CrawlJobs Logo

QA Engineering Lead, AI Native

meta.com Logo

Meta

Location Icon

Location:
United States , Menlo Park

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

138000.00 - 191000.00 USD / Year

Job Description:

Meta is seeking a QA Engineering Lead with expertise in AI product and model testing to drive the quality vision for our next-generation AI-powered products. In this role, you will lead the design and execution of comprehensive test strategies for AI models spanning text, image, and voice, ensuring our solutions are robust, reliable, and ethically sound. You will work on products built with cutting-edge technology, serving billions of users worldwide, and play a pivotal role in shaping the future of AI quality at Meta.

Job Responsibility:

  • Build and foster a quality-driven engineering environment that enables rapid, confident product releases, ensuring that quality is embedded throughout the development lifecycle
  • Develop and implement robust evaluation processes for AI models, including prompt engineering, scenario-based, and adversarial testing for text, image, and voice AI systems
  • Drive the quality for products and features, assess risks, and ensure features ship with a high quality bar, balancing speed and experience
  • Plan, develop, and execute comprehensive test strategies across core Meta products and platforms, leveraging both manual and automated approaches
  • Lead quality assurance efforts that align with product objectives, developing scalable solutions to support rapid product iteration and deployment
  • Solve cross-platform engineering challenges and contribute impactful ideas to improve quality, reliability, and user experience across diverse product surfaces
  • Implement and evolve QA processes to obtain effective test signals and scale testing efforts across multiple products, ensuring continuous improvement
  • Define quality metrics and implement measurements to determine test effectiveness, testing efficiency, and overall product quality, using data-driven insights to guide decisions
  • Partner with engineering and infrastructure teams to leverage automation for scalable solutions, preventing regressions and ensuring the reliability of products and AI models
  • Apply Responsible AI practices including safety, ethics, alignment, and explainability by building safeguards and quality controls to validate AI outputs, ensuring transparency, and compliance with ethical standards

Requirements:

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 5+ years of experience in quality assurance, test engineering, and test automation
  • 1+ years of hands-on experience testing AI-powered products (web, iOS, and/or Android) that generate or transform text, images, and/or voice, including end-to-end feature validation and user experience quality
  • 1+ years of hands-on experience testing, debugging, and evaluating LLM/multimodal model behavior, including defining and applying quality standards for accuracy, relevance, grounding, safety/policy compliance, and cultural/locale sensitivity, and driving model-quality regressions to resolution
  • Experience effectively utilizing AI technologies and tools (e.g., large language models, agents, etc.) to enhance QA workflows
  • Experience collaborating cross-functionally and contributing to technical decisions through influence, communication, and execution
  • Experience changing priorities quickly and adapt effectively in a fast-moving product development cycle

Nice to have:

  • Experience in Python, PHP, Java, C/C++, or equivalent programming language
  • Experience leading and executing black-box and white-box testing strategies (test planning, coverage, execution, and triage)
  • Experience partnering with AI/ML research and engineering teams, and communicating effectively with technical and non-technical stakeholders at multiple levels
  • Experience building AI-assisted test automation/test agents using LLMs and agent frameworks (e.g., internal or industry tools) to generate, execute, and maintain tests
  • Experience using analytics to define, measure, and improve QA operational KPIs (e.g., defect escape rate, detection latency, automation coverage, flake rate)
  • Experience designing and building test automation frameworks that leverage generative AI for test creation, prioritization, and maintenance
What we offer:
  • bonus
  • equity
  • benefits

Additional Information:

Job Posted:
March 25, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for QA Engineering Lead, AI Native

Head of AI Transformation & Operational Excellence

Lead Valtech’s end-to-end AI transformation and operational excellence for a maj...
Location
Location
France , Paris
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven track record in leading complex, data-driven or AI-enabled transformation programs
  • Demonstrated ability to move initiatives from POC to industrialized, production-grade solutions
  • Experience leading distributed delivery teams (onshore/offshore)
  • Strong understanding of e-commerce, retail, or omnichannel ecosystems
  • Ability to operate at both strategic and operational levels
  • Fully bilingual French / English is mandatory
  • Strong transformation leader with a clear, forward-looking vision
  • Clear, direct, and structured communicator
  • able to simplify complexity
  • Pragmatic, execution-focused, and value-driven
Job Responsibility
Job Responsibility
  • Lead Valtech’s end-to-end AI transformation and operational excellence for the client account
  • Own the definition, orchestration, and execution of AI initiatives, ensuring they move from POC to industrialized, production-grade capabilities delivering tangible value
  • Ensure AI-driven transformation is consistently embedded across the four core pillars of delivery: Agile Operating Model, Engineering, Quality & Testing, Production & Support
  • Drive innovation and continuous improvement of delivery and support operations, leveraging AI, automation, process optimization, and new operating practices
  • Define and own the global AI transformation roadmap across eRetail and omnichannel delivery
  • Ensure AI initiatives are aligned with the client’s business priorities and Valtech’s delivery and operational objectives
  • Drive AI adoption beyond experimentation, with clear industrialization paths, ownership models, and value tracking
  • Position AI as a structural enabler of delivery performance, quality, and operational efficiency
  • Work in close partnership with the AI Transformation Program Manager
  • Act as Valtech’s AI and operational excellence reference toward the client
What we offer
What we offer
  • Flexibility, with remote and hybrid work options (country-dependent)
  • Career advancement, with international mobility and professional development programs
  • Learning and development, with access to cutting-edge tools, training and industry experts
  • Fulltime
Read More
Arrow Right
New

Principal AI Test Engineer - Prisma Access

We are seeking an AI-savvy Principal QA Test Engineer to transform how we test a...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in QA/Test Automation Engineering with demonstrated impact on product quality and team practices
  • 2+ years of hands-on experience with AI/ML technologies, including LLMs, prompt engineering, and AI-assisted development workflows
  • Proven track record of building autonomous testing systems or AI-powered quality engineering tools
  • Deep expertise in cybersecurity, cloud networking, or distributed systems test
  • Strong proficiency in Python and/or Go for test automation and AI workflow development
  • Hands-on experience with LLM frameworks and AI model integration
  • Expertise in REST API testing, web UI automation (Selenium, Playwright, Puppeteer), and cloud-native application testing
  • Experience with browser security solutions: enterprise browsers, remote browser isolation, browser extensions
  • Strong understanding of networking fundamentals: TCP/IP, DNS, routing, VPN technologies, and firewall concepts
  • Knowledge of SASE (Secure Access Service Edge) architecture and Zero Trust Network Access (ZTNA) principles
Job Responsibility
Job Responsibility
  • Design and implement autonomous QA workflows using AI agents and LLM-based frameworks to achieve continuous, intelligent test execution across multiple services
  • Develop AI-augmented test infrastructure enabling scalable, context-aware testing that reflects real-world deployment scenarios
  • Build AI-powered test generation systems that automatically create comprehensive test suites from requirements, specifications, and production telemetry
  • Participate in system design to ensure quality, observability, and testability are built-in throughout the feature development lifecycle
  • Provide technical leadership in browser security, cloud orchestration, distributed systems, and AI-assisted quality engineering across multi-team quality initiatives
  • Mentor junior and mid-level engineers on AI/ML testing techniques, prompt engineering, and modern quality practices
  • lead adoption of new testing methodologies and measure impact
  • Collaborate with Development, SRE, Product Management, and Technical Marketing to align quality strategy with business outcomes
  • influence peers without authority to establish quality standards
  • Stay current with AI/ML advancements and translate them into practical testing innovations (agentic workflows, multimodal testing, AI-powered observability)
What we offer
What we offer
  • restricted stock units
  • bonus
  • Fulltime
Read More
Arrow Right
New

Senior Software Development Manager

At Appian, we’re passionate about technology—we love making it, and we love usin...
Location
Location
India , Chennai
Salary
Salary:
Not provided
appian.com Logo
Appian Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field
  • 15+ years of experience in software engineering
  • Proven track record in building and scaling distributed systems, preferably in cloud-native environments and modernization of platforms
  • Proven experience leading development teams
  • Strong knowledge of enterprise application architecture
  • Leading engineering teams and managers
  • Deep Understanding software engineering, Algorithms and Data Structures
  • Proficiency in any programming Language (Java, C++, Python, other programming languages)
  • Working knowledge of container technologies, orchestration frameworks (e.g., Kubernetes), and workflow automation
  • Familiarity with GPU computing and hybrid CPU/GPU architectures
Job Responsibility
Job Responsibility
  • Provide technical leadership for a specific product area
  • Directly drive the professional development of the engineers on your team
  • Manage development teams
  • Oversee architecture decisions
  • Ensure scalable, high-quality delivery aligned with business objectives
  • Guide software engineers through solving ambiguous and complex problems
  • Champion an AI-first approach
  • Bring deep experience in migrating and modernizing legacy applications using cloud-native, modular architectures and emerging technologies
  • Lead and mentor a team of developers, architects, and analysts
  • Set very high standards for the team and in hiring talent
What we offer
What we offer
  • Health coverage
  • Employee Assistance Program (EAP) with free mental health support
  • Life and disability insurance
  • Employee Stock Purchase Program (ESPP)
  • Retirement/pension plan
  • Wellness dollars
  • Tuition reimbursement
  • Family-forming benefits
Read More
Arrow Right
New

Executive Director, Digital Engineering- Aetna Member Services

The Executive Director, Digital Engineering- Aetna Member Services is a senior t...
Location
Location
United States , Work at Home
Salary
Salary:
175100.00 - 334750.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
May 31, 2026
Flip Icon
Requirements
Requirements
  • 15+ years of software engineering experience with deep expertise in backend systems, distributed services, and API platforms
  • Proven experience leading large engineering organizations delivering mission‑critical services
  • Strong background in AWS cloud platform, microservices architecture, CI/CD pipelines, and DevOps/SRE practices
  • Demonstrated success driving stability, resiliency, and observability improvements at scale
  • Experience leveraging AI, ML, or LLM-based engineering and operational tooling
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Lead the design, development, and delivery of scalable backend systems, APIs, and microservices powering member-facing capabilities
  • Define API contract standards, and integration patterns used across Member Services platforms
  • Drive service modernization by adopting cloud‑native architectures, containerization, service mesh, and event-driven patterns
  • Establish standards for availability, resiliency, performance, and disaster recovery across all services
  • Implement SLO/SLI/error budget frameworks, health checks, and high‑availability architectures
  • Institutionalize strong observability practices using metrics, logs, traces, and distributed monitoring
  • Drive continuous reliability improvements through chaos engineering, automated fault injection, and proactive root‑cause analysis
  • Integrate AI and LLM-based tooling into software development, QA, and operational processes
  • Promote AIOps capabilities to reduce manual toil and amplify engineering productivity
  • Introduce AI-enhanced workflows across Member Services to improve personalization, routing, and intelligent decisioning
What we offer
What we offer
  • Affordable medical plan options
  • 401(k) plan (including matching company contributions)
  • Employee stock purchase plan
  • No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
  • Paid time off
  • Flexible work schedules
  • Family leave
  • Dependent care resources
  • Colleague assistance programs
  • Tuition assistance
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or related field AND 8+ years of Fullstack experience with AI, building software tools, internal platforms, automation systems, or developer productivity solutions
  • Hands on experience with AI / Agentic AI / LLM / MCP servers
  • Strong coding expertise in C#, TypeScript, Java, Python, or JavaScript
Job Responsibility
Job Responsibility
  • Architect, design, and implement internal tools and platforms that modernize engineering workflows for Power BI Desktop and Service
  • Build scalable, secure, and reliable systems that support productivity, automation, and compliance across engineering teams
  • Lead tool-driven automation that improves validation, release readiness, diagnostic workflows, and engineering observability
  • Integrate GenAI, telemetry, and ML-based intelligence into tools to enhance coverage, detection, and engineering insights
  • Modernize legacy systems by migrating them to cloud-native, maintainable architectures
  • Partner with PM, QA, Release Engineering, and Partner Teams (Desktop, Service, Infra, ADO/GitHub) to align tooling needs and engineering OKRs
  • Mentor engineers and foster a culture of craftsmanship, learning, and technical excellence
  • Influence engineering strategy through data-driven insights, metrics, and tooling analytics
  • Drive continuous improvement through measurable success indicators and iterative tool enhancements
  • Fulltime
Read More
Arrow Right
New

Senior Manager Software Development

At Appian, we’re passionate about technology—we love making it, and we love usin...
Location
Location
India , Chennai
Salary
Salary:
Not provided
appian.com Logo
Appian Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field
  • 15+ years of experience in software engineering
  • Proven track record in building and scaling distributed systems, preferably in cloud-native environments and modernization of platforms
  • AI/ML adoption
  • Proven experience leading development teams
  • Strong knowledge of enterprise application architecture
  • Leading engineering teams and managers
  • Deep Understanding software engineering, Algorithms and Data Structures
  • Experience in AI Adoptability and usage and ML is highly desirable
  • Proficiency in any programming Language (Java, C++, Python, other programming languages)
Job Responsibility
Job Responsibility
  • Manage development teams, oversee architecture decisions, and ensure scalable, high-quality delivery aligned with business objectives
  • Guide software engineers through solving ambiguous and complex problems
  • Champion an AI-first approach
  • Bring deep experience in migrating and modernizing legacy applications using cloud-native, modular architectures and emerging technologies
  • Lead and mentor a team of developers, architects, and analysts
  • Set very high standards for the team and in hiring talent
  • Manage end-to-end project delivery
  • Establish development standards, governance, and best practices
  • Drive cross-functional teams
  • Collaborate with stakeholders, product owners, and cross-functional teams
What we offer
What we offer
  • Health coverage
  • Employee Assistance Program (EAP) with free mental health support
  • Life and disability insurance
  • Employee Stock Purchase Program (ESPP)
  • Retirement/pension plan
  • Wellness dollars
  • Tuition reimbursement
  • Family-forming benefits
Read More
Arrow Right

Lead IoT Platform Engineer

SoftClouds LLC is looking for a Full-Time Lead IoT Platform Engineer with at le...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
softclouds.com Logo
SoftClouds
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 14+ years of professional software engineering experience with a proven track record of delivering scalable, reliable systems
  • 6+ years of hands-on AWS experience building multi-service architectures
  • 5+ years in technical leadership or lead developer roles
  • 3+ years managing or mentoring engineering teams
  • 2+ years working with IoT platforms, real-time data systems, or telemetry processing
  • Proficiency in Java 17+ (5+ years of hands-on experience)
  • Proficiency in Spring Boot 3.x.
  • Proficiency in AWS SDK for Java v2
  • Proficiency in Lombok
  • Proficiency in Lambda PowerTools
Job Responsibility
Job Responsibility
  • Participate in the planning, architecture, and development of software solutions, integrating AI, machine learning, and data-driven features where applicable
  • Write high-quality code to develop and maintain scalable, high-performance systems, emphasizing security and long-term sustainability
  • Design and implement event-driven architectures using DynamoDB Streams, EventBridge, SQS, and Kinesis
  • Build serverless microservices with AWS Lambda and container-based services with ECS/Fargate
  • Develop RESTful APIs using API Gateway with proper authentication, rate limiting, and caching strategies
  • Optimize system performance across the entire stack including JVM tuning, connection pooling, and query optimization
  • Drive deployment, monitoring, and continuous improvement of systems including AI models and analytics components
  • Lead and mentor a team of 2-4+ software engineers, fostering a collaborative and innovative environment
  • Conduct code reviews and establish coding standards across multiple repositories
  • Drive technical decision-making and evangelize best practices for cloud-native development
  • Fulltime
Read More
Arrow Right
New

Senior Technical Project Manager

As a Senior Technical Project Manager in the Vehicle Hardware Team at Voi, you w...
Location
Location
Sweden , Stockholm
Salary
Salary:
Not provided
voi.com Logo
Voi Technology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A bachelor’s degree or higher in an engineering discipline (or equivalent practical experience)
  • Strong experience working closely with hardware suppliers, ideally including Chinese partners
  • Proven experience collaborating with multi‑disciplinary hardware teams (mechanical, electrical, test & verification, certification) as well as procurement, firmware, QA and supply chain
  • Experience leading products through the full lifecycle – from goal setting and requirements through launch and resolving in‑field issues
  • Excellent presentation and communication skills, able to explain technical topics and business trade‑offs to senior stakeholders
  • Strong mechanical engineering understanding, including working with DFMEA, PFMEA, FEA, reliability test reports and hands‑on repairability assessments
  • Solid electrical engineering understanding to engage in DFMEA/PFMEA and review reliability test reports
  • Excellent analytical and technical problem‑solving skills
  • AI‑native working style and confidence using modern AI tools in your daily work to increase speed, structure and quality
  • Fluency in English, both written and spoken
Job Responsibility
Job Responsibility
  • Lead end‑to‑end project management for typically two hardware procurement and development projects in parallel
  • Coordinate Voi teams and suppliers on timelines, milestones, risks, status and next steps to secure on‑time, high‑quality deliveries
  • Translate Voi’s needs into clear goals and technical requirements, and drive evaluation of samples across UX, repairability, reliability, energy efficiency and more
  • Support Voi engineers and suppliers on technical topics, contributing to documents such as DFMEA, PFMEA, FEA, Design for Reliability and Design for Repairability reports
  • Manage structured handling of actions, decisions, accountability and documentation to ensure smooth project progress
  • Present clear, concise project and technical status updates to the executive team, incorporating input from senior leadership into project plans
  • Build strong relationships and lead tough but constructive discussions and negotiations with suppliers on timelines, quality and technical issues
  • Travel regularly (e.g. quarterly) to China and occasionally to other supplier locations and Voi markets to work hands‑on with partners and in‑field issues
What we offer
What we offer
  • Get “skin in the game” through our employee options programme
  • Enjoy unlimited free Voi rides and a dog‑friendly office
  • Fulltime
Read More
Arrow Right