CrawlJobs Logo

QA Engineering Lead, AI Native

meta.com Logo

Meta

Location Icon

Location:
United States , Menlo Park

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

138000.00 - 191000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

Meta is seeking a QA Engineering Lead with expertise in AI product and model testing to drive the quality vision for our next-generation AI-powered products. In this role, you will lead the design and execution of comprehensive test strategies for AI models spanning text, image, and voice, ensuring our solutions are robust, reliable, and ethically sound. You will work on products built with cutting-edge technology, serving billions of users worldwide, and play a pivotal role in shaping the future of AI quality at Meta.

Job Responsibility:

  • Build and foster a quality-driven engineering environment that enables rapid, confident product releases, ensuring that quality is embedded throughout the development lifecycle
  • Develop and implement robust evaluation processes for AI models, including prompt engineering, scenario-based, and adversarial testing for text, image, and voice AI systems
  • Drive the quality for products and features, assess risks, and ensure features ship with a high quality bar, balancing speed and experience
  • Plan, develop, and execute comprehensive test strategies across core Meta products and platforms, leveraging both manual and automated approaches
  • Lead quality assurance efforts that align with product objectives, developing scalable solutions to support rapid product iteration and deployment
  • Solve cross-platform engineering challenges and contribute impactful ideas to improve quality, reliability, and user experience across diverse product surfaces
  • Implement and evolve QA processes to obtain effective test signals and scale testing efforts across multiple products, ensuring continuous improvement
  • Define quality metrics and implement measurements to determine test effectiveness, testing efficiency, and overall product quality, using data-driven insights to guide decisions
  • Partner with engineering and infrastructure teams to leverage automation for scalable solutions, preventing regressions and ensuring the reliability of products and AI models
  • Apply Responsible AI practices including safety, ethics, alignment, and explainability by building safeguards and quality controls to validate AI outputs, ensuring transparency, and compliance with ethical standards

Requirements:

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 5+ years of experience in quality assurance, test engineering, and test automation
  • 1+ years of hands-on experience testing AI-powered products (web, iOS, and/or Android) that generate or transform text, images, and/or voice, including end-to-end feature validation and user experience quality
  • 1+ years of hands-on experience testing, debugging, and evaluating LLM/multimodal model behavior, including defining and applying quality standards for accuracy, relevance, grounding, safety/policy compliance, and cultural/locale sensitivity, and driving model-quality regressions to resolution
  • Experience effectively utilizing AI technologies and tools (e.g., large language models, agents, etc.) to enhance QA workflows
  • Experience collaborating cross-functionally and contributing to technical decisions through influence, communication, and execution
  • Experience changing priorities quickly and adapt effectively in a fast-moving product development cycle

Nice to have:

  • Experience in Python, PHP, Java, C/C++, or equivalent programming language
  • Experience leading and executing black-box and white-box testing strategies (test planning, coverage, execution, and triage)
  • Experience partnering with AI/ML research and engineering teams, and communicating effectively with technical and non-technical stakeholders at multiple levels
  • Experience building AI-assisted test automation/test agents using LLMs and agent frameworks (e.g., internal or industry tools) to generate, execute, and maintain tests
  • Experience using analytics to define, measure, and improve QA operational KPIs (e.g., defect escape rate, detection latency, automation coverage, flake rate)
  • Experience designing and building test automation frameworks that leverage generative AI for test creation, prioritization, and maintenance
What we offer:
  • bonus
  • equity
  • benefits

Additional Information:

Job Posted:
March 25, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Meta - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for QA Engineering Lead, AI Native

Head of AI Transformation & Operational Excellence

Lead Valtech’s end-to-end AI transformation and operational excellence for a maj...
Location
Location
France , Paris
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven track record in leading complex, data-driven or AI-enabled transformation programs
  • Demonstrated ability to move initiatives from POC to industrialized, production-grade solutions
  • Experience leading distributed delivery teams (onshore/offshore)
  • Strong understanding of e-commerce, retail, or omnichannel ecosystems
  • Ability to operate at both strategic and operational levels
  • Fully bilingual French / English is mandatory
  • Strong transformation leader with a clear, forward-looking vision
  • Clear, direct, and structured communicator
  • able to simplify complexity
  • Pragmatic, execution-focused, and value-driven
Job Responsibility
Job Responsibility
  • Lead Valtech’s end-to-end AI transformation and operational excellence for the client account
  • Own the definition, orchestration, and execution of AI initiatives, ensuring they move from POC to industrialized, production-grade capabilities delivering tangible value
  • Ensure AI-driven transformation is consistently embedded across the four core pillars of delivery: Agile Operating Model, Engineering, Quality & Testing, Production & Support
  • Drive innovation and continuous improvement of delivery and support operations, leveraging AI, automation, process optimization, and new operating practices
  • Define and own the global AI transformation roadmap across eRetail and omnichannel delivery
  • Ensure AI initiatives are aligned with the client’s business priorities and Valtech’s delivery and operational objectives
  • Drive AI adoption beyond experimentation, with clear industrialization paths, ownership models, and value tracking
  • Position AI as a structural enabler of delivery performance, quality, and operational efficiency
  • Work in close partnership with the AI Transformation Program Manager
  • Act as Valtech’s AI and operational excellence reference toward the client
What we offer
What we offer
  • Flexibility, with remote and hybrid work options (country-dependent)
  • Career advancement, with international mobility and professional development programs
  • Learning and development, with access to cutting-edge tools, training and industry experts
  • Fulltime
Read More
Arrow Right

Principal Software Automation Test Engineer

We are seeking an AI-savvy Principal QA Test Engineer to transform how we test a...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • M.S./B.S. degree in Computer Science, Electrical Engineering, or equivalent military experience required
  • 10+ years of experience in QA/Test Automation Engineering with demonstrated impact on product quality and team practices
  • 2+ years of hands-on experience with AI/ML technologies, including LLMs, prompt engineering, and AI-assisted development workflows
  • Proven track record of building autonomous testing systems or AI-powered quality engineering tools
  • Intermediate to Expert level experience with REST API driven automation using Python or Go
  • Deep expertise in cybersecurity, cloud networking, or distributed systems test, including expert knowledge of TCP/IP, DNS, and SSL/TLS
  • Experience with Identity Technologies such as Azure AD, Okta, or Ping Identity
  • Experience with cloud providers (AWS, Azure, GCP) and cloud networking architectures (VPCs, subnets, security groups, NAT)
  • Experience with Windows/Linux/MAC Networking and Security Features
  • Expertise in REST API testing, web UI automation (Selenium, Playwright, Puppeteer), and cloud-native application testing
Job Responsibility
Job Responsibility
  • Design and implement autonomous QA workflows using AI agents and LLM-based frameworks to achieve continuous, intelligent test execution across multiple services
  • Develop AI-augmented test infrastructure enabling scalable, context-aware testing that reflects real-world deployment scenarios
  • Build AI-powered test generation systems that automatically create comprehensive test suites from requirements, specifications, and production telemetry
  • Participate in system design to ensure quality, observability, and testability are built-in throughout the feature development lifecycle
  • Provide technical leadership in browser security, cloud orchestration, distributed systems, and AI-assisted quality engineering across multi-team quality initiatives
  • Mentor junior and mid-level engineers on AI/ML testing techniques, prompt engineering, and modern quality practices
  • lead adoption of new testing methodologies and measure impact
  • Collaborate with Development, SRE, Product Management, and Technical Marketing to align quality strategy with business outcomes and establish quality standards
  • Enhance test strategies, automation, and build infrastructure with feedback and analysis from real-world customer deployments
  • Stay current with AI/ML advancements and translate them into practical testing innovations like agentic workflows, multimodal testing, and AI-powered observability
  • Fulltime
Read More
Arrow Right

Principal AI Test Engineer - Prisma Access

We are seeking an AI-savvy Principal QA Test Engineer to transform how we test a...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in QA/Test Automation Engineering with demonstrated impact on product quality and team practices
  • 2+ years of hands-on experience with AI/ML technologies, including LLMs, prompt engineering, and AI-assisted development workflows
  • Proven track record of building autonomous testing systems or AI-powered quality engineering tools
  • Deep expertise in cybersecurity, cloud networking, or distributed systems test
  • Strong proficiency in Python and/or Go for test automation and AI workflow development
  • Hands-on experience with LLM frameworks and AI model integration
  • Expertise in REST API testing, web UI automation (Selenium, Playwright, Puppeteer), and cloud-native application testing
  • Experience with browser security solutions: enterprise browsers, remote browser isolation, browser extensions
  • Strong understanding of networking fundamentals: TCP/IP, DNS, routing, VPN technologies, and firewall concepts
  • Knowledge of SASE (Secure Access Service Edge) architecture and Zero Trust Network Access (ZTNA) principles
Job Responsibility
Job Responsibility
  • Design and implement autonomous QA workflows using AI agents and LLM-based frameworks to achieve continuous, intelligent test execution across multiple services
  • Develop AI-augmented test infrastructure enabling scalable, context-aware testing that reflects real-world deployment scenarios
  • Build AI-powered test generation systems that automatically create comprehensive test suites from requirements, specifications, and production telemetry
  • Participate in system design to ensure quality, observability, and testability are built-in throughout the feature development lifecycle
  • Provide technical leadership in browser security, cloud orchestration, distributed systems, and AI-assisted quality engineering across multi-team quality initiatives
  • Mentor junior and mid-level engineers on AI/ML testing techniques, prompt engineering, and modern quality practices
  • lead adoption of new testing methodologies and measure impact
  • Collaborate with Development, SRE, Product Management, and Technical Marketing to align quality strategy with business outcomes
  • influence peers without authority to establish quality standards
  • Stay current with AI/ML advancements and translate them into practical testing innovations (agentic workflows, multimodal testing, AI-powered observability)
What we offer
What we offer
  • restricted stock units
  • bonus
  • Fulltime
Read More
Arrow Right

Go-to-Market Systems Lead, AI Native

Universal Ads, a part of Comcast, enables any brand, of any size, to seamlessly ...
Location
Location
United States , New York
Salary
Salary:
96074.94 - 192149.88 USD / Year
comcastadvertising.com Logo
Comcast Advertising
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–10 years in GTM Systems, GTM Engineering, Growth Engineering, RevOps Engineering, or similar roles
  • Proven experience building automation that drove measurable commercial impact
  • Comfort writing scripts, working with APIs, and deploying workflow tools
  • Strong product sense - you understand user flows and commercial incentives
  • Highly curious and solution-oriented
  • Scrappy, hands-on builder mentality
  • Able to lead directionally without managing a large team
  • Desire to build and steer a high-impact function at a growing business
  • Bachelor's Degree preferred
  • 7-10 Years relevant work experience
Job Responsibility
Job Responsibility
  • Identify highest-impact automation opportunities across Growth, Sales, CS, and Product/GTM intersection
  • Audit GTM workflows and perform gap analysis
  • Pinpoint friction, manual work, and latency
  • Prioritize automation initiatives based on revenue or efficiency impact
  • Author clear architecture documentation
  • Build and deploy automation systems including AI-powered outbound workflows, lead enrichment and scoring systems, creative review and QA automation, fraud detection and risk scoring tools, CRM-triggered automations, agentic performance insight workflows, internal productivity tools
  • Inject AI effectively across the revenue org
  • Implement LLM-driven workflows
  • Create agents, automations and artifacts
  • Continuously evaluate emerging tools
What we offer
What we offer
  • Paid Time off
  • Physical Wellbeing
  • Financial Wellbeing
  • Emotional Wellbeing
  • Life Events + Family Support
  • Bonus
  • Commission for sales positions
  • Fulltime
Read More
Arrow Right
New

Sr Manager, Digital Products & Platforms

This role leads engineering teams that design, build, and operate enterprise-gra...
Location
Location
United States , Frisco; Overland Park
Salary
Salary:
160000.00 - 288500.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree and 7 years of related work experience or a combination of education and experience deemed equivalent Acceptable areas of study include Computer Science, Engineering, IT or equivalent experience
  • 7-10 years experience of developing large scale business systems applications in an agile product development environment with an engineering background across the modern stack (Java, Python, JavaScript/TypeScript, APIs, databases)
  • 2-4 years People leadership managing cross-functional engineering teams (5+ engineers in direct reporting relationships)—including hiring, performance management, career development, and org design
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Lead and manage cross-functional engineering teams (software engineers, QA, DevOps, data engineers, product managers) to deliver enterprise applications—providing technical direction, architecture guidance, coaching, and performance management
  • Build and evolve an agentic AI capability within the engineering org—standing up AI-assisted workflows (automated code generation, test creation, Jira-to-MR pipelines) that reduce cycle time and free engineers for high-judgment work
  • Define and drive continuous improvement and engineering excellence—CI/CD pipeline optimization, automated quality gates, tech debt management, and measurable productivity frameworks (DORA metrics, automation coverage)
  • Own the technical roadmap in collaboration with architecture, platform engineering, cybersecurity, and design teams—balancing feature delivery, platform modernization, and automation investment
  • Manage technical vendor relationships and evaluate emerging technology (AI/ML tooling, cloud-native platforms, data infrastructure) to keep the engineering stack current and competitive
  • Recruit, hire, and develop engineering talent who bring strong full-stack fundamentals, a bias toward automation, and the ability to work effectively alongside AI-augmented toolchains
What we offer
What we offer
  • competitive base salary and compensation package
  • annual stock grant
  • employee stock purchase plan
  • 401(k)
  • access to free, year-round money coaches
  • medical, dental and vision insurance
  • flexible spending account
  • paid time off and up to 12 paid holidays
  • paid parental and family leave
  • family building benefits
  • Fulltime
Read More
Arrow Right

Assistant Engineering Manager

At Foundation, we believe great engineering leaders stay close to the technology...
Location
Location
United States , Strongsville
Salary
Salary:
Not provided
foundationsoft.com Logo
Foundation Software
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of software engineering experience
  • Experience mentoring engineers and leading technical initiatives
  • Strong background in cloud-native architecture and modern application development
  • Passion for technical leadership and building high-performing engineering teams
  • Strong communication, collaboration, and leadership skills
  • Interest in emerging technologies such as Generative AI is a plus
Job Responsibility
Job Responsibility
  • Provide hands-on technical leadership building scalable cloud applications across Azure and AWS
  • Lead by example through architecture guidance, design reviews, and mentoring engineers on complex technical challenges
  • Mentor engineers through code reviews, design discussions, and technical coaching
  • Help lead and grow a high-performing engineering team (onshore and offshore)
  • Collaborate with Product, QA, Architecture, Security, and DevOps to deliver integrated solutions
  • Promote engineering excellence through SOLID principles, clean code, modern architecture patterns, and observability
  • Assist with planning and execution across multiple product initiatives
What we offer
What we offer
  • On-site fitness center, personal training, and fitness classes
  • Massages, manicures/pedicures, house cleaning, laundry service
  • Catered lunches, monthly happy hours, and car washes
  • Game room, kitchen, snacks, and coffee
  • Strong benefits including 401(k) match, tuition reimbursement, and full health coverage
  • Fulltime
Read More
Arrow Right

Senior Software Development Manager

At Appian, we’re passionate about technology—we love making it, and we love usin...
Location
Location
India , Chennai
Salary
Salary:
Not provided
appian.com Logo
Appian Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field
  • 15+ years of experience in software engineering
  • Proven track record in building and scaling distributed systems, preferably in cloud-native environments and modernization of platforms
  • Proven experience leading development teams
  • Strong knowledge of enterprise application architecture
  • Leading engineering teams and managers
  • Deep Understanding software engineering, Algorithms and Data Structures
  • Proficiency in any programming Language (Java, C++, Python, other programming languages)
  • Working knowledge of container technologies, orchestration frameworks (e.g., Kubernetes), and workflow automation
  • Familiarity with GPU computing and hybrid CPU/GPU architectures
Job Responsibility
Job Responsibility
  • Provide technical leadership for a specific product area
  • Directly drive the professional development of the engineers on your team
  • Manage development teams
  • Oversee architecture decisions
  • Ensure scalable, high-quality delivery aligned with business objectives
  • Guide software engineers through solving ambiguous and complex problems
  • Champion an AI-first approach
  • Bring deep experience in migrating and modernizing legacy applications using cloud-native, modular architectures and emerging technologies
  • Lead and mentor a team of developers, architects, and analysts
  • Set very high standards for the team and in hiring talent
What we offer
What we offer
  • Health coverage
  • Employee Assistance Program (EAP) with free mental health support
  • Life and disability insurance
  • Employee Stock Purchase Program (ESPP)
  • Retirement/pension plan
  • Wellness dollars
  • Tuition reimbursement
  • Family-forming benefits
Read More
Arrow Right

Executive Director, Digital Engineering- Aetna Member Services

The Executive Director, Digital Engineering- Aetna Member Services is a senior t...
Location
Location
United States , Work at Home
Salary
Salary:
175100.00 - 334750.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
May 31, 2026
Flip Icon
Requirements
Requirements
  • 15+ years of software engineering experience with deep expertise in backend systems, distributed services, and API platforms
  • Proven experience leading large engineering organizations delivering mission‑critical services
  • Strong background in AWS cloud platform, microservices architecture, CI/CD pipelines, and DevOps/SRE practices
  • Demonstrated success driving stability, resiliency, and observability improvements at scale
  • Experience leveraging AI, ML, or LLM-based engineering and operational tooling
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Lead the design, development, and delivery of scalable backend systems, APIs, and microservices powering member-facing capabilities
  • Define API contract standards, and integration patterns used across Member Services platforms
  • Drive service modernization by adopting cloud‑native architectures, containerization, service mesh, and event-driven patterns
  • Establish standards for availability, resiliency, performance, and disaster recovery across all services
  • Implement SLO/SLI/error budget frameworks, health checks, and high‑availability architectures
  • Institutionalize strong observability practices using metrics, logs, traces, and distributed monitoring
  • Drive continuous reliability improvements through chaos engineering, automated fault injection, and proactive root‑cause analysis
  • Integrate AI and LLM-based tooling into software development, QA, and operational processes
  • Promote AIOps capabilities to reduce manual toil and amplify engineering productivity
  • Introduce AI-enhanced workflows across Member Services to improve personalization, routing, and intelligent decisioning
What we offer
What we offer
  • Affordable medical plan options
  • 401(k) plan (including matching company contributions)
  • Employee stock purchase plan
  • No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
  • Paid time off
  • Flexible work schedules
  • Family leave
  • Dependent care resources
  • Colleague assistance programs
  • Tuition assistance
  • Fulltime
Read More
Arrow Right