CrawlJobs Logo

QA Engineering Lead, AI Native

United States, Menlo Park 138000.00 - 191000.00 USD / Year · Job Posted March 25, 2026
Apply Position
Job Link Share

Job Description

Meta is seeking a QA Engineering Lead with expertise in AI product and model testing to drive the quality vision for our next-generation AI-powered products. In this role, you will lead the design and execution of comprehensive test strategies for AI models spanning text, image, and voice, ensuring our solutions are robust, reliable, and ethically sound. You will work on products built with cutting-edge technology, serving billions of users worldwide, and play a pivotal role in shaping the future of AI quality at Meta.

Job Responsibility

  • Build and foster a quality-driven engineering environment that enables rapid, confident product releases, ensuring that quality is embedded throughout the development lifecycle
  • Develop and implement robust evaluation processes for AI models, including prompt engineering, scenario-based, and adversarial testing for text, image, and voice AI systems
  • Drive the quality for products and features, assess risks, and ensure features ship with a high quality bar, balancing speed and experience
  • Plan, develop, and execute comprehensive test strategies across core Meta products and platforms, leveraging both manual and automated approaches
  • Lead quality assurance efforts that align with product objectives, developing scalable solutions to support rapid product iteration and deployment
  • Solve cross-platform engineering challenges and contribute impactful ideas to improve quality, reliability, and user experience across diverse product surfaces
  • Implement and evolve QA processes to obtain effective test signals and scale testing efforts across multiple products, ensuring continuous improvement
  • Define quality metrics and implement measurements to determine test effectiveness, testing efficiency, and overall product quality, using data-driven insights to guide decisions
  • Partner with engineering and infrastructure teams to leverage automation for scalable solutions, preventing regressions and ensuring the reliability of products and AI models
  • Apply Responsible AI practices including safety, ethics, alignment, and explainability by building safeguards and quality controls to validate AI outputs, ensuring transparency, and compliance with ethical standards

Requirements

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 5+ years of experience in quality assurance, test engineering, and test automation
  • 1+ years of hands-on experience testing AI-powered products (web, iOS, and/or Android) that generate or transform text, images, and/or voice, including end-to-end feature validation and user experience quality
  • 1+ years of hands-on experience testing, debugging, and evaluating LLM/multimodal model behavior, including defining and applying quality standards for accuracy, relevance, grounding, safety/policy compliance, and cultural/locale sensitivity, and driving model-quality regressions to resolution
  • Experience effectively utilizing AI technologies and tools (e.g., large language models, agents, etc.) to enhance QA workflows
  • Experience collaborating cross-functionally and contributing to technical decisions through influence, communication, and execution
  • Experience changing priorities quickly and adapt effectively in a fast-moving product development cycle

Nice to have

  • Experience in Python, PHP, Java, C/C++, or equivalent programming language
  • Experience leading and executing black-box and white-box testing strategies (test planning, coverage, execution, and triage)
  • Experience partnering with AI/ML research and engineering teams, and communicating effectively with technical and non-technical stakeholders at multiple levels
  • Experience building AI-assisted test automation/test agents using LLMs and agent frameworks (e.g., internal or industry tools) to generate, execute, and maintain tests
  • Experience using analytics to define, measure, and improve QA operational KPIs (e.g., defect escape rate, detection latency, automation coverage, flake rate)
  • Experience designing and building test automation frameworks that leverage generative AI for test creation, prioritization, and maintenance

What we offer

  • bonus
  • equity
  • benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

QA Engineering Lead, AI Native

8 matching positions

Go-to-Market Systems Lead, AI Native

Universal Ads, a part of Comcast, enables any brand, of any size, to seamlessly ...
Location
Location
United States , New York
Salary
Salary:
96074.94 - 192149.88 USD / Year
comcastadvertising.com Logo
Comcast Advertising
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–10 years in GTM Systems, GTM Engineering, Growth Engineering, RevOps Engineering, or similar roles
  • Proven experience building automation that drove measurable commercial impact
  • Comfort writing scripts, working with APIs, and deploying workflow tools
  • Strong product sense - you understand user flows and commercial incentives
  • Highly curious and solution-oriented
  • Scrappy, hands-on builder mentality
  • Able to lead directionally without managing a large team
  • Desire to build and steer a high-impact function at a growing business
  • Bachelor's Degree preferred
  • 7-10 Years relevant work experience
Job Responsibility
Job Responsibility
  • Identify highest-impact automation opportunities across Growth, Sales, CS, and Product/GTM intersection
  • Audit GTM workflows and perform gap analysis
  • Pinpoint friction, manual work, and latency
  • Prioritize automation initiatives based on revenue or efficiency impact
  • Author clear architecture documentation
  • Build and deploy automation systems including AI-powered outbound workflows, lead enrichment and scoring systems, creative review and QA automation, fraud detection and risk scoring tools, CRM-triggered automations, agentic performance insight workflows, internal productivity tools
  • Inject AI effectively across the revenue org
  • Implement LLM-driven workflows
  • Create agents, automations and artifacts
  • Continuously evaluate emerging tools
What we offer
What we offer
  • Paid Time off
  • Physical Wellbeing
  • Financial Wellbeing
  • Emotional Wellbeing
  • Life Events + Family Support
  • Bonus
  • Commission for sales positions
  • Fulltime
Read More
Arrow Right

Lead AI Engineer (Generative AI)

Location
Location
Australia , Melbourne
Salary
Salary:
160000.00 - 170000.00 AUD / Year
welovesalt.com Logo
Salt
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 – 4 years experience applying modern Generative AI in real delivery environments
  • A strong track record of providing technical leadership
  • A strong background in software engineering before stepping into a more AI-focused role in recent times
  • Deep expertise in Generative AI, large language models, retrieval‑augmented generation (RAG), and modern machine learning techniques
  • Strengths in prompt engineering, offline/online evaluation, safety guardrails, and telemetry‑driven improvement
  • Practical experience with RAG, embeddings/vector search, and tool‑use/function‑calling orchestration
  • The ability to define trustworthy AI metrics
  • A Software engineering background using the likes of React, Typescript, React Native
  • AWS experience / certifications
  • Strong knowledge of CI/CD
Job Responsibility
Job Responsibility
  • Accelerating the adoption of Generative AI for this company, leading the adoption of AI‑first engineering practices and an 'AI-first' mindset
  • Providing technical leadership and shaping AI-enabled solutions
  • Reporting into the Head of Technology and working closely with the Head of Enterprise AI
  • Collaborating with a variety of cross-functional teams including
  • Engineering, QA, BA, Product Management, Senior Business Stakeholders, Data Science, Cyber Security, Enterprise Architecture
  • Coaching and training engineers and leaders in the organisation in safe, effective AI‑assisted development
  • Encouraging teams to embed AI‑driven thinking in solution design and delivery
  • Defining and helping to operationalise trustworthy metrics to measure the impact of AI features, and developer productivity uplifts
  • Producing AI-augmented solution designs when required
  • Driving engineering excellence by uplifting standards, modernising technical practices, and championing AI‑aligned SDLC patterns
What we offer
What we offer
  • Super
  • Bonus
  • Fulltime
Read More
Arrow Right

Manager / Sr Manager, Engineering (AI Posture)

Location
Location
United States , Santa Clara
Salary
Salary:
185000.00 - 298000.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-7 years of experience managing software engineering teams within a large-scale organization
  • 5+ years of hands-on software engineering experience with a strong systems-level foundation
  • Proven ability to plan, execute, and deliver complex roadmaps with high predictability, owning distributed cloud products end-to-end
  • Demonstrated experience leading teams through the delivery of complex, data-rich web applications with a focus on performance and usability
  • Demonstrated experience designing and operating large-scale cloud architectures on platforms such as GCP, AWS, or Azure
  • Strong collaboration skills with a track record of aligning cross-disciplinary teams around shared objectives
Job Responsibility
Job Responsibility
  • Build, mentor, and lead a high-performing software engineering team, fostering a culture of empowerment and driving both individual growth and collective impact
  • Partner closely with Product Management and cross-functional teams (Infrastructure, UX, SRE & QA) to define priorities and shape multi-quarter product roadmaps, ensuring alignment across all stakeholders
  • Own the end-to-end software development lifecycle, translating product strategy into executable plans and ensuring consistent, high-quality, on-time delivery
  • Provide architectural leadership for scalable, distributed systems guiding the design and implementation of high-throughput, cloud-native applications
  • Drive production readiness by enforcing best practices around deployment, observability, reliability, and runtime stability, focusing on the details to ensure operational excellence
  • Align stakeholders across business units through clear communication of technical strategy, trade-offs, priorities, risks, and execution plans
  • Engage directly with strategic customers to lead technical deep dives and architecture reviews, and to influence future product direction
  • Foster a culture of high engineering standards, accountability, and continuous improvement, with a strong emphasis on quality and security
  • Fulltime
Read More
Arrow Right

Manager, Engineering (AI Posture)

As a full stack Engineering Manager at the AI Posture team, you will lead a team...
Location
Location
United States , Santa Clara
Salary
Salary:
165000.00 - 267500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-7 years of experience managing software engineering teams within a large-scale organization
  • 5+ years of hands-on software engineering experience with a strong systems-level foundation
  • Proven ability to plan, execute, and deliver complex roadmaps with high predictability, owning distributed cloud products end-to-end
  • Demonstrated experience leading teams through the delivery of complex, data-rich web applications with a focus on performance and usability
  • Demonstrated experience designing and operating large-scale cloud architectures on platforms such as GCP, AWS, or Azure
  • Strong collaboration skills with a track record of aligning cross-disciplinary teams around shared objectives
Job Responsibility
Job Responsibility
  • Build, mentor, and lead a high-performing software engineering team, fostering a culture of empowerment and driving both individual growth and collective impact
  • Partner closely with Product Management and cross-functional teams (Infrastructure, UX, SRE & QA) to define priorities and shape multi-quarter product roadmaps, ensuring alignment across all stakeholders
  • Own the end-to-end software development lifecycle, translating product strategy into executable plans and ensuring consistent, high-quality, on-time delivery
  • Provide architectural leadership for scalable, distributed systems guiding the design and implementation of high-throughput, cloud-native applications
  • Drive production readiness by enforcing best practices around deployment, observability, reliability, and runtime stability, focusing on the details to ensure operational excellence
  • Align stakeholders across business units through clear communication of technical strategy, trade-offs, priorities, risks, and execution plans
  • Engage directly with strategic customers to lead technical deep dives and architecture reviews, and to influence future product direction
  • Foster a culture of high engineering standards, accountability, and continuous improvement, with a strong emphasis on quality and security
  • Fulltime
Read More
Arrow Right

Lead Data Engineer - AI Search

We are looking for a Lead Data Engineer — AI Search (all genders) to join Valtec...
Location
Location
France , Paris
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional software engineering experience in enterprise environments
  • Strong expertise in Google Cloud Platform (GCP) and AI ecosystems
  • Experience with AI Search, conversational AI, and generative AI integrations
  • Strong application architecture, API design, and enterprise integration experience
  • Solid understanding of cloud-native, microservices, and event-driven architectures
  • Experience with CI/CD pipelines, software quality, observability, and cloud security best practices
  • Experience working with Kubernetes and Infrastructure as Code
  • Technical leadership experience, including mentoring engineers and guiding technical decisions
  • Ability to collaborate across architecture, engineering, cloud, and data teams
  • Strong communication and stakeholder management skills
Job Responsibility
Job Responsibility
  • Define detailed technical design, components, interfaces, and integration patterns
  • Lead development teams and enforce engineering standards and best practices
  • Coordinate architecture, cloud/platform, data, QA, and business stakeholders
  • Ensure delivery quality through testing, observability, and application security practices
  • Guide teams on GCP and AI Search implementation patterns
  • Lead technical discovery, estimation, and solution design workshops
  • Identify technical risks and propose mitigation strategies early
  • Ensure scalable, reliable, and production-ready AI solutions
  • Contribute hands-on in complex and high-impact technical areas
  • Support industrialization and operationalization of AI and search use cases
What we offer
What we offer
  • Flexibility, with remote and hybrid work options (country-dependent)
  • Career advancement, with international mobility and professional development programs
  • Learning and development, with access to cutting-edge tools, training and industry experts
  • Fulltime
Read More
Arrow Right

Tech Lead – Full Stack (AI-First Mindset)

As a Tech Lead (AI-First), you will lead technical execution across full-stack a...
Location
Location
India
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7–12+ years of software development experience with strong full-stack expertise
  • Deep hands-on skills in React.js, Angular, Node.js, Express.js, NestJS
  • Strong understanding of microservices, API design, and distributed systems
  • Proven experience leading technical projects or small teams
  • Experience integrating AI/LLM-based features OR willingness + capability to adopt AI-first tools.
Job Responsibility
Job Responsibility
  • Lead technical design, architecture decisions, and development workflows across frontend and backend systems
  • Provide direction on frameworks, patterns, code quality, and performance optimization
  • Mentor engineers, perform code reviews, and ensure engineering best practices
  • Evaluate new AI tools, frameworks, and libraries for integration into the project
  • Apply AI tools and LLMs to improve developer productivity (code generation, testing, documentation, automation)
  • Design systems that can support future AI/ML capabilities (API orchestration, extensible data models, scalable services)
  • Partner with AI/ML engineers to embed models into full-stack applications
  • Build scalable applications using React.js, Angular, Node.js, Express.js, NestJS
  • Design and develop RESTful APIs, microservices, and backend logic
  • Build reusable UI components, dashboards, and interactive interfaces
  • Fulltime
Read More
Arrow Right

Director of Engineering

We're looking for a Director of Engineering to lead the technical delivery of ou...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
collinsongroup.com Logo
Collinson
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Has led engineering teams as a Head of Engineering (or equivalent senior leadership role) before, accountable for delivery across multiple squads
  • Proven track record delivering business-critical, client-facing software at scale while protecting delivery commitments
  • Excellent people leadership skills, with a belief that the strongest teams are ones that love coming to work every day
  • Credible technical depth in modern cloud-native architecture on AWS, with hands-on understanding of TypeScript, Node.js, React, Kubernetes, serverless, eventing and modern data stores
  • Comfortable engaging with clients and other external stakeholders at a leadership level for both ongoing and new technical initiatives
  • Track record embedding quality, observability and operational readiness into delivery, and owning incident response for production services
  • Comfortable operating across both executive and technical levels, translating technical reality into clear narratives for senior, product and commercial stakeholders
  • Pragmatic use of AI and automation in the SDLC, with a bias towards measurable impact over hype
Job Responsibility
Job Responsibility
  • Own the technical delivery of the go-to-market products serving Clients, Consumers and Partners, including externally facing APIs, SDKs, partner integrations, and our digital experiences, while balancing delivery pace against long-term engineering quality
  • Set and evolve the technical direction for your team, working with the Platform Manager to keep service boundaries clear, reduce coupling, and stop a distributed monolith forming between product and platform
  • Lead and line-manage your Principal and Lead Engineers, and oversee the engineering squads in your area
  • Embed AI and automation into the SDLC where it removes real friction and improves measurable throughput, not as theatre or another layer of tooling
  • Treat APIs, events and data contracts as products, with proper standards, versioning and lifecycle management
  • Protect business-critical delivery commitments through frequent, reliable, low-risk deployments
  • Raise the quality bar across architecture, code review, automated testing (unit, integration, contract, E2E and performance), BDD and resilience, partnering with the Head of QA so quality is built in from discovery rather than inspected at the end
  • Make resilience, failure modes and recovery paths part of design from the start, and own the observability, on-call and incident response for the customer-facing services your teams run
  • Give senior leadership, product and commercial stakeholders honest, transparent visibility of delivery confidence, technical risk and trade-offs, especially where client commitments are at stake
  • Work with Product and Delivery early, before requirements are thrown over the wall, so squads have the context to make good decisions and move quickly without becoming chaotic
Read More
Arrow Right

Senior Android Developer

The Digital S/W Engineer Sr Analyst is a seasoned professional role. Applies in-...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional experience in native mobile application development
  • 5+ years of hands-on experience with Kotlin (strong preference for Kotlin-first development
  • Java familiarity a plus)
  • 5+ years of experience building and shipping enterprise-grade native Android applications at scale
  • Deep understanding of the Android SDK, platform lifecycle, and Google ecosystem (Jetpack, Android Runtime, etc.)
  • Strong understanding of Android internals — memory management, process lifecycle, activity/fragment back stack, and app lifecycle at a low level
  • Experience with networking layers, Retrofit, OkHttp, and custom network stack implementations
  • Proficiency with data persistence strategies (Room, SQLite, DataStore, SharedPreferences, EncryptedSharedPreferences)
  • Solid understanding of security best practices at the OS level (certificate pinning, Android Keystore, data encryption, ProGuard/R8 obfuscation)
  • Familiarity with performance profiling and optimization using Android Studio Profiler (memory leaks, CPU usage, rendering bottlenecks, battery impact)
Job Responsibility
Job Responsibility
  • Accountable for executing and driving mid-size feature application design and development efforts to completion, serving as a development lead on medium-scale projects and supporting the execution of larger efforts
  • Proficient at operating with considerable autonomy and discretion as you will significantly influence the way an application is designed and developed by providing subject specific expertise and an advanced level of understanding of application programming principles
  • Sought after due to ability to analyze and troubleshoot coding, application performance and design challenges
  • Capable of research in root cause of development and performance concerns as well as the resolution of defects
  • Have a deep understanding of the technical requirements for the solutions being built
  • Understand engineering needs including those required to build, maintain, and operate the system through all phases of its life
  • Proficient in information modeling, data structures and algorithms
  • Understand maintenance characteristics, runtime properties and dependencies that exist in support of your system’s software. These dependencies will include but not limited to: hardware, platform, operating system, performance and load requirements, as well as contingencies with upstream and downstream systems
  • Demonstrate an advanced understanding of supported main system flows and possess a comprehensive understanding of how the system and others (i.e. architecture or infrastructure) collectively integrate to contribute towards achieving business objectives. Using this expertise, assist with the development of standards for coding, testing, debugging and implementation. This will ensure application design adheres to the overall architecture blueprint
  • Participate in design discussions as a Development Lead and as such will play the part of a key decision maker in driving design decisions. This is evidenced by your knowledge of the application code details and your experience with the technology and teams engaged
  • Fulltime
Read More
Arrow Right