CrawlJobs Logo

Engineering Manager, AI Quality

United States, San Francisco 260000.00 - 330000.00 USD / Year · Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

At Harvey, we’re transforming how legal and professional services operate — not incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come. The quality of Harvey’s AI & Search systems is of critical importance. Our customers expect us to produce accurate, specific, verifiable and personalized results across all of our product surfaces. They also expect the quality of our answers to continuously get benchmarked and improved. In this role, you will drive overall AI & results quality across all of Harvey’s products (Assistant, Harvey Word, Vault, Workflows & Agents, and net new products).

Job Responsibility

  • Establish an AI & Results Quality Program at Harvey: Establish offline and online eval processes and tools, and a culture of continuous iteration and experimentation
  • Build out core AI quality building blocks that can be reused across different teams and surface areas
  • Own search & retrieval quality, both for AI applications as well as other use cases
  • Work closely with product engineering to continuously improve the quality and capabilities of our AI & search products
  • Work closely with platform engineering to scale our capabilities

Requirements

  • Significant industry experience leading AI or other related quality efforts (search or ads ranking systems, recommender systems, etc) at industry-leading companies
  • Excellent software engineering skills
  • experience working in teams that built and operated production systems
  • Excellent communication skills, both written and verbal
  • Ability to roll up your sleeves and build team, processes, and technology from the ground up
  • A strong academic or professional background in Machine Learning, Generative AI, Information Retrieval or other related fields

What we offer

  • Offers Equity
  • Offers Bonus
  • Comprehensive health, dental and vision coverage
  • retirement benefits (401k match up to 4%)
  • flexible PTO

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Engineering Manager, AI Quality

8 matching positions

Engineering Manager, AI Quality

At Harvey, we’re transforming how legal and professional services operate — not ...
Location
Location
United States , New York
Salary
Salary:
260000.00 - 330000.00 USD / Year
harvey.ai Logo
Harvey
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant industry experience leading AI or other related quality efforts (search or ads ranking systems, recommender systems, etc) at industry-leading companies
  • Excellent software engineering skills
  • experience working in teams that built and operated production systems
  • Excellent communication skills, both written and verbal
  • Ability to roll up your sleeves and build team, processes, and technology from the ground up
  • A strong academic or professional background in Machine Learning, Generative AI, Information Retrieval or other related fields
Job Responsibility
Job Responsibility
  • Establish an AI & Results Quality Program at Harvey: Establish offline and online eval processes and tools, and a culture of continuous iteration and experimentation
  • Build out core AI quality building blocks that can be reused across different teams and surface areas
  • Own search & retrieval quality, both for AI applications as well as other use cases
  • Work closely with product engineering to continuously improve the quality and capabilities of our AI & search products
  • Work closely with platform engineering to scale our capabilities
What we offer
What we offer
  • Offers Equity
  • Offers Commission
  • Offers Bonus
  • Comprehensive health, dental and vision coverage
  • retirement benefits (401k match up to 4%)
  • flexible PTO
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager - AI Engineering

The Fabric Data Engineering Experience & Infrastructure team is hiring a Princip...
Location
Location
Canada , Vancouver
Salary
Salary:
142400.00 - 257500.00 CAD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Lead and grow a team: Hire, onboard, coach, and develop engineers
  • set clear expectations
  • create an inclusive culture of accountability, learning, and collaboration.
  • Drive execution and delivery: Guide team planning and prioritization across multiple workstreams
  • manage dependencies, risks, and release readiness
  • ensure predictable delivery from requirements → architecture → implementation → rollout → live-site operations.
  • Shape requirements with partners: Partner with Product Management, Design, Research, and dependent engineering teams to translate ambiguous customer needs into crisp scenario plans and measurable outcomes.
  • Guide architecture and technical strategy: Lead identification of dependencies and development of design documents
  • guide architectural decisions for distributed, cloud-scale systems (Spark/PySpark + Python services) with explicit tradeoffs across performance, reliability, cost, security, privacy, and operability.
  • Raise the engineering quality bar: Establish and reinforce engineering standards (design reviews, coding patterns, test strategy, performance practices, operational readiness)
  • Fulltime
Read More
Arrow Right

Manager / Sr Manager, Engineering (AI Posture)

Location
Location
United States , Santa Clara
Salary
Salary:
185000.00 - 298000.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-7 years of experience managing software engineering teams within a large-scale organization
  • 5+ years of hands-on software engineering experience with a strong systems-level foundation
  • Proven ability to plan, execute, and deliver complex roadmaps with high predictability, owning distributed cloud products end-to-end
  • Demonstrated experience leading teams through the delivery of complex, data-rich web applications with a focus on performance and usability
  • Demonstrated experience designing and operating large-scale cloud architectures on platforms such as GCP, AWS, or Azure
  • Strong collaboration skills with a track record of aligning cross-disciplinary teams around shared objectives
Job Responsibility
Job Responsibility
  • Build, mentor, and lead a high-performing software engineering team, fostering a culture of empowerment and driving both individual growth and collective impact
  • Partner closely with Product Management and cross-functional teams (Infrastructure, UX, SRE & QA) to define priorities and shape multi-quarter product roadmaps, ensuring alignment across all stakeholders
  • Own the end-to-end software development lifecycle, translating product strategy into executable plans and ensuring consistent, high-quality, on-time delivery
  • Provide architectural leadership for scalable, distributed systems guiding the design and implementation of high-throughput, cloud-native applications
  • Drive production readiness by enforcing best practices around deployment, observability, reliability, and runtime stability, focusing on the details to ensure operational excellence
  • Align stakeholders across business units through clear communication of technical strategy, trade-offs, priorities, risks, and execution plans
  • Engage directly with strategic customers to lead technical deep dives and architecture reviews, and to influence future product direction
  • Foster a culture of high engineering standards, accountability, and continuous improvement, with a strong emphasis on quality and security
  • Fulltime
Read More
Arrow Right

Digital Software Engineering Senior Group Manager – Head of Quality & Performance Engineering

We are seeking a visionary and experienced Digital Software Engineering Senior G...
Location
Location
India , Chennai; Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of relevant experience, with significant time in a product line management, e-commerce, or strategic planning role
  • Proven track record of managing the full SDLC for large-scale, complex software projects and succeeding in delivering high-quality technology products/services in a high-growth environment where priorities shift rapidly
  • Extensive experience in designing and implementing CI/CD pipelines and automated testing frameworks
  • First-class leadership, influencing, and talent management skills, with significant experience managing and developing a Software Engineering Team
  • Ability to use hard data and metrics to back up assumptions and develop business cases
  • Deep understanding of various testing methodologies, including performance, functional, and non-functional testing
  • Strong knowledge of agile development methodologies (Scrum, Kanban) and modern software architecture patterns
  • Familiarity with AI/ML concepts and their application in software development is highly desirable
  • Excellent communication and negotiation skills, with experience negotiating internally at a senior level
  • Bachelor’s/University degree required
Job Responsibility
Job Responsibility
  • Lead an AI-first testing strategy to transform quality engineering across applications and platforms
  • Leverage AI to generate test cases, predict risks, accelerate defect detection, and enable synthetic data generation for comprehensive testing
  • Implement AI-powered solutions & automation for functional, integration, smoke, and performance testing, as well as self-healing automation
  • Enable developers to incorporate testing as part of the development lifecycle, including integration and smoke tests within the pipeline
  • Maximize test coverage and reliability by leveraging AI tools and techniques
  • Drive the adoption of autonomous, self-healing testing in the code and deployment pipeline to enhance speed, quality, and release confidence
  • Synthetic test data management
  • Oversee the end-to-end Software Development Lifecycle (SDLC), implementing best practices for agile development, continuous integration, and continuous delivery (CI/CD)
  • Design, build, and manage a highly automated testing pipeline that enables rapid, high-quality releases
  • Champion a "shift-left" approach to quality, embedding testing throughout the development lifecycle
  • Fulltime
Read More
Arrow Right

Senior Engineering Manager, AI Product (Thunderbolt)

Thunderbolt is an open-source, cross-platform AI product initiative from the tea...
Location
Location
Canada; United States
Salary
Salary:
190000.00 - 240000.00 USD; CAD / Year
mozilla.org Logo
Mozilla
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of professional software development experience, including significant experience in senior engineering leadership or complex product delivery roles
  • 5+ years of experience managing technical teams, including senior engineers or senior individual contributors
  • A track record of leading a team that shipped polished, top-tier products held to a genuine standard of craft
  • Strong ability to translate ambiguous product and technical direction into clear plans, ownership models, and delivery momentum
  • Technical fluency with AI-enabled products, including the ability to evaluate tradeoffs across areas such as LLM applications, RAG workflows, agents, enterprise search, automation, on-device AI, or AI evaluation
  • Demonstrated experience delivering complex applications across multiple platforms, such as desktop, web, and mobile, using technologies such as Tauri, Electron, React Native, or comparable frameworks
  • Experience with enterprise software, regulated environments, or similarly complex technical products, including security, privacy, compliance readiness, administration, integrations, and customer-controlled deployment models
  • Practical experience with local-first, offline-capable, self-hosted, hybrid, on-premise, air-gapped, or other customer-controlled product architectures, including tradeoffs related to data storage, sync, privacy, reliability, and user experience
  • Experience improving engineering practices related to technical planning, code review, release readiness, testing, documentation, CI/CD, maintainability, or technical debt management
  • Excellent communication skills around technical prioritization, release risk, ownership, quality expectations, and tradeoffs
Job Responsibility
Job Responsibility
  • Lead engineering execution by clarifying priorities, ownership, timelines, risks, dependencies, and quality expectations
  • Manage engineers and contractors, including coaching, feedback, prioritization, performance support, and team development
  • Stay close to the codebase by contributing code, reviewing technical work, evaluating tradeoffs, and helping the team maintain momentum and quality
  • Partner with technical and product leadership to turn product direction, AI strategy, user experience goals, and technical priorities into coordinated engineering plans
  • Establish planning, review, release, and follow-through practices that improve predictability and reduce bottlenecks
  • Maintain high standards for code quality, testing, documentation, reliability, security awareness, maintainability, and release readiness
  • Build strong product and architectural context across AI-enabled workflows, integrations, local-first or customer-controlled architectures, and release requirements
  • Partner across product, design, enterprise-facing teams, and technical leadership to balance speed, user experience, privacy, quality, enterprise readiness, and long-term sustainability
  • Lead hiring, onboarding, and resource planning as the Thunderbolt engineering team grows
  • Help Thunderbolt scale from an incubation-stage product into a reliable, enterprise-ready open-source AI product
What we offer
What we offer
  • Fully remote work & schedule flexibility
  • Company-provided laptop
  • Annual bonus program
  • Monthly remote work stipend
  • Annual professional development stipend
  • Access to Coursera learning platform
  • Industry conferences
  • Company all-hands and team gatherings
  • 24 days PTO per year (prorated)
  • Your birthday
  • Fulltime
Read More
Arrow Right

Senior Test Automation & AI Quality Engineering Lead - VOIS

We are seeking a highly experienced and hands-on Test Automation and Quality Eng...
Location
Location
India , Pune
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience (15+ years) in Test Automation and Quality Engineering with strong hands-on expertise
  • Proficient in programming languages such as Java, JavaScript, TypeScript or Python with solid understanding of OOP and design patterns
  • Skilled in automation tools and frameworks including Playwright (preferred), Selenium, Appium and Tosca
  • Experience with API automation using REST Assured, Postman or Karate
  • Knowledge of BDD frameworks such as Cucumber or SpecFlow and unit testing tools like JUnit or TestNG
  • Familiarity with CI/CD tools including Azure DevOps (essential), Jenkins, Git and container technologies
  • Understanding of AI/GenAI applications in testing, including prompt engineering and intelligent automation solutions
  • Experience with cloud platforms and testing microservices architectures
  • Strong leadership, communication and stakeholder engagement capabilities across global environments
  • Data-driven, collaborative and committed to continuous improvement and innovation
Job Responsibility
Job Responsibility
  • Define and lead a unified automation strategy across UI, API, mobile, integration and end-to-end testing
  • Establish enterprise-wide governance, standards, frameworks and reusable automation assets
  • Drive shift-left and shift-right testing within Agile and SAFe environments
  • Measure and improve automation effectiveness using key metrics such as coverage, cycle time and defect leakage
  • Architect and evolve scalable automation frameworks using Playwright, Selenium and modern design principles
  • Lead API-first testing strategies for microservices and cloud-native platforms
  • Ensure robust test data management, service virtualisation and environment readiness
  • Integrate automation into CI/CD pipelines using Azure DevOps and related tools
  • Champion AI-led testing innovations including self-healing scripts, predictive analytics and GenAI-powered test generation
  • Evaluate and scale AI agents and LLM-based tools for autonomous test execution and analysis
What we offer
What we offer
  • Opportunity to lead large-scale AI-driven quality engineering transformation initiatives
  • Exposure to global Vodafone markets and cross-functional collaboration
  • Work with cutting-edge automation, AI and GenAI tools and frameworks
  • Career growth in a strategic and innovation-focused environment
  • A culture that supports continuous learning, diversity and inclusive collaboration
  • Fulltime
Read More
Arrow Right

Senior Manager, Quality Engineering

Senior Manager, Quality Engineering at Palo Alto Networks. This role is remote, ...
Location
Location
United States , Santa Clara
Salary
Salary:
185000.00 - 298000.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in Software Quality Assurance, with at least 5+ years in a dedicated people management or leadership role
  • Proven track record of owning product quality end-to-end for scalable SaaS, cloud, or enterprise applications
  • Demonstrated experience leading a team through a significant technological pivot (e.g., manual-to-automation or automation-to-AI transition)
  • Deep expertise in modern automation frameworks (e.g., Playwright, Selenium, Pytest) and CI/CD pipelines (Jenkins, GitLab)
  • Strong conceptual and practical understanding of how Generative AI, LLMs, and ML tools can be applied to the testing lifecycle
  • Solid grasp of coding/scripting languages (Python, JavaScript, or Java)
  • Change Management: Exceptional ability to guide teams through organizational and technological shifts with empathy and clarity
  • Strategic Thinker: Ability to balance long-term AI innovation with the daily demands of product shipping
  • Communication: Crisp and compelling communication skills, capable of explaining complex AI concepts to stakeholders and engineering teams alike
Job Responsibility
Job Responsibility
  • Own & Lead Product Quality: Define, implement, and evolve the comprehensive QA strategy, test frameworks, and quality metrics across all product lines
  • End-to-End Ownership: Take ultimate accountability for the quality of releases, ensuring software is scalable, secure, and high-performing
  • Cross-Functional Collaboration: Partner closely with Product Management, Engineering, and DevOps to embed quality standards early in the SDLC (Shift-Left approach)
  • Risk Management: Identify, assess, and mitigate product quality risks before they impact production
  • Drive AI Transformation & Innovation: Research, evaluate, and implement cutting-edge AI/ML-driven testing tools and generative AI utilities to optimize test case generation, execution, and maintenance
  • Team Upskilling: Act as a mentor and change agent, designing training pathways to help traditional manual and automation QA engineers transition into AI-augmented testing roles
  • Smart Automation: Evolutionize existing automation frameworks by incorporating predictive analytics, self-healing test scripts, and intelligent bug-clustering
  • Efficiency Metrics: Establish baseline metrics to measure the ROI, speed, and accuracy improvements gained through AI adoption
  • People & Team Leadership: Foster a high-performance culture rooted in continuous learning, innovation, and psychological safety
  • Resource Planning: Manage headcount, budget, and resource allocation across multiple agile squads
What we offer
What we offer
  • Competitive salary, equity package, and comprehensive benefits
  • Dedicated budget for AI tools, training, and professional development
  • Flexible/hybrid work environment
  • Restricted stock units
  • Bonus
  • Fulltime
Read More
Arrow Right

Corporate Facilities & Engineering Quality Manager

Location
Location
United States , Thousand Oaks
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Doctorate degree OR Master's degree and 2 years of relevant experience OR Bachelor's degree and 4 years of relevant experience OR Associate's degree and 8 years of relevant experience OR High school diploma / GED and 10 years of relevant experience
  • Understanding of GMP/GDP requirements
  • Strong critical thinking and reasoning skills
  • Strong communication skills
  • Experience with presenting to regulatory agencies
  • Demonstrated proficiency and understanding in facility management
  • Data-driven mindset with experience using metrics, analytics, or insights to guide decisions and continuous improvement
  • Excellent organizational, communication, and stakeholder management skills, with the ability to clearly convey system, process or data-driven topics to diverse audiences
  • Demonstrated capability to support change management and continuous improvement initiatives
  • Strong collaboration and influencing skills, including the ability to influence outcomes without direct authority
Job Responsibility
Job Responsibility
  • Coordinates, leads, participates and responds in internal and external audits from Quality and regulatory agencies in facility scope managed by integrated service providers
  • Assists with audit programs and activities, ensuring relevant data is correct and available, when necessary
  • Assesses state of compliance with appropriate integrated service provider quality leads and form action plans to correct deficiencies
  • Own Deviations, Corrective Actions/Preventive Actions and Change Controls on behalf of integrated service providers
  • Actively represent Global Facilities Operations on incident triage teams or support efforts by providing guidance and direction
  • Enables reliable data consumption for analytics, reporting, and operational decision-making
  • Use of AI-driven tools to analyze data pertaining to facility maintenance and operational metrics
  • Drives process/system standardization and harmonization across all Amgen sites
  • Supports continuous improvement initiatives, programs and projects
What we offer
What we offer
  • A comprehensive employee benefits package, including a Retirement and Savings Plan with generous company contributions, group medical, dental and vision coverage, life and disability insurance, and flexible spending accounts
  • A discretionary annual bonus program, or for field sales representatives, a sales-based incentive plan
  • Stock-based long-term incentives
  • Award-winning time-off plans
  • Flexible work models where possible
  • Fulltime
Read More
Arrow Right