CrawlJobs Logo

AI Quality Lead

alight.com Logo

Alight Solutions

Location Icon

Location:
United States of America , Lincolnshire, Illinois

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

100000.00 - 160000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

As the AI Quality Lead for the Artificial Intelligence Center of Excellence (AI CoE), you will architect and drive the end-to-end AI Quality program from inception. This is a hands-on leadership role, requiring both strategic vision and technical depth to go from 0→1 in AI Quality at Alight.

Job Responsibility:

  • Design and implement the unified AI Quality strategy and SOP, scaling controls by risk tier (Tier 1–3)
  • Define and own success metrics, risk tiering, acceptance criteria, and operating thresholds for AI solutions
  • Lead the development of golden/adversarial test suites (prompt injection, misuse, safety, bias, functional automation)
  • Oversee the creation and maintenance of schema-level UI/API tests, agent contracts, and observability instrumentation
  • Own the org-wide evaluation harnesses (e.g., promptfoo, TruLens, Ragas), CI gating, and red-team playbooks
  • Manage independent spot checks, factsheets, registry entries, and evidence for governance and audit
  • Collaborate with Product Owners, Developers, SRE/Observability, and Governance to ensure compliance and operational excellence
  • Drive continuous improvement in fairness, explainability, safety, security, and operational SLOs
  • Mentor and grow the AI Quality team, including onboarding and coaching junior engineers

Requirements:

  • Experience leading or building quality engineering or testing programs (AI/ML experience is a plus, but not required)
  • Ability to design and implement test strategies, automation frameworks, and quality standards
  • Excellent communication and leadership skills
  • ability to work cross-functionally and influence stakeholders.
  • Experience with LLM, RAG, agentic, or classic ML systems
  • Familiarity with test automation frameworks, CI/CD pipelines, and evaluation tools (promptfoo, TruLens, Ragas)
  • Knowledge of fairness, explainability, safety, and security standards (e.g., OWASP Top 10, MITRE ATLAS, Fairlearn, AIF360)
  • Experience with data integrity, lineage, and observability (OpenTelemetry, New Relic, OpenLineage)
  • Familiarity with AI infrastructure, orchestration, data integrity, deployments, and model registry practices
  • Knowledge of international standards and regulatory frameworks for Responsible AI
  • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field, or equivalent experience
What we offer:
  • Flexible working arrangements
  • Variety of health coverage options
  • Wellbeing and support programs
  • Retirement plans
  • Vacation and sick leave
  • Maternity, paternity & adoption leave
  • Continuing education and training
  • Voluntary benefit options

Additional Information:

Job Posted:
January 10, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
Alight Solutions - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for AI Quality Lead

Team Lead - AI Labs

We are seeking a Team Lead to oversee the day-to-day operations of a Robotic AI ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
instawork.com Logo
Instawork
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in team leadership roles, preferably in operations, BPO, or technology-driven task environments
  • Demonstrated experience managing task-driven teams in fast-paced, dynamic environments
  • Extremely adept at using AI tools to solve problems - most important is chatGPT to come up with task ideas for agents
Job Responsibility
Job Responsibility
  • Hiring new agents and build the team
  • Mentor and manage a team of agents/operators performing task-based physical and data-driven workflows
  • Oversee day-to-day operations related to AI task execution, including sorting, assembling, matching, and other process-driven activities
  • Maintain high QA standards by creating SOP’s, defining and enforcing quality control processes
  • Review completed work regularly to ensure compliance with requirements and provide corrective feedback where needed
  • Act as the main point of contact between the operations team and project stakeholders
What we offer
What we offer
  • Competitive compensation, perks like commute, food
  • Fulltime
Read More
Arrow Right

Principal Product Manager, AI Quality

As a Principal Product Manager for AI Quality in Central AI, you will play a piv...
Location
Location
United States
Salary
Salary:
161100.00 - 252625.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of product management experience, with substantial recent experience driving relevance and quality for a consumer or enterprise AI product
  • Proven proficiency in defining and improving on relevance and quality measurement metrics
  • Strong technical subject matter expertise, with a comprehensive understanding of search/ads technologies, natural language processing, and machine learning principles
  • Data-driven decision-making skills, including the ability to independently analyze complex data sets, identify trends, and demonstrate the customer impact of improvements
  • Deep user empathy and commitment to delivering exceptional experiences, with attention to detail that drives continuous improvement
  • Exceptional communication and stakeholder management skills, capable of conveying complex technical concepts clearly to both technical and non-technical audiences, including senior executives
  • Demonstrated ability to influence and drive cross-functional initiatives without direct authority, maintaining alignment across diverse teams
  • Bachelor's or Master’s degree in Computer Science, Data Science, or a related field preferred
Job Responsibility
Job Responsibility
  • Define and drive the strategic vision and roadmap for AI quality for your feature areas, clearly articulating the desired outcomes and the path to achieve them
  • Lead initiatives to improve the quality, reliability, and trustworthiness of AI models and experiences, ensuring alignment with organizational goals and user expectations
  • Partner with engineering, data science, product, and design teams to identify opportunities and implement improvements in AI quality
  • Advocate for relevance and quality standards, influencing stakeholders and championing initiatives that elevate user experience
  • Develop deep customer insights to pinpoint gaps in quality, proactively addressing issues to enhance user satisfaction and engagement
  • Regularly interact with users and internal stakeholders to validate quality enhancements and prioritize feature improvements
  • Create compelling narratives and communicate progress effectively to customers, stakeholders, and the broader community, highlighting Atlassian’s advancements in search relevance and quality
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
Read More
Arrow Right

Quality Engineer - AI and Data Platforms

This is a pioneering Quality Engineer role at the intersection of data engineeri...
Location
Location
United Kingdom , Manchester
Salary
Salary:
44000.00 - 66000.00 GBP / Year
matillion.com Logo
Matillion
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid foundation in data engineering: including SQL, ETL/ELT design, and specific experience building data pipelines and managing data movement
  • Strong practical AI experience: you have used, experimented with, and are an advocate for an AI-first approach to quality engineering
  • Proficiency in coding in Java or JavaScript to navigate the codebase and implement quality frameworks
  • Demonstrated Autonomy, Curiosity, and Problem-solving skills, with a willingness to look at challenges in a different way and ask for assistance as needed
  • Experience in managing end-to-end testing of SaaS applications, including developing and maintaining efficient test automation tooling
Job Responsibility
Job Responsibility
  • Leveraging AI and agentic solutions, including our agentic AI product Maia, to accelerate investigation, generate test cases, and increase quality assurance across the Data Productivity Cloud
  • Performing root cause analysis on pipeline stability issues, particularly identifying why DPC pipelines run out of memory (OOM) within the agents
  • Building pipelines to automate every process, solutionizing problems to increase overall team and product productivity
  • Acting as a crucial bridge by collaborating extensively with various teams, raising problems, and ensuring that fixes are implemented effectively
  • Adopting, implementing, and championing shift-left testing practices across the team, leading an automation-first approach
What we offer
What we offer
  • Company Equity
  • 30 days holiday + bank holidays
  • 5 days paid volunteering leave
  • Health insurance
  • Life Insurance
  • Pension
  • Access to mental health support
  • Fulltime
Read More
Arrow Right

AI Research Lead - Multimodal & Video

Join Tether and Shape the Future of Digital Finance. At Tether, we’re not just b...
Location
Location
Salary
Salary:
Not provided
tether.to Logo
Tether App
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD, MS or equivalent experience
  • Hands on experience in building Image/Video/3D generation and multimodal foundation models building from scratch
  • 5+ years of experience in managing or leading 10+ research & engineer teams
  • Excellent communication and interpersonal skills
  • Excellent understanding of an AI-based product lifecycle
  • Hands-on experience in building end-to-end multimodal foundation models on thousands of multi-node GPUs
  • Proficiency in modern deep learning and diffusion frameworks & libraries
Job Responsibility
Job Responsibility
  • Lead the research, design, and development of state-of-the-art image, video, and 3D generation models, including multimodal foundation models
  • Lead high-impact, specialized projects focused on innovative text, images, audio and video applications
  • Define and drive the technical roadmap for multimodal AI initiatives, aligning research goals with business and product objectives
  • Provide technical leadership and mentorship to teams of AI researchers and engineers, fostering innovation and skill development
  • Oversee the end-to-end lifecycle of multimodal model development, from dataset curation and model training to deployment and performance evaluation
  • Lead large-scale multi-node GPU model training, ensuring scalability, efficiency, and reproducibility of experiments
  • Collaborate closely with cross-functional teams, including product, design, and engineering, to integrate AI solutions into production systems
  • Drive applied research initiatives in image/video/3D generation, editing, animation, and other related domains
  • Monitor advancements in AI research and multimodal technologies, and incorporate novel techniques to improve model capabilities and performance
  • Contribute to the AI research community, including publications, open-source contributions, and participation in conferences
Read More
Arrow Right

AI Lead – Digital B2B platforms

Do you want to lead AI projects that enhance the customer experience on our digi...
Location
Location
Sweden
Salary
Salary:
Not provided
atea.se Logo
Atea Sverige AB
Expiration Date
January 16, 2026
Flip Icon
Requirements
Requirements
  • Experience in project management within AI and ML
  • Solid understanding of GDPR, compliance, and KPIs
  • Comfortable collaborating with data teams and external partners
  • Business-driven, analytical, and skilled at coordinating complex AI projects
Job Responsibility
Job Responsibility
  • Lead AI projects from planning through production
  • Coordinate stakeholders and resources (data teams, vendors, partners)
  • Ensure compliance and ethical AI practices (GDPR, Responsible AI, privacy-by-design)
  • Track KPIs and report progress to leadership
  • Optimize AI delivery for business impact and quality
!
Read More
Arrow Right

AI & Data Lead

We are seeking a highly skilled AI & Data Lead to spearhead our transformation i...
Location
Location
United Kingdom , North West
Salary
Salary:
Not provided
dynamicsearch.co.uk Logo
Dynamic Search Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in a senior data/AI/analytics role (e.g., Data Lead, Analytics Lead, AI Specialist, BI Lead)
  • Strong background with Power BI, including DAX, modelling, governance, and enterprise deployments
  • Hands-on experience building AI and machine learning solutions using modern cloud tools (Azure preferred)
  • Strong understanding of data engineering concepts (ETL/ELT, pipelines, warehousing)
  • Ability to translate business challenges into technical AI/analytics solutions
  • Excellent stakeholder engagement and communication skills
  • Strategic thinker capable of setting direction and driving organisational change
Job Responsibility
Job Responsibility
  • Strategic Leadership & Planning Develop and own the company’s AI, analytics, and data strategy
  • Create a roadmap for moving from traditional BI to a modern, AI-augmented data ecosystem
  • Identify opportunities where AI, ML, and automation can drive measurable value
  • Act as a trusted advisor to senior leaders and departments regarding data, BI, and AI
  • Translate complex data and AI concepts into clear business language and use cases
  • Facilitate workshops, run discovery sessions, and guide teams on AI best practices
  • Build prototypes and production-level AI/ML solutions, such as predictive models, natural language interfaces, and automation workflows
  • Develop robust data models, pipelines, and integrations to ensure scalable AI adoption
  • Establish data governance standards, security controls, and compliance practices
  • Own data quality frameworks to ensure trusted reporting and model reliability
Read More
Arrow Right

AI Research Lead - Multimodal & Video

Join Tether and Shape the Future of Digital Finance. At Tether, we’re not just b...
Location
Location
Salary
Salary:
Not provided
tether.to Logo
Tether App
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD, MS or equivalent experience
  • Hands on experience in building Image/Video/3D generation and multimodal foundation models building from scratch
  • 5+ years of experience in managing or leading 10+ research & engineer teams
  • Excellent communication and interpersonal skills
  • Excellent understanding of an AI-based product lifecycle
  • Hands-on experience in building end-to-end multimodal foundation models on thousands of multi-node GPUs
  • Proficiency in modern deep learning and diffusion frameworks & libraries
Job Responsibility
Job Responsibility
  • Lead the research, design, and development of state-of-the-art image, video, and 3D generation models, including multimodal foundation models
  • Lead high-impact, specialized projects focused on innovative text, images, audio and video applications
  • Define and drive the technical roadmap for multimodal AI initiatives, aligning research goals with business and product objectives
  • Provide technical leadership and mentorship to teams of AI researchers and engineers, fostering innovation and skill development
  • Oversee the end-to-end lifecycle of multimodal model development, from dataset curation and model training to deployment and performance evaluation
  • Lead large-scale multi-node GPU model training, ensuring scalability, efficiency, and reproducibility of experiments
  • Collaborate closely with cross-functional teams, including product, design, and engineering, to integrate AI solutions into production systems
  • Drive applied research initiatives in image/video/3D generation, editing, animation, and other related domains
  • Monitor advancements in AI research and multimodal technologies, and incorporate novel techniques to improve model capabilities and performance
  • Contribute to the AI research community, including publications, open-source contributions, and participation in conferences
Read More
Arrow Right

AI Research Lead - Multimodal & Video

Join Tether and Shape the Future of Digital Finance. At Tether, we’re not just b...
Location
Location
Salary
Salary:
Not provided
tether.to Logo
Tether App
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD, MS or equivalent experience
  • Hands on experience in building Image/Video/3D generation and multimodal foundation models building from scratch
  • 5+ years of experience in managing or leading 10+ research & engineer teams
  • Excellent communication and interpersonal skills
  • Excellent understanding of an AI-based product lifecycle
  • Hands-on experience in building end-to-end multimodal foundation models on thousands of multi-node GPUs
  • Proficiency in modern deep learning and diffusion frameworks & libraries
Job Responsibility
Job Responsibility
  • Lead the research, design, and development of state-of-the-art image, video, and 3D generation models, including multimodal foundation models
  • Lead high-impact, specialized projects focused on innovative text, images, audio and video applications
  • Define and drive the technical roadmap for multimodal AI initiatives, aligning research goals with business and product objectives
  • Provide technical leadership and mentorship to teams of AI researchers and engineers, fostering innovation and skill development
  • Oversee the end-to-end lifecycle of multimodal model development, from dataset curation and model training to deployment and performance evaluation
  • Lead large-scale multi-node GPU model training, ensuring scalability, efficiency, and reproducibility of experiments
  • Collaborate closely with cross-functional teams, including product, design, and engineering, to integrate AI solutions into production systems
  • Drive applied research initiatives in image/video/3D generation, editing, animation, and other related domains
  • Monitor advancements in AI research and multimodal technologies, and incorporate novel techniques to improve model capabilities and performance
  • Contribute to the AI research community, including publications, open-source contributions, and participation in conferences
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy