CrawlJobs Logo

AI Quality Lead

alight.com Logo

Alight Solutions

Location Icon

Location:
United States of America , Lincolnshire, Illinois

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

100000.00 - 160000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

As the AI Quality Lead for the Artificial Intelligence Center of Excellence (AI CoE), you will architect and drive the end-to-end AI Quality program from inception. This is a hands-on leadership role, requiring both strategic vision and technical depth to go from 0→1 in AI Quality at Alight.

Job Responsibility:

  • Design and implement the unified AI Quality strategy and SOP, scaling controls by risk tier (Tier 1–3)
  • Define and own success metrics, risk tiering, acceptance criteria, and operating thresholds for AI solutions
  • Lead the development of golden/adversarial test suites (prompt injection, misuse, safety, bias, functional automation)
  • Oversee the creation and maintenance of schema-level UI/API tests, agent contracts, and observability instrumentation
  • Own the org-wide evaluation harnesses (e.g., promptfoo, TruLens, Ragas), CI gating, and red-team playbooks
  • Manage independent spot checks, factsheets, registry entries, and evidence for governance and audit
  • Collaborate with Product Owners, Developers, SRE/Observability, and Governance to ensure compliance and operational excellence
  • Drive continuous improvement in fairness, explainability, safety, security, and operational SLOs
  • Mentor and grow the AI Quality team, including onboarding and coaching junior engineers

Requirements:

  • Experience leading or building quality engineering or testing programs (AI/ML experience is a plus, but not required)
  • Ability to design and implement test strategies, automation frameworks, and quality standards
  • Excellent communication and leadership skills
  • ability to work cross-functionally and influence stakeholders.
  • Experience with LLM, RAG, agentic, or classic ML systems
  • Familiarity with test automation frameworks, CI/CD pipelines, and evaluation tools (promptfoo, TruLens, Ragas)
  • Knowledge of fairness, explainability, safety, and security standards (e.g., OWASP Top 10, MITRE ATLAS, Fairlearn, AIF360)
  • Experience with data integrity, lineage, and observability (OpenTelemetry, New Relic, OpenLineage)
  • Familiarity with AI infrastructure, orchestration, data integrity, deployments, and model registry practices
  • Knowledge of international standards and regulatory frameworks for Responsible AI
  • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field, or equivalent experience
What we offer:
  • Flexible working arrangements
  • Variety of health coverage options
  • Wellbeing and support programs
  • Retirement plans
  • Vacation and sick leave
  • Maternity, paternity & adoption leave
  • Continuing education and training
  • Voluntary benefit options

Additional Information:

Job Posted:
January 10, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
Alight Solutions - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for AI Quality Lead

Principal Product Manager, AI Quality

As a Principal Product Manager for AI Quality in Central AI, you will play a piv...
Location
Location
United States
Salary
Salary:
161100.00 - 252625.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of product management experience, with substantial recent experience driving relevance and quality for a consumer or enterprise AI product
  • Proven proficiency in defining and improving on relevance and quality measurement metrics
  • Strong technical subject matter expertise, with a comprehensive understanding of search/ads technologies, natural language processing, and machine learning principles
  • Data-driven decision-making skills, including the ability to independently analyze complex data sets, identify trends, and demonstrate the customer impact of improvements
  • Deep user empathy and commitment to delivering exceptional experiences, with attention to detail that drives continuous improvement
  • Exceptional communication and stakeholder management skills, capable of conveying complex technical concepts clearly to both technical and non-technical audiences, including senior executives
  • Demonstrated ability to influence and drive cross-functional initiatives without direct authority, maintaining alignment across diverse teams
  • Bachelor's or Master’s degree in Computer Science, Data Science, or a related field preferred
Job Responsibility
Job Responsibility
  • Define and drive the strategic vision and roadmap for AI quality for your feature areas, clearly articulating the desired outcomes and the path to achieve them
  • Lead initiatives to improve the quality, reliability, and trustworthiness of AI models and experiences, ensuring alignment with organizational goals and user expectations
  • Partner with engineering, data science, product, and design teams to identify opportunities and implement improvements in AI quality
  • Advocate for relevance and quality standards, influencing stakeholders and championing initiatives that elevate user experience
  • Develop deep customer insights to pinpoint gaps in quality, proactively addressing issues to enhance user satisfaction and engagement
  • Regularly interact with users and internal stakeholders to validate quality enhancements and prioritize feature improvements
  • Create compelling narratives and communicate progress effectively to customers, stakeholders, and the broader community, highlighting Atlassian’s advancements in search relevance and quality
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
Read More
Arrow Right

AI & Data Lead

We are seeking a highly skilled AI & Data Lead to spearhead our transformation i...
Location
Location
United Kingdom , North West
Salary
Salary:
Not provided
dynamicsearch.co.uk Logo
Dynamic Search Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in a senior data/AI/analytics role (e.g., Data Lead, Analytics Lead, AI Specialist, BI Lead)
  • Strong background with Power BI, including DAX, modelling, governance, and enterprise deployments
  • Hands-on experience building AI and machine learning solutions using modern cloud tools (Azure preferred)
  • Strong understanding of data engineering concepts (ETL/ELT, pipelines, warehousing)
  • Ability to translate business challenges into technical AI/analytics solutions
  • Excellent stakeholder engagement and communication skills
  • Strategic thinker capable of setting direction and driving organisational change
Job Responsibility
Job Responsibility
  • Strategic Leadership & Planning Develop and own the company’s AI, analytics, and data strategy
  • Create a roadmap for moving from traditional BI to a modern, AI-augmented data ecosystem
  • Identify opportunities where AI, ML, and automation can drive measurable value
  • Act as a trusted advisor to senior leaders and departments regarding data, BI, and AI
  • Translate complex data and AI concepts into clear business language and use cases
  • Facilitate workshops, run discovery sessions, and guide teams on AI best practices
  • Build prototypes and production-level AI/ML solutions, such as predictive models, natural language interfaces, and automation workflows
  • Develop robust data models, pipelines, and integrations to ensure scalable AI adoption
  • Establish data governance standards, security controls, and compliance practices
  • Own data quality frameworks to ensure trusted reporting and model reliability
Read More
Arrow Right

Lead Product Designer, AI

We are looking for a Lead Product Designer to be a key pillar in the AI Design t...
Location
Location
United States
Salary
Salary:
157500.00 - 246750.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of product design experience designing complex or enterprise-level software
  • High level of craft for visual design execution
  • Experience in AI products across Search, Chat, and Agents
  • Experience in end-to-end UX/product design to design impactful solutions to challenging problems
  • Passion for story-telling, the ability to bring design direction to life with compelling narrative
  • Experience balancing customer needs with business goals, market viability, and technical feasibility
  • Facilitation and cross-functional collaboration skills: you can demonstrate the ability to integrate the work of multiple teams, solicit and synthesize feedback, and facilitate design discussions that lead company wide outcomes
  • Experience measuring success with qualitative and quantitative methods
  • Experience improving process and methodology to increase product value, team velocity and accelerate adoption of new capabilities
Job Responsibility
Job Responsibility
  • Design foundational AI patterns with a focus on visual systems, design languages, and brand direction
  • Partner with leadership, stakeholders, cross-functional teams to create a unified view of AI capabilities across Atlassian
  • Lead design projects from creation to execution and be responsible tying back to customer value delivery and outcomes
  • Identify success metrics ensuring design solutions continue to deliver customer value
  • Identify opportunities to enhance our products and accelerate AI and search experiences at Atlassian
  • Collaborate with some of the industry's smartest (and nicest) people. You'll work with Engineers, Product Managers, Content Designers, Researchers, Marketing Experts, and Analysts to advocate for the user experience in our products and ship high-quality work
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
  • Fulltime
Read More
Arrow Right

Lead Product Designer, Confluence AI

As a Lead Product Designer in the Confluence AI organization, you'll help shape ...
Location
Location
United States; Canada , San Francisco; Seattle; Mountain View
Salary
Salary:
156600.00 - 251600.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of product design experience designing complex or enterprise-level software
  • Demonstrated experience designing for AI (or related) features
  • Experience in creating and delivering strategic design programs which impact multiple delivery teams
  • Experience in end-to-end UX/product design to design impactful solutions to challenging problems
  • Passion for story-telling, the ability to bring design direction to life with compelling narrative
  • Experience balancing customer needs with business goals, market viability, and technical feasibility
  • Facilitation and cross-functional collaboration skills: you can demonstrate the ability to integrate the work of multiple teams, solicit and synthesize feedback, and facilitate design discussions that lead company wide outcomes and positively influence future delivery roadmaps
  • Experience in design systems, the ability to identify common components required to support a wide array of customer use cases
  • Experience measuring success with qualitative and quantitative methods
  • Experience improving process and methodology to increase product value, team velocity and accelerate adoption of new capabilities
Job Responsibility
Job Responsibility
  • Lead the strategic vision and conceptual design outcomes which provide a clear direction for our AI experiences across Confluence
  • Apply your systems thinking and ability to understand complex relationships between various products, channels, features to drive better design outcomes
  • Have a strong skillset in visual and interaction design which enables you to visually communicate your work for influence and impact
  • Drive design reviews, design crits and be the design craft leader and coach to other designers to ensure consistent and cohesive AI experiences
  • Partner with leadership, stakeholders, cross-functional team members to create a unified design view of AI capabilities across Confluence
  • Lead design projects from creation to execution and be responsible tying back to customer value delivery and outcomes
  • Identify success metrics ensuring design solutions continue to deliver customer value
  • Identify opportunities to enhance and accelerate our AI experiences at Atlassian
  • Collaborate with some of the industry's smartest (and nicest) people. You'll work with Engineers, Product Managers, Content Designers, Researchers, Marketing Experts, and Analysts to advocate for the user experience in our products and ship high-quality work
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Lead Content Designer, Confluence AI

As a Lead Content Designer in the AI and Horizontals organization, you'll help s...
Location
Location
United States , San Francisco; Mountain View; Seattle
Salary
Salary:
145200.00 - 233300.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years if experience in a content design role, designing complex or enterprise-level software
  • Demonstrated experience designing for AI (or related) features
  • Experience creating and delivering content strategy which impacts multiple teams or departments
  • Experience delivering end-to-end content design outcomes from ideation through to delivery, both within product and for supporting documentation
  • Passion for storytelling and experience bringing design direction to life and influencing cross-functional stakeholders
  • Experience coaching and leading other content designers by providing critique and supporting effective design operations to generate higher quality outcomes for users
  • Facilitation and leadership skills - you can work dynamically across multiple teams and align cross-functional partners around clear goals and design solutions
  • Experience balancing customer needs and business goals
  • Experience in design systems, identifying and creating common content patterns and frameworks requires to support a range of customer use cases
  • The ability to work in design tools like Figma to collaborate with product designers on projects.
Job Responsibility
Job Responsibility
  • Lead the strategic vision and content design outcomes, providing clear direction for Confluence AI experiences
  • Apply your systems thinking and ability to understand complex journeys to drive better content design outcomes for users
  • Be a content design craft leader to coach other designers and ensure consistent and cohesive experiences across Confluence, including leading design reviews
  • Have expertise in content strategy, content operations and effective communications which elevates your influence and impact
  • Lead and deliver design projects end-to-end, working across various teams and stakeholders and tying work back to customer value and outcomes
  • Drive research and identify success metrics, ensuring design solutions continue to deliver customer value
  • Collaborate with some of the industry’s smartest (and nicest) people. You’ll work with Engineers, Product Managers, Products Designers, Researchers, Marketing Experts ad Analysts to advocate for the user experience in our products and ship high quality work.
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

AI Operations Team Lead

As an Operations Team Lead, you will be challenged to guide and empower a team o...
Location
Location
Philippines , Metro Manila
Salary
Salary:
45000.00 - 60000.00 PHP / Month
https://www.snappr.com Logo
Snappr
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 5 years of progressive experience in operations
  • At least 2 years in a leadership role
  • A track record of running performance improvement plans
  • Proven experience in effectively managing and leading a team
  • Demonstrated experience in driving and achieving Key Performance Indicators (KPIs)
  • Strong analytical and problem-solving skills
  • Strong leadership skills
  • Great spreadsheet skills are an advantage
  • Familiarity with Adobe Photoshop is preferred but is not a hard requirement
  • Should be willing to work with creative people
Job Responsibility
Job Responsibility
  • Lead and manage day-to-day operations, ensuring efficiency, quality, and adherence to established processes
  • Manage and mentor a team of Specialists, providing guidance, support, and fostering a collaborative team environment
  • Drive and monitor key performance indicators (KPIs) to ensure the team meets or exceeds performance targets
  • Design and implement performance improvement plans for team members who require such assistance
  • Collaborate with cross-functional teams to enhance communication and coordination across departments
  • Develop and implement strategies to improve operational processes and streamline workflows
  • Continuously assess and optimize operational procedures to enhance productivity
  • Act as a point of contact for escalated issues and provide timely resolutions
  • Communicate with Senior Operations Manager/s and Head of Operations to ensure projects are on track
  • Monitor and produce regular performance reports
What we offer
What we offer
  • Transportation allowance provided
  • 20% night differential (if applicable)
  • Health Insurance (Day 1 HMO w/ dependents)
  • Free daily meals
  • Paid Time Off
  • Company Equity
  • Fulltime
Read More
Arrow Right

Director of Quality Engineering

HMH is a learning technology company committed to delivering connected solutions...
Location
Location
India , Pune
Salary
Salary:
Not provided
edtechjobs.io Logo
EdTech Jobs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of experience in software quality engineering
  • At least 7+ years in leadership roles overseeing QA/QE or Platform Engineering
  • Proven experience managing large engineering teams across geographies, preferably 50+ team members
  • Demonstrated success leading AI/automation initiatives within engineering or quality organizations
  • Deep expertise in modern testing strategies, CI/CD pipelines, cloud-native architectures, and tooling
  • Strong understanding of SDLC, release governance, and large-scale program execution
  • Excellent communication, stakeholder management, and leadership presence
  • Ability to operate in a fast-paced, matrixed global environment
Job Responsibility
Job Responsibility
  • Provide on-the-ground leadership for all QE teams in Pune, ensuring strong engagement, alignment, and execution
  • Develop and execute a strategy to elevate engineering maturity, strengthen delivery discipline, and scale operational excellence
  • Serve as a key member of the global engineering leadership team, driving alignment across geographies and business units
  • Engage with cross-functional teams, including product managers and business leaders, to align technical efforts with company objectives
  • Lead adoption and integration of AI, autonomous testing solutions, and agentic workflows to improve efficiency, accuracy, and delivery velocity
  • Champion innovation in automation frameworks, intelligent observability, and predictive analytics across QE
  • Evaluate and drive implementation of advanced tooling and platforms to enhance productivity
  • Oversee roadmap delivery for Platform and Curriculum initiatives, ensuring commitments are met with speed, reliability, and quality
  • Establish strong governance, release management rigor, and continuous improvement practices
  • Partner closely with Product, Architecture, Engineering, and Program teams to ensure seamless end-to-end delivery
  • Fulltime
Read More
Arrow Right

Technical Lead

At AKQA we believe in the imaginative application of art and science to create b...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
akqa.com Logo
AKQA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Client facing
  • Thought Leadership and promotion of AKQA Technology
  • AI Implementor
  • AI Usage - proficient elevated workflow and development tooling
  • AI Enabled Experience Development & Integration - vendor and cloud landscape knowledge, systems design, integration & model customisation
  • AI Architecture - Agentic AI creation and Orchestration
  • AI Content & Data Engineering
  • AI Cost x Value calculations
  • AI Governance and Testing models
  • Design and implement first-class end-to-end Solutions and MACH Architectures
Job Responsibility
Job Responsibility
  • Main driver for the end-to-end
  • ideation, technical innovation, design, scoping, development, deployment and maintenance of solutions
  • Overall responsibility for the day-to-day technical ownership and direction of a project
  • Lead the technical direction and architecture of the project
  • Contribute to code, particularly during critical phases or to prototype new features
  • Work closely with Business, Project Management, Creative, UX, and Data teams
  • Run on-shore, off-shore and hybrid development teams
  • Contribute to Technical Strategy, ideation, pitching, pre-sales activities and engineering, thought leadership, profile creation and speaking engagements
What we offer
What we offer
  • Hybrid working environment
  • Frequently collaborating with our global studios and partners
  • Work in a team of highly skilled people
  • Work in a progressive environment that fosters a meritocratic culture
  • Explore our extensive range of benefits
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy