CrawlJobs Logo

Product Manager, AI Quality

United States, San Francisco Bay Area 160000.00 - 240000.00 USD / Year · Job Posted January 06, 2026
Apply Position
Job Link Share

Job Description

As Glean’s PM for Glean Model Hub, you will evaluate LLM models, define the roadmap for growing Glean’s LLM portfolio, manage relationships with inference and model providers, and determine product strategy for allowing customers to experiment with different LLMs. You will own projections of LLM usage, cost, and capacity planning while driving customer enablement and their upgrade adoption journey for the latest LLMs and LLM-native capabilities.

Job Responsibility

  • Evaluate LLM models
  • Define the roadmap for growing Glean’s LLM portfolio
  • Manage relationships with inference and model providers
  • Determine product strategy for allowing customers to experiment with different LLMs
  • Own projections of LLM usage, cost, and capacity planning
  • Drive customer enablement and their upgrade adoption journey for the latest LLMs and LLM-native capabilities
  • Spend time with customers to deeply understand their knowledge needs
  • Develop key parts of our product roadmap, marrying customers’ needs with our product vision
  • Empower your team by giving context, setting direction, and building alignment
  • Drive customer-focused decisions, clear prioritization, and efficient execution
  • Coordinate cross-functionally with leadership, go-to-market teams, and other key stakeholders across the company
  • Build processes that will scale as our team and company go through rapid growth

Requirements

  • 4+ years of experience in product management at SaaS companies, primarily serving large enterprises with responsibilities spanning AI/ML Ops and external-facing platform capabilities
  • Strong technical background and experience with both UX and API driven products and 3rd party product partnerships
  • Excellent written and verbal communicator
  • Proven track record of taking ownership, taking initiative, and delivering results
  • Collaborate effectively with cross-functional partners
  • Learning and growth mindset
  • Mission-first and understand that your success is measured by your product and team’s success
  • Early adopter in building with or adopting AI for your own product craft and excited about helping customers accelerate their own AI adoption journey

Nice to have

Having built or worked with LLMs for at-scale products is a major plus

What we offer

  • Medical, Vision, and Dental coverage
  • Generous time-off policy
  • Opportunity to contribute to your 401k plan
  • Home office improvement stipend
  • Annual education and wellness stipends
  • Vibrant company culture through regular events
  • Healthy lunches daily

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Product Manager, AI Quality

8 matching positions

Principal Product Manager, AI Quality

As a Principal Product Manager for AI Quality in Central AI, you will play a piv...
Location
Location
United States
Salary
Salary:
161100.00 - 252625.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of product management experience, with substantial recent experience driving relevance and quality for a consumer or enterprise AI product
  • Proven proficiency in defining and improving on relevance and quality measurement metrics
  • Strong technical subject matter expertise, with a comprehensive understanding of search/ads technologies, natural language processing, and machine learning principles
  • Data-driven decision-making skills, including the ability to independently analyze complex data sets, identify trends, and demonstrate the customer impact of improvements
  • Deep user empathy and commitment to delivering exceptional experiences, with attention to detail that drives continuous improvement
  • Exceptional communication and stakeholder management skills, capable of conveying complex technical concepts clearly to both technical and non-technical audiences, including senior executives
  • Demonstrated ability to influence and drive cross-functional initiatives without direct authority, maintaining alignment across diverse teams
  • Bachelor's or Master’s degree in Computer Science, Data Science, or a related field preferred
Job Responsibility
Job Responsibility
  • Define and drive the strategic vision and roadmap for AI quality for your feature areas, clearly articulating the desired outcomes and the path to achieve them
  • Lead initiatives to improve the quality, reliability, and trustworthiness of AI models and experiences, ensuring alignment with organizational goals and user expectations
  • Partner with engineering, data science, product, and design teams to identify opportunities and implement improvements in AI quality
  • Advocate for relevance and quality standards, influencing stakeholders and championing initiatives that elevate user experience
  • Develop deep customer insights to pinpoint gaps in quality, proactively addressing issues to enhance user satisfaction and engagement
  • Regularly interact with users and internal stakeholders to validate quality enhancements and prioritize feature improvements
  • Create compelling narratives and communicate progress effectively to customers, stakeholders, and the broader community, highlighting Atlassian’s advancements in search relevance and quality
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
Read More
Arrow Right

Senior Product Manager – Conversational AI Servicing Quality Assurance

Location
Location
United States , McLean; Richmond; New York
Salary
Salary:
200700.00 - 249900.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of experience working in Product Management
  • A Bachelor's Degree in a quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Computer Science, Computer Engineering, Software Engineering, Mechanical Engineering, Information Systems or a related quantitative field)
  • A Master's Degree in a quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Computer Science, Computer Engineering, Software Engineering, Mechanical Engineering, Information Systems or a related quantitative field) or an MBA with a quantitative concentration
Job Responsibility
Job Responsibility
  • Drive Conversational AI Integration: Own the end-to-end platform integration and roadmap execution required to successfully onboard conversational AI solutions onto our enterprise quality assurance platform
  • Pioneer AI QA & Feedback Loops: Support the development of advanced 'AI QA on AI' capabilities
  • Scale Automated Assessments: Design the systems that allow our automated QA platform to keep pace with rapid coverage expansion
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Product Manager, Trip Quality Merchandising and AI

Airbnb is seeking an experienced product leader to own the guest-facing quality ...
Location
Location
United States , San Francisco
Salary
Salary:
224000.00 - 280000.00 USD / Year
airbnb.com Logo
Airbnb
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of product management experience
  • Expert ability to use data and business analysis to inform product strategy and drive decisions
  • Domain familiarity with marketplace trust/quality, search/ranking/relevance, or content/feedback systems is strongly preferred
  • Track record of shipping AI/ML-powered features on consumer products, including defining requirements for content generation, ranking, or personalization systems and working with data science teams to evaluate and improve model outputs
  • Experience creating product messaging and delivering to customers
  • Demonstrated track record of building cross-functional and executive leadership alignment
  • Experience working on consumer products with marketplace dynamics on a global scale
  • Entrepreneurial track record of taking an idea to reality
  • Excited to lead cross-functional execution, from strategy through shipped product in a fast-paced environment
  • Desire to do individual contributor product management work
Job Responsibility
Job Responsibility
  • Develop and execute the product roadmap for foundational data improvements related to trip quality, reviews, and ratings
  • Lead the product strategy and develop the roadmap for Trip Quality Merchandising and AI
  • Craft the product narrative that inspires teams, leadership, and the company and builds alignment on the quality merchandising strategy
  • Partner with design, engineering, and customer support to deliver features that improve both guest and host experiences
  • Collaborate closely with our Policy, Privacy, and Legal teams on topics that are essential to making Airbnb one of the most trusted marketplaces in the world
  • Build AI-powered features that improve how guests evaluate listing quality, partnering with Data Science to evaluate model performance and translate outputs into product decisions
  • Build deep expertise in how guests evaluate listing quality through user research, marketplace data, and competitive analysis
  • use those insights to define and prioritize features that will lead to improved user experiences and a better Airbnb service
  • Make prioritization decisions that balance guest experience, platform integrity, and host impact
  • Efficiently execute to ship updates and deliver impact for our business and customers
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Employee Travel Credits
  • Fulltime
Read More
Arrow Right

Principal Product Manager, AI Product

We are looking for a Principal Product Manager, AI Products to help define and d...
Location
Location
United States
Salary
Salary:
Not provided
themuse.com Logo
The Muse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years in enterprise SaaS, platform products, AI-enabled products, data products, or similarly complex technical environments
  • bonus if experience includes healthcare environments
  • Experience building and scaling enterprise-grade AI, machine learning, or generative AI products
  • Experience delivering products powered by LLMs, agentic systems, retrieval-augmented generation (RAG), intelligent automation, predictive analytics, or similar AI technologies
  • Proven track record shipping products used by enterprise customers at scale
  • Experience defining and delivering products tied to measurable business outcomes and revenue impact
  • Experience owning products with measurable commercial outcomes, including adoption, retention, growth, or revenue objectives
  • Demonstrable understanding of how product decisions connect to business performance and customer value realization
  • Experience partnering closely with Engineering and GTM organizations to successfully bring products to market
  • Strong technical fluency across modern AI systems, including generative AI, LLMs, retrieval architectures (RAG), intelligent automation, model evaluation, and AI governance
Job Responsibility
Job Responsibility
  • Own the end-to-end lifecycle of AI-powered product capabilities from concept through customer adoption and measurable business impact
  • Deliver enterprise-grade generative AI products and workflow automation capabilities into production environments at scale
  • Work directly with customers to understand operational challenges, validate product direction, and ensure solutions address real-world healthcare workflows
  • Translate advances in AI, LLMs, agentic systems, retrieval architectures, and analytics into practical customer solutions
  • Partner closely with Engineering, Data Science, Customer Success, and GTM teams to ensure products are successfully adopted and deliver measurable value
  • Drive roadmap decisions using customer needs, technical realities, business objectives, and market opportunities
  • Own product success metrics tied to customer adoption, revenue growth, operational efficiency, and business outcomes
  • Act as the accountable owner for shipping high-quality products on a predictable cadence
  • Mentor and elevate product management practices across the broader Product organization
What we offer
What we offer
  • Pet Insurance
  • Health Insurance
  • Dental Insurance
  • Vision Insurance
  • FSA
  • HSA
  • HSA With Employer Contribution
  • Life Insurance
  • Short-Term Disability
  • Long-Term Disability
  • Fulltime
Read More
Arrow Right

Senior Product Manager and Principal Product Manager

The Microsoft ES365 Engineering Systems team builds and operates the foundationa...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 5+ years' experience in product/service/program management or software development OR equivalent experience
  • Bachelor's Degree AND 8+ years' experience in product/service/program management or software development OR equivalent experience
  • 6+ years of product management experience, with direct experience defining and shipping products in complex technical domains
  • Hands-on experience experimenting with AI and LLM-powered workflows
  • Demonstrated ability to lead large cross-org initiatives
  • Direct experience influencing without authority
  • Experience driving multi-year, durable outcomes that improve engineering efficiency, quality, and organizational momentum
  • Experience in security, compliance, or engineering fundamentals
  • Familiarity with Microsoft's engineering ecosystem
Job Responsibility
Job Responsibility
  • Define and evolve the product vision, roadmap, and success metrics for AI-driven, agentic solutions
  • Identify high-leverage opportunities to simplify, automate and eliminate engineering toil using AI
  • Drive and deliver product capabilities that support security, compliance, and regulatory requirements
  • Partner closely with central security, compliance, and engineering teams across North America, India, and other global locations
  • Drive planning, pilot design, adoption, and rollout of solutions
  • Communicate product direction, roadmap, risks, and outcomes clearly to technical and executive stakeholders
  • Enable transparent change management
  • Use data, adoption signals, and customer feedback to continuously improve product impact and usability
What we offer
What we offer
  • Eligible for benefits and other compensation
  • Fulltime
Read More
Arrow Right
New

Senior Engineering Manager, AI Product (Thunderbolt)

Thunderbolt is an open-source, cross-platform AI product initiative from the tea...
Location
Location
Canada; United States
Salary
Salary:
190000.00 - 240000.00 USD; CAD / Year
mozilla.org Logo
Mozilla
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of professional software development experience, including significant experience in senior engineering leadership or complex product delivery roles
  • 5+ years of experience managing technical teams, including senior engineers or senior individual contributors
  • A track record of leading a team that shipped polished, top-tier products held to a genuine standard of craft
  • Strong ability to translate ambiguous product and technical direction into clear plans, ownership models, and delivery momentum
  • Technical fluency with AI-enabled products, including the ability to evaluate tradeoffs across areas such as LLM applications, RAG workflows, agents, enterprise search, automation, on-device AI, or AI evaluation
  • Demonstrated experience delivering complex applications across multiple platforms, such as desktop, web, and mobile, using technologies such as Tauri, Electron, React Native, or comparable frameworks
  • Experience with enterprise software, regulated environments, or similarly complex technical products, including security, privacy, compliance readiness, administration, integrations, and customer-controlled deployment models
  • Practical experience with local-first, offline-capable, self-hosted, hybrid, on-premise, air-gapped, or other customer-controlled product architectures, including tradeoffs related to data storage, sync, privacy, reliability, and user experience
  • Experience improving engineering practices related to technical planning, code review, release readiness, testing, documentation, CI/CD, maintainability, or technical debt management
  • Excellent communication skills around technical prioritization, release risk, ownership, quality expectations, and tradeoffs
Job Responsibility
Job Responsibility
  • Lead engineering execution by clarifying priorities, ownership, timelines, risks, dependencies, and quality expectations
  • Manage engineers and contractors, including coaching, feedback, prioritization, performance support, and team development
  • Stay close to the codebase by contributing code, reviewing technical work, evaluating tradeoffs, and helping the team maintain momentum and quality
  • Partner with technical and product leadership to turn product direction, AI strategy, user experience goals, and technical priorities into coordinated engineering plans
  • Establish planning, review, release, and follow-through practices that improve predictability and reduce bottlenecks
  • Maintain high standards for code quality, testing, documentation, reliability, security awareness, maintainability, and release readiness
  • Build strong product and architectural context across AI-enabled workflows, integrations, local-first or customer-controlled architectures, and release requirements
  • Partner across product, design, enterprise-facing teams, and technical leadership to balance speed, user experience, privacy, quality, enterprise readiness, and long-term sustainability
  • Lead hiring, onboarding, and resource planning as the Thunderbolt engineering team grows
  • Help Thunderbolt scale from an incubation-stage product into a reliable, enterprise-ready open-source AI product
What we offer
What we offer
  • Fully remote work & schedule flexibility
  • Company-provided laptop
  • Annual bonus program
  • Monthly remote work stipend
  • Annual professional development stipend
  • Access to Coursera learning platform
  • Industry conferences
  • Company all-hands and team gatherings
  • 24 days PTO per year (prorated)
  • Your birthday
  • Fulltime
Read More
Arrow Right
New

Senior Product Manager - AI Content Creation

As Senior Product Manager for AI Content Creation, you will lead the evolution o...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
babbel.com Logo
Babbel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A demonstrated track record of owning complex digital products end-to-end, from discovery through delivery
  • Strong product judgment and the ability to operate in ambiguous, fast-evolving problem spaces
  • Solid understanding of AI-powered systems and how to productize them. Experience building AI products is a plus
  • Experience working closely with engineers and data teams
  • A high bar for quality and a strong focus on user outcomes
  • Excellent communication and stakeholder alignment skills
  • Able to drive progress in ambiguous environments and communicate decisions clearly to technical and non-technical stakeholders
  • Note that our company's operating language is English, so you will need to be able to work in English.
Job Responsibility
Job Responsibility
  • Own the product strategy for AI-driven content creation, from discovery to execution
  • Create, improve and scale AI generation workflows, including prompting, evaluation, and quality loops
  • Enable faster creation of new languages, levels, and learning experiences, including more complex language systems
  • Balance automation and quality, evolving human-in-the-loop processes where needed
  • Define success metrics and use learner data and feedback to guide decisions
  • Collaborate across Product, Engineering, Data, Design and Learning Content to deliver reliable, learner-ready solutions
What we offer
What we offer
  • Flexible working models
  • Learning budgets
  • Free language learning
  • An inclusive, supportive environment that values curiosity and growth
  • Fulltime
Read More
Arrow Right

AI Product Manager

Get to Know Us: It's fun to work in a company where people truly believe in what...
Location
Location
United States , New York
Salary
Salary:
133000.00 - 167000.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years in corporate accounting executing across month-end close tasks
  • Bachelor's in Accounting, Finance, or a related field
  • Deep familiarity across ERP platforms like SAP, NetSuite, or Sage Intacct
  • Deep familiarity with the month end close process for a corporate accounting team
  • Clear, concise communicator with strong organizational hygiene to structure and manage multiple concurrent deliverables
  • Ability to translate technical accounting concepts to non-accounting stakeholders
  • Thrive in a fast-paced, in-person-first environment
Job Responsibility
Job Responsibility
  • Product Discovery & Client Partnership: Act as the primary product expert for our AI agents, guiding clients from initial design partnership through to successful adoption
  • Embed with client accounting teams to deeply understand their workflows, gather direct feedback, and translate their needs into actionable product requirements for the engineering team
  • Collaboration: Partner directly with engineering, design, marketing, and sales teams to ensure seamless product iteration and market fit based on client feedback
  • Compliance: Monitor the performance of and ensure that the quality of product outputs adhere to accounting standards by executing and improving on QA testing processes
  • Process Architecture: Maintain rigorous documentation of standard operating procedures, performance analytics, and quality assurance frameworks to ensure consistent execution and knowledge transfer across all involved teams
What we offer
What we offer
  • Short-term and long-term incentive programs
  • Robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right