CrawlJobs Logo

AI Product Manager, Insights

United States, San Francisco 206800.00 - 258500.00 USD / Year · Job Posted February 20, 2026
Apply Position
Job Link Share

Job Description

We are looking for a highly analytical and strategic thinker to take ownership of our model evaluation analysis and insight generation. Our analysis has established a high standard for deep-dive analysis of model evaluation. We need someone who can not only maintain this cadence but elevate it, turning raw result data into a roadmap for model improvement.

Job Responsibility

  • Own the creation of model evaluation from initial hypothesis, data scraping to final publication
  • Go beyond aggregate metrics (e.g., "Accuracy is 85%"). deeply analyze why the model failed on the other 15%. Identify semantic patterns, edge cases, and systemic hallucinations in raw model outputs
  • Review raw data sets, meeting transcripts, and research notes to identify the "so what?" We need to turn these findings into a logical hierarchy
  • You will act as the bridge between the data and the narrative by structuring findings into a logical hierarchy where the most critical "hook" lands first, followed by the supporting evidence

Requirements

  • 5 - 10 years of experience in DS, ML, AI research and analysis
  • Structured Thinker: You organize your writing logically
  • High Tolerance for Ambiguity: You can take a messy pile of notes and organize it into a coherent outline without needing your hand held
  • Executive Presence: You are comfortable interviewing senior leaders and pushing back when an "insight" isn't actually insightful
  • Cross Functionality: Be able to work cross functionally across ML researchers to clients

Nice to have

  • Experience in Model Evaluation, ML Engineering or Technical Research
  • Experience designing or curating datasets (RLHF, SFT data)

What we offer

  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

AI Product Manager, Insights

8 matching positions

Principal Product Manager - AI Governance (Azure AI Foundry)

AI is transforming how organizations operate, and with it comes a new frontier o...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree AND 8+ years in product management, program management, or technical leadership roles OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Deep familiarity with AI/ML systems, model governance, or enterprise compliance frameworks
  • Proven experience driving cross-functional initiatives with engineering, security, and policy teams
  • Excellent communication skills with demonstrated ability to influence across organizational boundaries
  • 10+ years of product management or applied AI experience, ideally in enterprise cloud or responsible AI domains
  • Knowledge of AI governance frameworks (EU AI Act, NIST AI RMF, ISO 42001, SOC 2, etc.)
  • Experience building or integrating security, compliance, or observability products
  • Familiarity with agentic AI systems and associated risk classes (e.g., sensitive data leakage, prohibited actions, task drift, jailbreaks)
Job Responsibility
Job Responsibility
  • Lead the AI Governance product area within Azure AI Foundry — defining the long-term vision, strategy, and roadmap for policy management, compliance automation, and regulatory readiness
  • Design and deliver core governance experiences, including agent-level policies, data sensitivity signals, prohibited action controls, and AI system compliance dashboards
  • Integrate Foundry governance with Microsoft’s broader security and compliance stack — Entra (identity and A2A policies), Purview (data classification and DLP), and Defender (threat insights)
  • Translate emerging AI regulations (EU AI Act, ISO 42001, NIST AI RMF) into actionable platform capabilities and customer experiences
  • Partner with Responsible AI researchers and engineering teams to operationalize ethical principles into measurable safeguards and evaluators
  • Collaborate with customers, industry bodies, and policymakers to help shape standards for trustworthy AI deployment
  • Establish and track success metrics (governance coverage, compliance posture, customer adoption), ensuring measurable impact and clarity across engineering and partner orgs
  • Represent the product in executive and customer forums, evangelizing Microsoft’s approach to responsible, governed AI systems
  • Fulltime
Read More
Arrow Right
New

Technology Product Manager AI & Data Strategy

Finance Technology at Citi is a catalyst for technology and process transformati...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ Years of Demonstrated experience in Product Management and/or Product Development discipline with Finance background is mandate
  • Solid Experience with Data pipelines, virtualization, analytics, Automation and management, process re-engineering and AI-led transformation projects
  • Ability to Represent customer needs to guide product development features, functionality, and overall competitiveness
  • Strong understanding of Finance processes and data flows, record to report, Accounting, reconciliation, regulatory reporting and close process, with ability to interpret financial data. Familiarity with Financial products and asset classes, with an appreciation of how transactions flow from source product systems to financial reporting
  • Strong working knowledge of Agentic AI/ML, LLM, A2A concepts and their practical applications in business processes across financial services
  • Ability to critically assess where AI adds value vs, where traditional rule-based automaton / process improvements are more effective ensuring pragmatic and cost-efficient solutions
  • Strong experience and background with Data analysis, management and automation. Basic, SQL, Python will be added advantage. Ex
  • Proven ability to translate ambiguous business problems into structured AI and automation opportunities, including defining problem statements, required data inputs and expected outcomes
  • Ability to apply ingenuity, creativity and analytical thinking to problem analysis and resolution in complicated and/or novel situations
  • Build consensus and communicate the value proposition to key partners and stakeholders across the organization, ask right questions and challenge current ways of working to identify root-cause of problems
Job Responsibility
Job Responsibility
  • Ownership of the Product backlog and roadmap, strategy, outlining the vision and direction for the product offering over time, to ensure users derive the most value possible from the product
  • Develop solution proposals, business cases, and budget requests
  • Define and prioritize and product roadmaps aligned with transformation initiative and coordinate delivery with engineering
  • Work in an agile environment (Scrum/ release ceremonies), continuously reviewing the business needs, refining priorities, outlining milestones and deliverables, and identifying opportunities and risks
  • Responsible to create Product features and epics functionalities in JIRA which enable achievement of business goals by collaborating with stakeholders
  • Drive stakeholder alignment and iterative product delivery
  • Lead business process redesign, operational optimization, digital transformation initiative and change management
  • Manage cross-functional dependencies, regulatory and risk alignment, user adoption and change management
  • Work with Data: Data analysis to document business requirements at the right level, draw meaningful insights, and visualize conceptual and logical data models and flows. Collaborate with various teams and application owners to unify data concepts across finance applications across Citi
  • Stay ahead of AI. This space moves fast. We need someone who follows it seriously, brings new ideas back to the team, and actively applies what they're learning to the products we build. If you've been experimenting with new models, new tooling, or new patterns, that's exactly the kind of thinking we want in the room
  • Fulltime
Read More
Arrow Right

Senior Product Manager, AI

Bubble is the only fully visual AI app builder that lets you vibe code without t...
Location
Location
United States , New York City
Salary
Salary:
170000.00 - 220000.00 USD / Year
bubble.io Logo
Bubble
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8+ years of product management experience including experience building AI products and working on end user facing products at scale
  • Experience shaping evidenced-based roadmaps and leading high-impact projects from discovery through launch and iteration
  • Strong technical fluency and hands-on experience designing, building, and improving the quality of AI products
  • Proficient using AI to accelerate product work, from capturing insights to generating documentation to creating prototypes
  • Strong product judgment: you can spot high-impact opportunities and turn them into concrete, actionable plans
  • Experience working with design to find intuitive and easy to use solutions to complex UX problems
  • Comfortable partnering with engineering: You engage on technical tradeoffs and help shape implementation decisions
  • Experience using research and data to inform product decisions, not just validate them
  • Strong communication skills for working with cross-functional teams
  • Desire to move quickly in building, launching, and iterating
Job Responsibility
Job Responsibility
  • Drive the product strategy, OKRs, and roadmap for an AI focus area
  • Drive product initiatives from concept through delivery, balancing long-term thinking with near-term execution
  • Partner closely with design and engineering in product discovery and delivery, and with marketing and success in go-to-market
  • Leverage AI to accelerate prototyping, research and validation, engineering & GTM hand-off, and more
  • Conduct user research to validate product opportunities, and use evals and feedback to iterate on the experience
  • Clearly scope MVPs and make informed prioritization decisions while maintaining high standards
  • Mentor junior members of the team and help shape product team processes and best practices
  • Get hands-on building with Bubble to become an expert on our platform
What we offer
What we offer
  • Comprehensive health coverage
  • 401(k) matching
  • Wellness and work enablement stipends
  • Generous PTO
  • A Sabbatical program
  • Generous equity
  • Flexible PTO
  • Competitive healthcare
  • Fulltime
Read More
Arrow Right

Senior Product Manager, AI & Developer Productivity Data Strategy

As a Senior Manager of Product Management for Inner Loop, you will own the measu...
Location
Location
United States , McLean; Richmond; New York; Plano; Chicago
Salary
Salary:
182500.00 - 249900.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of experience working in Product Management
  • Bachelor's Degree in a quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Computer Science, Computer Engineering, Software Engineering, Mechanical Engineering, Information Systems or a related quantitative field)
  • Master's Degree in a quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Computer Science, Computer Engineering, Software Engineering, Mechanical Engineering, Information Systems or a related quantitative field) or an MBA with a quantitative concentration
Job Responsibility
Job Responsibility
  • Own the measurement and acceleration of how 14K+ developers write, test, and ship code at Capital One
  • Define the metrics that engineering leaders use to invest, build data products that quantify developer productivity
  • Shape how the enterprise measures the impact of AI coding tools on the software development lifecycle
  • Turn developer experience data into actionable insights
  • Directly influence how Capital One builds software faster, with higher quality, and less friction
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • Fulltime
Read More
Arrow Right

Senior Product Manager, AI Literacy

We are seeking a Senior Product Manager with extensive experience in educational...
Location
Location
United States of America
Salary
Salary:
101900.00 - 132800.00 USD / Year
blackbaud.com Logo
Blackbaud
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years in product management, with at least 3 years in senior-level roles.
  • Proven track record of launching education, certification, or SaaS products at scale, including 0-to-1 programs or products.
  • Strong understanding of AI concepts, Responsible AI principles, and regulatory frameworks.
  • Exceptional communication and stakeholder management skills.
  • Data-driven decision-making and comfort with ambiguity and change agility.
  • Strategic thinker with ability to translate vision into actionable plans.
Job Responsibility
Job Responsibility
  • Serve as the primary product liaison for the AI Coalition for Social Impact, an advisory body of external companies, practitioners, and AI experts.
  • Structure and lead coalition meetings related to this initiative, working groups, and review cycles that inform the certification’s competencies, frameworks, and design.
  • Translate coalition insights and recommendations into prioritized certification product requirements and roadmap updates.
  • Maintain strong relationships with coalition members, ensuring engagement is productive, collaborative, and impactful.
  • Own the full product lifecycle - from discovery and design through development, launch, and continuous improvement.
  • Prioritize features and enhancements using data, customer feedback, and input from coalition partners and internal subject matter experts.
  • Ensure alignment with Responsible AI guidelines and emerging regulatory frameworks relevant to AI literacy.
  • Conduct market research, persona development, and analysis to identify opportunities and differentiation.
  • Partner with Corporate Marketing to support content development, campaigns, and launch activities.
  • Present the product and its impact at industry events, webinars, and partner engagements in collaboration with Marketing and the Blackbaud Institute.
What we offer
What we offer
  • Medical, dental, and vision insurance
  • Remote-flexible workforce
  • Wellness Programs
  • 401(k) program with employer match
  • Flexible paid time off
  • Generous Parental Leave
  • Donations for Doers
  • Pet insurance, legal and identity protection
  • Tuition reimbursement program
  • Fulltime
Read More
Arrow Right

Research & Insights Manager – Product & Market Focus

Do you want to go beyond analyzing data and actually drive business impact? As a...
Location
Location
Germany , Dusseldorf
Salary
Salary:
Not provided
stepstone.de Logo
StepStone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in Business, Economics, Statistics, Data Science, Marketing or a comparable field with a strong analytical focus
  • Experience in Product Marketing, Strategy, or Lifecycle Marketing
  • Fluent in German and English, both written and spoken
  • Strong understanding of subscription-based B2B business models and digital product-driven organizations
  • Solid background in market or labor market research, including quantitative methods, trend analysis and segmentation
  • Experience with Qualtrics (or similar)
  • Strong interest in and curiosity about AI tools and their practical applications
  • Hands-on experience with at least one AI assistant or LLM-based tool (e.g. Claude, ChatGPT, Gemini)
  • Ability to translate complex data into clear insights, compelling narratives and decision-ready outputs
  • Strong commercial mindset with a focus on revenue impact, product adoption and positioning
Job Responsibility
Job Responsibility
  • Analyze labor market, product, and competitive data to identify trends and differentiation potential
  • Translate insights into clear recommendations for product and go-to-market decisions
  • Build data-driven narratives around value proposition, ICPs, and positioning
  • Provide proof points for campaigns, launches, and messaging
  • Create sales-ready insights, pitch materials, and benchmarks to strengthen conversion
  • Turn research into thought leadership, content, and demand-generating formats
  • Develop dashboards and reporting frameworks to enable stakeholders
  • Ensure insights are accessible, actionable, and widely adopted across teams
What we offer
What we offer
  • 30 days of vacation + 1 local holiday + 2 extra days for Christmas and New Year
  • Hybrid working model
  • Company pension scheme
  • Company life insurance
  • Volunteer days
  • Job bike
  • In-house gym
  • In-house barista
  • Discounted Urban Sports Club membership
  • Discounted parking, job ticket or Deutschlandticket
  • Fulltime
Read More
Arrow Right

Principal AI Product Manager, Technical

Principal Innovation Product Manager, Technical is a visionary, strategist, anal...
Location
Location
United States , Bellevue
Salary
Salary:
139700.00 - 252000.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, Engineering, IT or equivalent experience
  • 8+ years’ experience in hands on technical role writing production code, solution engineering, or technical archtecture in large scale company / appplication / product environment
  • More than 10 years Relevant Product Management experience in an agile software product development environment
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Vision & Strategy for AI Products
  • Owns strategy, roadmap, and lifecycle for enterprise AI products and reusable AI capabilities serving multiple customer journeys, business units, or platforms
  • Accountable for measurable business outcomes including revenue growth, cost reduction, adoption, retention, automation impact, and customer experience improvement
  • Drives multi-year product investment strategy, including business cases, funding requests, and prioritization of AI initiatives across a portfolio of opportunities
  • Own the product lifecycle for complex technical solutions, ensuring alignment with business objectives and customer needs
  • Conducts deep customer research and market analysis to identify breakthrough AI opportunities
  • Defines success metrics and tracks progress against ambitious growth targets
  • Anticipates AI trends and competitive threats, incorporating insights into product strategy
  • Conducts analysis of quantitative and qualitative data to identify product innovation opportunities or root cause of issues, and assess opportunity size and impact
  • May work with data scientists to answer complex questions or identify meaningful insights from data
What we offer
What we offer
  • competitive base salary and compensation package
  • annual stock grant
  • employee stock purchase plan
  • 401(k)
  • free, year-round money coaches
  • medical, dental and vision insurance
  • flexible spending account
  • paid time off
  • up to 12 paid holidays
  • paid parental and family leave
  • Fulltime
Read More
Arrow Right

AI product manager

At HubX we build mobile apps, used and loved by millions all around the world. W...
Location
Location
Turkey , Istanbul
Salary
Salary:
Not provided
hubx.co Logo
HubX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/MS in Software/Computer/Electronics/Industrial Engineering or related disciplines
  • Experience using and applying Large Language Models. You should know how to prompt-engineer them, how to evaluate them, and understand how they are tuned
  • Hands-on experience building or using LLM-powered agentic solutions
  • A healthy blend of general technical knowledge with a customer-focused mindset and empathy
  • Great communication skills and background knowledge for customers, stakeholders, and technical team
  • General knowledge of the ins and outs of development, UI/UX design and flows, agile framework, software development, scrum approach, and IT infrastructure
  • A desire to work in a fast-paced, results-driven environment
Job Responsibility
Job Responsibility
  • Creating business analysis documents, test cases, mockups, and prototypes to assist with development, including leveraging AI tools (e.g., LLMs) to accelerate documentation, generate scenarios, and validate edge cases
  • Analyzing metrics to understand customer and product performance, incorporating AI-driven insights (e.g., model outputs, user interactions with AI features, prompt success rates) to guide product decisions
  • Staying in sync with team members using agile approaches, while adapting workflows to support rapid experimentation and iteration of AI-powered features
  • Attending grooming sessions with the development team to clarify requirements, including defining AI-specific behaviors (e.g., prompts, expected outputs, fallback scenarios) and ensuring the team understands both product and model-related objectives
  • Partnering closely with technical teams by bringing clear, structured requirements to engineers, and actively contributing to discussions around LLM capabilities, constraints, and implementation trade-offs
  • Running qualitative and quantitative research to define ambiguous problems, including evaluating where AI/LLMs can provide value and validating hypotheses through data and experimentation
  • Designing, testing, and iterating on prompt strategies
  • understanding prompt engineering techniques and how they impact model performance and user experience
  • Evaluating LLM outputs using structured approaches (e.g., accuracy, consistency, safety, and relevance), and working with teams to improve model performance through fine-tuning or prompt adjustments
  • Collaborating on or contributing to the development of LLM-powered or agentic solutions, understanding how multi-step AI workflows operate and how they integrate into the product experience
What we offer
What we offer
  • Huge impact
  • Ownership, opportunity to take responsibility from day one
  • A competitive compensation package
  • A brand new Macbook and welcome kit
  • Private Medical Insurance & HPV Vaccine & Critical Women’s Health Coverage
  • Gym Reimbursement
  • A unique and top-notch office
  • Unlimited coffee from XPresso
  • Limitless Snacks & breakfast
  • Continuous education
  • Fulltime
Read More
Arrow Right