CrawlJobs Logo

Principal Product Manager - Human Data

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Multiple Locations

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

139900.00 - 274800.00 USD / Year

Job Description:

As a Principal Product Manager, you will lead the human-in-the-loop evaluation program that drives the quality and experience of M365 Copilot Chat for Business—ensuring M365 Copilot is the best AI assistant for work, grounded in M365 data. You'll build and scale the people, processes, and evaluation pipelines that turn expert human judgment into reliable quality signals that directly shape the product.

Job Responsibility:

  • Define what great looks like for human data—bringing your own knowledge and perspective on the best approaches to collecting, interpreting, and applying human feedback across product decisions
  • Lead the human-in-the-loop evaluation program—designing evaluation frameworks, scorecards, and quality benchmarks that measure and continuously raise the bar on M365 Copilot's response quality, helpfulness, and user experience
  • Build and manage evaluation workforce operations, including vendor partnerships, annotator onboarding, qualification, training, and continuous performance management
  • Partner with data scientists and engineers to scope evaluation needs, define task instructions, calibrate annotators, and ensure evaluation data is reliable and repeatable

Requirements:

  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • 3+ years of human data or human-in-the-loop evaluation experience
  • Experience at an AI research organization or AI data services provider
  • 4+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework)
  • 6+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn)
  • Experience building and managing workforce programs, including vendor partnerships and annotation operations at scale
  • Proficiency in evaluation pipeline design, annotation frameworks, and quality governance
  • Track record of translating human feedback and evaluation signals into measurable product impact

Additional Information:

Job Posted:
March 19, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Product Manager - Human Data

AI Product Manager

We’re scaling AI and machine learning across our products, devices, and operatio...
Location
Location
United States , Boston
Salary
Salary:
121300.00 - 177900.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of product management experience, including significant ownership of AI/ML or data-intensive products
  • Clear track record of shipping production ML systems (not just integrating third-party AI APIs), in close partnership with data science, ML engineering, and MLOps
  • Principal-level impact: leading cross-team initiatives, shaping strategy, and influencing senior stakeholders
  • Strong understanding of core ML concepts and lifecycle: data, labeling, training/validation, evaluation metrics, deployment, monitoring, and retraining
  • ML experience with at least one of following: computer vision or sensor data, LLM-powered applications (prompting, RAG, fine-tuning, evaluation) and/or hardware or edge products (e.g., on-device models, connectivity/latency trade-offs)
  • Familiarity with modern ML infrastructure (cloud platforms, model serving, CI/CD for ML, monitoring/alerting)
  • Comfortable going deep into data, metrics, and model behavior—not just the UX layer
  • Excellent communicator who can make complex AI topics clear to diverse audiences
  • Strong alignment with our values: customer-obsessed, low ego, highly collaborative, comfortable with ambiguity, and biased toward learning and iteration.
Job Responsibility
Job Responsibility
  • Define and communicate the multi-year roadmap for key AI/ML capabilities across SimpliSafe
  • Identify and prioritize AI opportunities where models and data can materially improve safety, customer experience, or efficiency—on both devices and cloud services
  • Make build-vs-buy decisions for AI capabilities in partnership with data science and engineering
  • Partner with data scientists, ML engineers, and MLOps to design and deliver end-to-end ML solutions—from problem framing through data, training, evaluation, deployment, and monitoring
  • Work with hardware and embedded teams to shape edge AI/ML experiences (e.g., on-device detection, low-latency decisions, bandwidth-aware designs)
  • Define model-level requirements (metrics, latency, cost, guardrails) and connect them to business outcomes (e.g., false alarm reduction, detection accuracy, handle time, CSAT)
  • Translate product needs into requirements for ML platform capabilities (model serving, observability, experiment tracking, human-in-the-loop tools)
  • Lead product direction for LLM and multimodal use cases (e.g., text, vision, sensor data)
  • Decide when to use prompt engineering, RAG, fine-tuning, or traditional ML—and how to evaluate quality, safety, and hallucinations
  • Design workflows that incorporate human review and escalation where needed
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow, and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits.
  • Fulltime
Read More
Arrow Right

Principal Product Designer

Join T-Mobile’s Product, Experience Design & Innovation team as a Principal Prod...
Location
Location
United States , Bellevue; Denver; Overland Park; Frisco
Salary
Salary:
115400.00 - 208100.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in human-centered design, computer science, research, or related work experience in Service
  • 7+ years of experience in user experience, digital strategy, or product management
  • 5+ years' experience working with Figma
  • Demonstrated ability to lead highly technical, complex projects with cross-functional teams of strategists, designers, and engineers
  • Willingness to roll up sleeves and lead by example
  • Outstanding interpersonal, communication, presentation, data analysis, and storytelling skills
  • Excellent collaborator and communicator
  • Demonstrates a high level of executive accountability, initiative, flexibility, and the ability to prioritize resource workload to efficiently deliver results
  • Comfortable working in an ambiguous environment
  • Exceptional portfolio of work spanning multiple design projects that represent complex experiences related to Service
Job Responsibility
Job Responsibility
  • Drive the UX Roadmap and strategy framework through partnership with key leaders and other Principal Designers to ensure cohesive product experience across lines of businesses
  • Act as an evangelist for design thinking, partnering with key leaders to demonstrate how design empowers the creation of better digital products
  • Lead a design and user experience team in the creation of enterprise applications, design frameworks, visual libraries, and scalable interface assets
  • Collaborate with Engineering key leaders to understand and identify tech possibilities and constraints on LOB and company
  • Partner with Engineering key leaders to create new opportunities to develop tech capability that can enhance customer experience on LOB/enterprise level
  • Provide constructive feedback on peer user experience design reviews that’s focused on the big picture and future enterprise vision
  • Create high-level UX assets (workflow, customer journey map, prototype, etc.)
  • Solve complex customer experiences while building beautiful, usable interfaces
  • Collaborates with Researchers, other Principal designers and vendors to maintain consistency across the digital ecosystem and organization
  • Demonstrates ability to work with highly technical teams and handle multiple projects in a fast-paced environment
What we offer
What we offer
  • Annual bonus or periodic sales incentive or bonus
  • Medical, dental and vision insurance
  • Flexible spending account
  • 401(k)
  • Employee stock grants
  • Employee stock purchase plan
  • Paid time off
  • Up to 12 paid holidays
  • Paid parental and family leave
  • Family building benefits
  • Fulltime
Read More
Arrow Right

Principal Product Designer

Be the center of product innovation and design at T-Mobile. As a critical leader...
Location
Location
United States , Bellevue
Salary
Salary:
115400.00 - 208100.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in human-centered design, computer science, research, psychology, or related work experience
  • 7-10 years of experience of user experience, digital strategy, or product management
  • 2+ years experience working with Figma
  • Proficiency in UI design principles, execution, and best practices
  • Demonstrates ability to lead highly technical, highly complex projects with cross-functional teams of strategists, designers, and engineers in a fast-paced environment
  • Willingness to roll up the sleeves and lead by example when required
  • Outstanding interpersonal, communication, presentation, data analysis, and storytelling skills
  • Excellent collaborator
  • Demonstrates a high level of executive accountability, initiative, flexibility, and the ability to prioritize resource workload to efficiently deliver results
  • Comfortable working in an ambiguous environment
Job Responsibility
Job Responsibility
  • Drive the UX Roadmap and strategy framework through partnership with key leaders and other Principal Designers to ensure cohesive product experience across lines of businesses (LOBs)
  • Act as an evangelist for design thinking, partnering with key leaders to demonstrate how design empowers the creation of better digital products
  • Lead a design and user experience team in the creation of enterprise applications, design frameworks, visual libraries, and scalable interface assets
  • Implement ethical, accessible, and dynamic features and capabilities, such as AI-driven task recommendations and digital check-in tools, to streamline processes and improve operational efficiency
  • Collaborate with Engineering key leaders to understand and identify tech possibilities and constraints on LOB and company
  • Partner with Engineering key leaders to create new opportunities to develop tech capability that can enhance customer experience on LOB/enterprise level
  • Provide constructive feedback on peer user experience design reviews that’s focused on the big picture and future enterprise vision
  • Create high-level UX assets (workflow, customer journey map, prototype, etc.)
  • Collaborates with User Researchers and other Principal designers to maintain consistency across the digital ecosystem and organization
  • Demonstrates ability to work with highly technical teams and handle multiple projects in a fast-paced environment
What we offer
What we offer
  • Competitive base salary and compensation package
  • Annual stock grant
  • Employee stock purchase plan
  • 401(k)
  • Access to free, year-round money coaches
  • Medical, dental and vision insurance
  • Flexible spending account
  • Paid time off
  • Up to 12 paid holidays
  • Paid parental and family leave
  • Fulltime
Read More
Arrow Right

Principal Product Designer - Emerging Technologies

Be the center of product innovation and design at T-Mobile. As a critical leader...
Location
Location
United States , Bellevue; Denver; Atlanta; Overland Park; Frisco; Herndon
Salary
Salary:
115400.00 - 208100.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in human-centered design, computer science, research, psychology, or related work experience
  • 7-10 years of experience of user experience, digital strategy, or product management
  • 2+ years experience working with Figma
  • Demonstrates ability to lead highly technical, highly complex projects with cross-functional teams of strategists, designers, and engineers in a fast-paced environment
  • Willingness to roll up the sleeves and lead by example when required
  • Outstanding interpersonal, communication, presentation, data analysis, and storytelling skills
  • Excellent collaborator
  • Demonstrates a high level of executive accountability, initiative, flexibility, and the ability to prioritize resource workload to efficiently deliver results
  • Comfortable working in an ambiguous environment
  • Exceptional portfolio of work spanning multiple design projects
Job Responsibility
Job Responsibility
  • Drive the UX Roadmap and strategy framework through partnership with key leaders and other Principal Designers to ensure cohesive product experiences across lines of businesses (LOBs)
  • Conduct user research, usability testing, and data analysis to inform AI design decisions
  • Collaborate with Product Managers, AI researchers, and Engineers to align AI capabilities with user expectations
  • Advocate for ethical AI use, ensuring fairness, inclusivity, and transparency
  • Act as an evangelist for design thinking, partnering with key leaders to demonstrate how design empowers the creation of better digital products
  • Design intuitive and seamless experiences that integrate AI-powered features
  • Translate complex AI concepts into user-friendly interactions, ensuring explainability and transparency in AI-driven decisions
  • Facilitate workshops and design sprints to align teams on AI experience strategy
  • Create and test low- and high-fidelity prototypes for AI-powered experiences, including conversational flows, voice interactions, and adaptive UI components
  • Analyze research data and user feedback to understand customer pain points, identify business opportunities, and continuously refine AI behaviors, creating compelling narratives that drive customer-centric design solutions
What we offer
What we offer
  • Competitive base salary and compensation package
  • Annual stock grant
  • Employee stock purchase plan
  • 401(k)
  • Access to free, year-round money coaches
  • Medical, dental and vision insurance
  • Flexible spending account
  • Paid time off
  • Up to 12 paid holidays
  • Paid parental and family leave
  • Fulltime
Read More
Arrow Right

Senior HR Data Analyst

The Senior HR Data Analyst serves as the cornerstone of data integrity and manag...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
adbsafegate.com Logo
ADB Safegate
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Human Resources, Data Science, Information Technology, or a related field
  • a Master’s degree is a plus
  • Proven experience (minimum of 5 years) in data analysis, specifically within an HR context, demonstrating a deep understanding of HR processes and data systems
  • Advanced proficiency in data analytics tools (e.g., PowerBI, etc.) and HR Information Systems (HRIS) software. SuccessFactors experience is an advantage
  • Strong excel knowledge
  • Strong knowledge of data governance practices, data quality management, and data protection laws and regulations
  • Exceptional analytical and problem-solving skills, with the ability to translate complex data into actionable insights
  • Excellent communication and interpersonal skills, capable of working collaboratively across departments and presenting data in a clear, understandable manner
Job Responsibility
Job Responsibility
  • Strategic HR Data Management: Manage the implementation of process/system improvement plans, including testing phases, governance and documentation
  • STIP (Short Term Incentive Plan):Support monthly calculations for STIP accruals. Validate final calculations with the senior leadership team (SLT) and the Excom, ensure transparency and understanding through detailed presentations. Produce letters
  • Merit Administration: Design and provide user-friendly calculation templates, consolidate complex data from multiple regions for Excom approval, overseeing the smooth running of merit assessment. Letter Production
  • SuccessFactors and System Management: Act as a principal user and manager of SuccessFactors (including interactions with other systems like Concur). Oversee mass uploads, system maintenance tasks, ensure LinkedIn Learning and ServiceNow are operational and up to date
  • Data Reporting and Analysis: Strategically report and analyze data from SuccessFactors. This includes but is not limited to headcount, budget, merit, organizational design changes, and performance management
  • HR Scorecard Reporting: Lead in the production of regular HR Scorecard reporting, developing HR KPIs that provide strategic insights for business decision making
  • Performance Management: Oversee reporting on performance status, launch forms, and reminders. Use data insights to guide performance management strategies
  • HR Audits Support: Conduct and support HR audits via comprehensive data reporting whilst maintaining rigor in data management protocols
  • Exchange Rate Currency: Manage monthly updates of exchange rates applicable to global operations
  • Budget Ownership: In partnership with leadership, lead the budgeting exercise
What we offer
What we offer
  • A dynamic and challenging environment that encourages growth and learning
  • Opportunities for professional development and career advancement in an internationally operating company
  • A collaborative culture that values innovation, integrity, and inclusivity
  • Attractive compensation and comprehensive employee benefits
Read More
Arrow Right

Principal Lead UX Researcher

This role involves driving research for investments across Atlassian's broader S...
Location
Location
United States , Seattle
Salary
Salary:
169600.00 - 272500.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in research, including leading research strategy in complex and/or enterprise-level software environments
  • expertise in applying quantitative and qualitative research methods to business problems, impacting both product direction and detailed experience design
  • proficiency in hands-on research, with demonstrated skill in collecting and analyzing human behavioral data to improve product plans and UX in a technology industry setting
  • compelling storytelling skills with a range of strategies to drive engagement with and actionability of research-driven insights and analyses
  • proven expertise influencing business and product strategy, driving change across organizational boundaries
  • deep expertise building trusted advisor relationships with senior business leaders.
Job Responsibility
Job Responsibility
  • Collaborate with designers, data scientists, product managers, and engineers to create innovative solutions
  • identify, define, prioritize, and execute the critical research needs
  • deliver measurable impact to the business
  • partner with product managers, designers, data science, engineers, and other cross-functional teams to define the research roadmap, execute the strategy, and deliver critical insights
  • be product opinionated, leveraging deep user, market, and competitor understanding to influence product strategy and user experience design
  • connect UX insights with established brand and market research insights
  • provide thought leadership in UX and related research practices.
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • equity
  • bonuses
  • commissions
  • Fulltime
Read More
Arrow Right

Principal Product Manager

AgentX Support is Workato’s flagship AI-native engine designed to transform cust...
Location
Location
United States , Palo Alto
Salary
Salary:
Not provided
workato.com Logo
Workato
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of product management experience in enterprise software
  • Demonstrated success building 0-to-1 products or defining new market categories
  • Track record shipping ML/AI products to production (not just prototyping)
  • Experience with customer support platforms or CRM systems
  • Experience with real-time systems or high-throughput environments
  • Strong systems thinking and comfort designing across APIs, data, models, and workflows
  • Sufficient technical depth to partner effectively with engineering and AI research teams
  • Ability to operate effectively in ambiguous, fast-moving environments
  • Exceptional written and verbal communication skills, with executive-level presence
Job Responsibility
Job Responsibility
  • Define the vision and long-term strategy for AI-native, agentic customer support
  • Establish the product narrative and positioning that differentiates Workato in the customer service market
  • Represent Workato’s point of view with customers, partners, and industry stakeholders
  • Partner with design and marketing to translate product capabilities into clear customer value
  • Define how AI agents interpret intent, reason through complex customer issues, and determine when to act autonomously
  • Design orchestration frameworks that connect large language models with enterprise systems of record
  • Lead the development of workflows that enable AI agents to execute actions such as refunds, order modifications, and escalations
  • Ensure appropriate controls for safety, observability, compliance, and human-in-the-loop oversight at enterprise scale
  • Define the next-generation support agent workspace augmented by real-time AI guidance
  • Deliver systems that surface relevant context, recommendations, and next-best actions to human support agents during live customer interactions
What we offer
What we offer
  • Vibrant and dynamic work environment
  • Multitude of benefits they can enjoy inside and outside of their work lives
Read More
Arrow Right

Sr. / Principal Product Manager - AI

Shape the future of trust in the age of AI. At Oscilar, we're building the most ...
Location
Location
Salary
Salary:
Not provided
oscilar.com Logo
Oscilar
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of product management experience, with at least 3 years in B2B SaaS platforms
  • Proven track record building workflow automation, orchestration, or integration platforms
  • Experience with AI/ML products, particularly in production environments
  • Background in fintech, risk management, or financial services preferred
  • Demonstrated success launching technical products for non-technical users
  • Deep understanding of workflow orchestration patterns, event-driven architectures, and state machines
  • Experience with visual programming concepts and node-based editors (Node-RED, Retool Workflows, Pipedream)
  • Knowledge of AI/ML concepts including LLMs, embeddings, vector databases, RAG, and agent architectures
  • Understanding of real-time systems, message queuing (Kafka, RabbitMQ), and streaming data processing
  • Familiarity with API design, webhooks, OAuth flows, and integration patterns
Job Responsibility
Job Responsibility
  • Define the product vision for an AI-first risk orchestration platform that revolutionizes how FIs manage risk workflows
  • Develop the roadmap that balances no-code accessibility with sophisticated AI capabilities
  • Research and analyze competitive landscape (n8n, Zapier, Temporal) to identify differentiation opportunities
  • Create the strategy for transitioning from traditional rule engines to AI-orchestrated decisioning
  • Define success metrics and KPIs that demonstrate value across fraud, credit, AML, and onboarding use cases
  • Agentic Workflow Components: Design autonomous AI nodes
  • LLM Integration Framework: Build a flexible system supporting multiple LLM providers
  • Intelligent Orchestration: Create smart workflow features
  • Human-in-the-Loop AI: Design collaborative features
  • Node Library Development: Design 200+ pre-built risk nodes
What we offer
What we offer
  • Competitive salary and equity packages, including a 401k plan
  • Remote-first culture — work from anywhere
  • 100% Employer covered comprehensive health, dental, and vision insurance with a top tier plan for you and your dependents (US)
  • Unlimited PTO policy
  • AI First company
  • both Co-Founders are engineers at heart
  • and over 50% of the company is Engineering and Product
  • Family-Friendly environment
  • Regular team events and offsites
  • Unparalleled learning and professional development opportunities
  • Fulltime
Read More
Arrow Right