This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Microsoft Teams is used by over 300 million people worldwide for meetings, chat, calling, and collaboration. Search is one of the highest-leverage surfaces in Teams, helping users instantly find messages, files, people, meetings, and more across their entire M365 graph. As AI transforms how users interact with information, Teams Search is evolving from keyword retrieval to intelligent, context-aware assistance powered by large language models. We are looking for a Principal Product Manager based in IDC Bangalore to own the quality and evaluation strategy for Teams Search. You will define how we measure, improve, and ship a best-in-class search and AI-powered retrieval experience at scale. This is a senior IC role with high visibility across Teams, M365 Search, and the broader Copilot platform.
Job Responsibility:
Own Search Quality & Evals Strategy: Define the evaluation framework for Teams Search
Lead the design of human evaluation pipelines
Build and maintain an offline eval harness
Partner with Applied Science and engineering to translate eval signals into roadmap priorities and quality SLAs
Drive AI-Powered Search Features: Define product requirements for semantic search, hybrid retrieval, re-ranking, and Copilot-integrated search experiences in Teams
Own the PM relationship with the relevance science team
Work with the Copilot/AI team to integrate retrieval-augmented generation (RAG) patterns into Teams Search
Define Metrics and Success: Own the success metrics hierarchy for Teams Search
Instrument A/B experiments end-to-end
Build a culture of evidence-based decision making
Stakeholder Leadership: Collaborate with partner teams across M365 Search, Copilot
Represent Teams Search in cross-org quality reviews, red-lines, and AI safety reviews
Mentor junior PMs on the team
Requirements:
Bachelor's Degree AND 8+ years experience in product/service/program management or software development
8+ years of product management experience, with at least 3 years in search, information retrieval, or a related ML/AI-powered product area
Deep, hands-on experience with evaluation frameworks for search or AI systems
Solid understanding of IR fundamentals: ranking, relevance, query understanding, recall/precision trade-offs
Experience with LLM-era eval challenges: hallucination detection, groundedness, response quality, and human eval design for generative outputs
Demonstrated ability to work cross-functionally with applied scientists, ML engineers, and data teams
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Nice to have:
Experience shipping search or retrieval features in a large-scale consumer or enterprise product (100M+ users)
Familiarity with RAG pipelines, vector databases, hybrid retrieval architectures, or semantic search systems
Experience with annotation platforms (Scale AI, Appen, internal tools) and managing human evaluation programs
Knowledge of Microsoft 365 data model, Graph API, or Teams platform is a strong plus
Prior experience in a Hyderabad/Bangalore engineering or PM role, with ability to influence across time zones