This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Microsoft AI is pushing the boundaries of technology. We are creating unique, beautiful and powerful products that will change lives. As a small, friendly, fast-moving team, we support each other to do the best work of our lives, always looking to break new ground, fast. We are proud of what we build, how we build it and that our products will define the AI era. We run lean, obsess about users, and always make our decisions based on the evidence. We ship regularly, so your work will have real and immediate impact. It’s a time of huge change in the AI landscape, and this role will put you right in the heart of it. We're looking for a Senior AI Product Manager who will drive Copilot model capabilities such as tool-use to ensure that the language models that power Microsoft Copilot deliver high quality responses to our users whilst being grounded, reliable, and cost-efficient. You will work at the nexus of product and research, driving execution in partnership with engineers, language engineers, data scientists and researchers. We’re looking for someone with an abundance of positive energy, empathy, and kindness, in addition to being highly effective. The right candidate takes the initiative and enjoys building world-class consumer experiences and products in a fast-paced environment.
Job Responsibility:
Develop and execute on LLM platform strategy for Copilot that extend language model's capabilities
Prototype approaches by steering language models to drive response quality across a wide range of scenarios
Identify and prioritize platform, orchestration and language model issues that impact quality, factuality and safety and working with engineers and researchers to find a path to resolution
Define and build measurable evaluations with relevant datasets to demonstrate quality improvements
Define, deploy and manage experiments in production that impact language model's tool use, driving measurable improvements in relevance for and engagement with Copilot users
Partner with product teams to scale tool building and work with inference, agents and orchestration teams to resolve dependencies
Accountable to own the status of key projects, proactively identifying risks and proposing solutions to ensure timely delivery
Requirements:
Bachelor's Degree AND 5+ years experience in product management OR equivalent experience
3+ years of experience leading ambiguous product areas, defining requirements, developing roadmaps, and working with multi-disciplinary teams to execute them
2+ years of experience building ML-powered or LLM-powered products
Hands-on experience with LLM APIs (e.g. OpenAI, Anthropic, Azure OpenAI), embeddings, vector databases, and tool use
Hands-on experience with prompt design, context window management, and model evaluation