CrawlJobs Logo
Microsoft Corporation Logo Microsoft Corporation · IT - Software Development

Principal Technical Program Manager - Applied Science

United States, Redmond Employment contract 139900.00 - 274800.00 USD / Year · Job Posted May 04, 2026
Apply Position
Job Link Share

Job Description

The Applied Science team for GitHub Copilot sits at the intersection of frontier AI research and the world's largest developer platform. We ship AI-powered experiences (ex: code completion, code review, coding agents) used by millions of professional developers every day. As a member of the team, you will help lead GitHub Copilot's AI evaluation strategy end-to-end — from benchmark design and lifecycle governance, through evaluation infrastructure and internal adoption, to community engagement and public transparency. You are the person who ensures that every model swap, product harness, and feature launch is measured against what actually matters to developers — and that the world can see the results.

Job Responsibility

  • Partner with Applied Science researchers to translate cutting-edge evaluation research into production systems: adaptive testing (IRT), agent-centric co-evolution, adversarial benchmarking, and telemetry-driven benchmark generation
  • Lead the deprecation of saturated benchmarks and design their next-generation replacements — including procedurally-generated code evaluations that can't be memorized and adaptive testing systems that skip trivial questions for frontier models
  • Build GitHub's community benchmark submission program — enabling external researchers, enterprises, and open-source developers to contribute domain-specific evaluations — and publish GitHub's first external benchmark transparency reports showing how models perform on real developer workflows
  • Design and operationalize multi-tier evaluation frameworks — from fast automated regression suites and LLM-as-judge systems, through expert human evaluation, to production A/B testing — so teams can iterate in hours, not weeks
  • Design feedback-to-benchmark pipelines that convert thumbs-down signals, user frustrations, and support tickets into candidate regression tests — systematizing informal practices into scalable, automated systems
  • Establish evaluation as a first-class discipline across GitHub Copilot — creating the rituals, dashboards, and communication cadences that make evaluation results accessible and actionable for every team

Requirements

  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years

Nice to have

  • 5+ years of experience in technical program management, product management, applied science, or equivalent
  • 2+ years managing programs in machine learning, AI/ML evaluation, or data science
  • 2+ years managing cross-functional and/or cross-team projects
  • Deep, firsthand experience with AI/ML evaluation methodologies: benchmark design and validity, human evaluation frameworks, automated scoring systems (including LLM-as-judge), A/B testing, and statistical significance
  • Deep personal experience with AI coding tools — you use Copilot, Cursor, Claude Code, or similar tools daily and have strong opinions about what 'good' looks like from a developer's perspective
  • Understanding of software engineering workflows at scale — code review, CI/CD, testing, debugging, refactoring — and how AI tools should integrate into each
  • Experience with community or open-source program management — contributor programs, external research partnerships, or developer relations in a technical context
  • Proven ability to navigate competing priorities across teams and build shared commitment to common goals in ambiguous, fast-moving environments
  • Track record of building evaluation systems that directly influenced product or model shipping decisions at scale
Microsoft Corporation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal Technical Program Manager - Applied Science

8 matching positions

Principal Technical Program Manager - Applied Science

The OneDrive and SharePoint (ODSP) Applied Science team is driving high‑ambition...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Solid technical depth and comfort engaging with applied science, AI systems, experimentation, and evaluation
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Works in close partnership with Applied Science leadership and broader product leadership, including Engineering, Product Management, Design, and key partner organizations, to help shape and drive the applied science strategy across ODSP
  • Focus on advancing both high‑value scientific investments that deliver clear product and customer impact and high‑ambition efforts that push the frontier of applied AI, focused on knowledge work
  • Collaborate with leaders to inform portfolio‑level decisions spanning exploratory research, applied invention, and scaled product impact, helping surface tradeoffs, clarify priorities, and ensure different kinds of science are intentionally cultivated and sustained
  • Acting as a technical program manager for complex, science‑heavy initiatives, such as agentic systems, evaluation frameworks, knowledge retrieval, and content understanding, you will help define success in terms of scientific progress and learning, not just near‑term delivery
  • Support the translation of ambitious ideas into enduring capabilities, align teams on paths from concept to scale, and help build the narratives and mechanisms that allow bold science to consistently turn into durable impact
  • Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager (Quantum Hardware and Firmware Systems)

Microsoft Quantum team is dedicated to developing the first scalable, fault-tole...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in quantum information, physics, materials science, electrical engineering, hardware systems, engineering, or related technical fields OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
  • Citizenship & Citizenship Verification: This role will require access to information that is controlled for export under export control regulations, potentially under the U.S. International Traffic in Arms Regulations or Export Administration Regulations, the EU Dual Use Regulation, and/or other export control regulations. As a condition of employment, the successful candidate will be required to provide proof of citizenship, U.S. permanent residency, or other protected status (e.g., under 8 U.S.C. § 1324b(a)(3)) for assessment of eligibility to access the export-controlled information. To meet this legal requirement, and as a condition of employment, the successful candidate's citizenship will be verified with a valid passport. Lawful permanent residents, refugees, and asylees may verify status using other documents, where applicable.
  • Ability to leverage AI tools to drive innovation and efficiency (e.g., performance modeling and analysis, research gathering, day to day task automation).
  • Apply AI to accelerate engineering and lab workflows. Design and build AI agents/copilots that assist with experiment setup, log triage, measurement report generation, protocol templating, and knowledge retrieval (e.g., instrument manuals, design docs).
  • Evaluate agentic solutions with measurable metrics and humanintheloop safeguards following Microsoft Responsible AI requirements for generative AI.
  • 10+ years of experience owning and managing multi-year, highly complex hardware and firmware product portfolios involving deep-tech or first-of-a-kind technologies, including board bring-up, System-on-Chip (SoC) bring-up, BIOS and driver development, Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), quantum systems, advanced chip packaging, cryoelectronics, or other high-reliability hardware.
  • Experience managing firmware and hardware product development across the full lifecycle, including R&D, system integration, hardware-software integration, new-technology introduction, and technology transfer from R&D into scaled engineering and manufacturing, including hardware quality systems and development or auditing of test and validation protocols.
  • Experience with hands-on firmware, low-level systems, or advanced hardware R&D, including BIOS, drivers, embedded systems, quantum device development, quantum error correction, measurement/control systems, or similar advanced hardware domains.
Job Responsibility
Job Responsibility
  • Drive Program Execution: Lead comprehensive program management for pivotal quantum hardware initiatives. Oversee all phases, including concept development, engineering design, prototyping, validation, operational scaling, and ongoing delivery. Collaborate closely with system architects, research scientists, and hardware engineers to ensure successful outcomes for each project
  • Strategic Planning & Roadmapping: Work with program management leadership, engineering teams, and executive stakeholders to develop and maintain a clear roadmap for hardware platform advancement. Align technical milestones, allocate resources, manage schedules, and address risks to support Microsoft Quantum’s overarching long-term goals
  • Cross-Disciplinary Coordination: Facilitate collaboration and alignment among teams specializing in quantum device physics, cryoelectronics, materials science, hardware control, manufacturing, supply chain, integration, and cloud hardware operations. Ensure that integrated efforts result in reliable and scalable hardware solutions
  • Supplier & Partner Engagement: Manage relationships with external foundries, research laboratories, equipment vendors, and strategic partners. Foster cross-company collaboration, establish clear requirements, and ensure compliance with Microsoft’s standards for quality, safety, and data security
  • Risk Management: Identify, monitor, and mitigate technical, scheduling, and operational risks throughout program execution. Apply continuous improvement strategies and adjust programs in response to lessons learned and evolving technology trends
  • Agile Delivery: Oversee Agile program processes and ceremonies, promote transparency by conducting regular reviews and updates, and proactively remove obstacles to ensure timely achievement of critical deliverables
  • Customer Focus: Incorporate feedback from internal and pilot customers—including researchers, manufacturing partners, and Azure Quantum platform teams—to guide improvements in hardware and processes
  • Executive Communication: Develop concise, data-driven reports and executive updates that communicate program status, milestones, risks, dependencies, and impact, upholding Microsoft’s high standards for stakeholder engagement and reporting
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager (Quantum Hardware)

Microsoft Quantum team is dedicated to developing the first scalable, fault-tole...
Location
Location
United States , Redmond
Salary
Salary:
165600.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in quantum information, physics, materials science, electrical engineering, hardware systems, engineering, or related technical fields OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Citizenship & Citizenship Verification
  • Ability to leverage AI tools to drive innovation and efficiency
  • Apply AI to accelerate engineering and lab workflows
  • Evaluate agentic solutions with measurable metrics and human-in-the-loop safeguards
Job Responsibility
Job Responsibility
  • Drive Program Execution
  • Strategic Planning & Roadmapping
  • Cross-Disciplinary Coordination
  • Supplier & Partner Engagement
  • Risk Management
  • Agile Delivery
  • Customer Focus
  • Executive Communication
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager

At Microsoft Research (MSR), we are shaping the future of Artificial Intelligenc...
Location
Location
United States , Multiple Locations
Salary
Salary:
142800.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in computer engineering, electrical/electronic engineering, computer science, physics, applied physics, optics/photonics, materials science, or a related field AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
Job Responsibility
Job Responsibility
  • You will translate early-stage research from Microsoft Research and applied R&D into shippable cloud AI capabilities, shaping technical concepts into product roadmaps with researchers, driving execution with Azure engineering teams, and managing external hardware and software suppliers to land critical dependencies on time and on spec
  • You will partner with MSR researchers, Azure engineering teams, and external hardware and software vendors to design technical solutions that span models, systems, and hardware. You will surface the trade-offs and risks behind those choices and make data-driven recommendations to research and engineering leads, and supplier partners
  • You will define what success looks like for moving research prototypes to general availability, the technical bar, the launch criteria, and the cross-team commitments, and hold MSR, Azure, and supplier stakeholders aligned to it through every program milestone
  • You will own the program structure end-to-end: roadmap, schedule, staging and rollout plans, and governance for multi-team, multi-quarter efforts that cut across MSR, Azure, and the supplier ecosystem
  • You will close the loop from production back to research: validate use cases against live workloads, instrument performance and reliability metrics at cloud AI scale, and bring signal from customer engagements back to MSR and Azure teams to shape the next generation of platform investments
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager - Quantum

Microsoft Quantum team is dedicated to developing the first scalable, fault-tole...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in quantum information, physics, materials science, electrical engineering, hardware systems, engineering, or related technical fields OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Ability to leverage AI tools to drive innovation and efficiency
  • Apply AI to accelerate engineering and lab workflows
  • Citizenship verification requirement for export control compliance
Job Responsibility
Job Responsibility
  • Drive Program Execution: Lead comprehensive program management for pivotal quantum hardware initiatives
  • Strategic Planning & Roadmapping: Work with program management leadership, engineering teams, and executive stakeholders to develop and maintain a clear roadmap for hardware platform advancement
  • Cross-Disciplinary Coordination: Facilitate collaboration and alignment among teams specializing in quantum device physics, cryoelectronics, materials science, hardware control, manufacturing, supply chain, integration, and cloud hardware operations
  • Supplier & Partner Engagement: Manage relationships with external foundries, research laboratories, equipment vendors, and strategic partners
  • Risk Management: Identify, monitor, and mitigate technical, scheduling, and operational risks throughout program execution
  • Agile Delivery: Oversee Agile program processes and ceremonies
  • Customer Focus: Incorporate feedback from internal and pilot customers to guide improvements in hardware and processes
  • Executive Communication: Develop concise, data-driven reports and executive updates that communicate program status, milestones, risks, dependencies, and impact
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager

Do you enjoy meeting with customers to understand their needs and discuss the ar...
Location
Location
Australia , Brisbane
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree and 9+ years' experience in engineering, product development, or technical program management, or equivalent professional experience
  • Experience leading complex, cross-functional programs end to end, partnering with engineering, data science, and design from planning through execution
  • Experience engaging senior stakeholders, including external customers, with the ability to influence decisions in complex or strategic environments
  • Demonstrated leadership as a senior individual contributor, leading through influence and collaboration
  • Experience with AI/ML technologies, cloud architectures, or data engineering
  • Experience using AI tools and workflows in managing and creating software engineering artifacts
  • Willingness to travel up to 25% as required
  • Experience reading and/or writing code and influencing architecture decisions (e.g., sample documentation, product demos, ADR facilitation)
  • Experience with data analysis related to the management and process of program delivery
Job Responsibility
Job Responsibility
  • Own end-to-end customer engagements, from problem definition through production delivery and adoption
  • Provide direction and momentum in high-ambiguity environments, operating with a high degree of autonomy
  • Apply domain expertise to validate and govern AI-assisted solutions, ensuring quality and real-world impact
  • Drive a continuous flow of value to production, evolving delivery models beyond traditional, phase-based approaches
  • Shape Forward Deployed Engineering and AI-assisted engineering practices, influencing how teams engage customers and scale AI-powered delivery
  • Partner with Engineering, Data Science, Design, and SMEs to architect and deliver complex, multi-feature technical solutions
  • Define success metrics and delivery plans for highly complex, cross-functional initiatives, ensuring alignment across stakeholders
  • Enable continuous improvement through use-case validation, testing strategies, performance metrics, and direct customer engagement
  • Embodies our culture and values
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager

The Principal Technical Program Manager will be responsible for the planning and...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
siriusxm.com Logo
SiriusXM
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, engineering, or equivalent work experience
  • Minimum 10 years of deep TPM experience leading large scale technology initiatives within tight deadlines, across multiple cross-functional teams, and building consumer facing applications across a variety of platforms
  • Minimum 10 years experience managing engineering focused programs, building processes and coordinating release schedules
  • Minimum 10 years of program experience in commerce platform technologies (payment and billing, IAP, subscription management, offer management) and/or data and marketing related technologies
  • Minimum 5 years Atlassian (Jira) or similar tooling for managing product and engineering intake and fulfillment processes across large scale engineering initiatives
  • Excellent managerial skills and interpersonal skills
  • effectively communicate and collaborate with all areas of engineering, ability to interact and work with staff at all levels
  • Expert-level understanding of SDLC methodologies and hands-on experience with Scrum, Kanban, and Waterfall practices
  • Strong propensity towards relationship building
  • Experience working with multiple Agile methodologies
Job Responsibility
Job Responsibility
  • Ensure best practices and repeatable consistent processes for requirements definition, including the use of Jira to enable the traceability of tickets to our company roadmap, and the engagement with TPM-driven processes leading to engineering fulfillment
  • Guide the appropriate funneling of requirements to Engineering teams by driving collaborations across all functional product and stakeholder orgs, including Product teams, Business stakeholders (Finance, Legal, Marketing), and Business areas (Automotive, Content, Martech)
  • Contribute to executive-facing program reviews, utilizing Jira data, along with program insights, to create clear communication on health of product definition, technical executions, cross-team accountabilities and expectations
  • Regularly contribute to conversations with leads across all functions, including the executive leadership team
  • Manage and execute large-scale programs with a focus on improving deployment processes, project timelines, and delivery standards
  • Lead cross-functional communications, inclusive of change management and initiative status reporting
  • Provide escalation paths as appropriate, to identify risks, improve execution and remove barriers to execution
  • Create and maintain comprehensive domain roadmaps, ensuring alignment with organizational objectives and enhancing process efficiencies
  • Apply expert-level understanding of Software Development Lifecycle (SDLC) methodologies and best practices to deliver high-impact programs
  • Act as a technical knowledge repository, supporting engineering teams with precise and relevant information through a robust technical vocabulary
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager

The Microsoft AI Monetization team is responsible for driving innovative monetiz...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Bachelor's Degree AND 12+ years experience engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • Experience with Search and Ads ecosystems including search engines (Bing, Google), advertising platforms (Microsoft Advertising, Google Ads), ad serving systems, or related technologies
  • 8+ years of experience managing cross-functional and/or cross-team projects
  • 1+ year(s) of experience reading and/or writing code (e.g., sample documentation, product demos)
Job Responsibility
Job Responsibility
  • Own end-to-end execution of large-scale monetization programs, driving delivery against aggressive timelines and measurable business outcomes
  • Define execution strategy, milestones, and success metrics for complex technical programs across ad delivery, AI/ML-driven targeting and bidding, traffic optimization, whole-page monetization, and cross-platform user experiences
  • Orchestrate execution across multiple engineering, product, and partner teams, proactively managing dependencies, risks, and tradeoffs in highly matrixed environments
  • Establish solid operational rigor through clear review cadences, executive-level communication, and cross-team alignment to maintain velocity and quality at scale
  • Partner closely with Finance, Product, Engineering, Data Science, and Design to model revenue impact, track performance, and translate technical complexity into business-aligned outcomes
  • Lead data-driven experimentation and analysis to validate monetization hypotheses, measure incremental impact, and inform prioritization across initiatives
  • Apply deep understanding of the Search and Ads ecosystem—including SERP rendering, ad marketplaces, ranking systems, and monetization infrastructure—to guide technical and product decisions
  • Influence senior stakeholders across Bing, Microsoft Advertising, AI Platform, and partner organizations to drive alignment, unblock decisions, and deliver cohesive solutions
  • Fulltime
Read More
Arrow Right