CrawlJobs Logo

Principal Technical Program Manager - Applied Science

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

139900.00 - 274800.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

The Applied Science team for GitHub Copilot sits at the intersection of frontier AI research and the world's largest developer platform. We ship AI-powered experiences (ex: code completion, code review, coding agents) used by millions of professional developers every day. As a member of the team, you will help lead GitHub Copilot's AI evaluation strategy end-to-end — from benchmark design and lifecycle governance, through evaluation infrastructure and internal adoption, to community engagement and public transparency. You are the person who ensures that every model swap, product harness, and feature launch is measured against what actually matters to developers — and that the world can see the results.

Job Responsibility:

  • Partner with Applied Science researchers to translate cutting-edge evaluation research into production systems: adaptive testing (IRT), agent-centric co-evolution, adversarial benchmarking, and telemetry-driven benchmark generation
  • Lead the deprecation of saturated benchmarks and design their next-generation replacements — including procedurally-generated code evaluations that can't be memorized and adaptive testing systems that skip trivial questions for frontier models
  • Build GitHub's community benchmark submission program — enabling external researchers, enterprises, and open-source developers to contribute domain-specific evaluations — and publish GitHub's first external benchmark transparency reports showing how models perform on real developer workflows
  • Design and operationalize multi-tier evaluation frameworks — from fast automated regression suites and LLM-as-judge systems, through expert human evaluation, to production A/B testing — so teams can iterate in hours, not weeks
  • Design feedback-to-benchmark pipelines that convert thumbs-down signals, user frustrations, and support tickets into candidate regression tests — systematizing informal practices into scalable, automated systems
  • Establish evaluation as a first-class discipline across GitHub Copilot — creating the rituals, dashboards, and communication cadences that make evaluation results accessible and actionable for every team

Requirements:

  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years

Nice to have:

  • 5+ years of experience in technical program management, product management, applied science, or equivalent
  • 2+ years managing programs in machine learning, AI/ML evaluation, or data science
  • 2+ years managing cross-functional and/or cross-team projects
  • Deep, firsthand experience with AI/ML evaluation methodologies: benchmark design and validity, human evaluation frameworks, automated scoring systems (including LLM-as-judge), A/B testing, and statistical significance
  • Deep personal experience with AI coding tools — you use Copilot, Cursor, Claude Code, or similar tools daily and have strong opinions about what 'good' looks like from a developer's perspective
  • Understanding of software engineering workflows at scale — code review, CI/CD, testing, debugging, refactoring — and how AI tools should integrate into each
  • Experience with community or open-source program management — contributor programs, external research partnerships, or developer relations in a technical context
  • Proven ability to navigate competing priorities across teams and build shared commitment to common goals in ambiguous, fast-moving environments
  • Track record of building evaluation systems that directly influenced product or model shipping decisions at scale

Additional Information:

Job Posted:
May 04, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
Microsoft Corporation - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Technical Program Manager - Applied Science

Principal Technical Program Manager - Applied Science

The OneDrive and SharePoint (ODSP) Applied Science team is driving high‑ambition...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Solid technical depth and comfort engaging with applied science, AI systems, experimentation, and evaluation
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Works in close partnership with Applied Science leadership and broader product leadership, including Engineering, Product Management, Design, and key partner organizations, to help shape and drive the applied science strategy across ODSP
  • Focus on advancing both high‑value scientific investments that deliver clear product and customer impact and high‑ambition efforts that push the frontier of applied AI, focused on knowledge work
  • Collaborate with leaders to inform portfolio‑level decisions spanning exploratory research, applied invention, and scaled product impact, helping surface tradeoffs, clarify priorities, and ensure different kinds of science are intentionally cultivated and sustained
  • Acting as a technical program manager for complex, science‑heavy initiatives, such as agentic systems, evaluation frameworks, knowledge retrieval, and content understanding, you will help define success in terms of scientific progress and learning, not just near‑term delivery
  • Support the translation of ambitious ideas into enduring capabilities, align teams on paths from concept to scale, and help build the narratives and mechanisms that allow bold science to consistently turn into durable impact
  • Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

Principal Program Manager

At Cloudera, we empower people to transform complex data into clear and actionab...
Location
Location
Hungary , Budapest
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, computer engineering, or related field, or equivalent experience
  • 10+ years of experience in a technical lead, systems engineer, or technical program management role with experience architecting and integrating software into complex systems and deploying solutions to the field
  • 7+ years of experience leading cross-functional teams delivering products on schedule
  • Strong communication skills with the ability to disseminate (verbally and in writing) clear updates to different audiences, both technical and non-technical
  • Demonstrated ability to lead interdisciplinary discussions between product and R&D teams to define and drive scope and clarity of work, and reach optimum system level trades
  • Proficiency with at least one schedule tracking tool such as Asana, Excel, or JIRA/Confluence etc.
Job Responsibility
Job Responsibility
  • Lead and coordinate triage activities for product pillar initiatives in partnership with cross-functional Product, Engineering, and UX teams
  • Collaborate closely with Product Managers to ensure that business case data is complete, accurate, and provided by the appropriate stakeholders and requestors
  • Deliver complex, multi-year, multi-team product or platform objectives with a high standard of judgment, innovation, and execution
  • Drive end-to-end delivery and execution of qualified product pillar initiatives by managing timelines, dependencies, risks, and deliverables across multiple teams
  • Provide clear, consistent, and proactive communication of initiative status, risks, and progress to stakeholders and leadership
  • Apply a proven set of program management skills and sophisticated delivery approaches tailored to the unique needs and complexity of each program
  • Own and execute Engineering product releases through full-cycle program management
  • Lead, mentor, and guide junior Program Managers in managing initiatives and executing full-cycle program management activities.
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Principal Program Manager

The Program Management Office (PMO) at Cloudera is responsible for establishing ...
Location
Location
Hungary , Budapest
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, computer engineering, or related field, or equivalent experience
  • 10+ years of experience in a technical lead, systems engineer, or technical program management role with experience architecting and integrating software into complex systems and deploying solutions to the field
  • 7+ years of experience leading cross-functional teams delivering products on schedule
  • Strong communication skills with the ability to disseminate (verbally and in writing) clear updates to different audiences, both technical and non-technical
  • Demonstrated ability to lead interdisciplinary discussions between product and R&D teams to define and drive scope and clarity of work, and reach optimum system level trades
  • Proficiency with at least one schedule tracking tool such as Asana, Excel, or JIRA/Confluence etc.
Job Responsibility
Job Responsibility
  • Lead and coordinate triage activities for product pillar initiatives in partnership with cross-functional Product, Engineering, and UX teams
  • Collaborate closely with Product Managers to ensure that business case data is complete, accurate, and provided by the appropriate stakeholders and requestors
  • Deliver complex, multi-year, multi-team product or platform objectives with a high standard of judgment, innovation, and execution
  • Drive end-to-end delivery and execution of qualified product pillar initiatives by managing timelines, dependencies, risks, and deliverables across multiple teams
  • Provide clear, consistent, and proactive communication of initiative status, risks, and progress to stakeholders and leadership
  • Apply a proven set of program management skills and sophisticated delivery approaches tailored to the unique needs and complexity of each program
  • Own and execute Engineering product releases through full-cycle program management
  • Lead, mentor, and guide junior Program Managers in managing initiatives and executing full-cycle program management activities.
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Director of Engineering

The Director of Engineering is the senior technical execution leader responsible...
Location
Location
United States , Aberdeen Proving Ground
Salary
Salary:
Not provided
VES
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Engineering, Computer Science, or a related technical field (Master's degree preferred)
  • 15+ years of engineering experience, including significant hands-on technical responsibility for complex systems
  • 7+ years in senior technical leadership roles, such as Principal Engineer, Chief Engineer, Lead Architect, or equivalent
  • Demonstrated ability to independently solve complex, cross-domain technical problems involving software, systems, infrastructure, and security
  • Strong understanding of software engineering, systems engineering, integration practices, and modern deployment environments
  • Experience implementing and enforcing SDLC, configuration management, and quality standards
  • Experience working in a government contracting or regulated environment, including DoD or Federal programs
  • Ability to communicate complex technical concepts clearly to engineers, program leadership, executives, and customers
  • Excellent written and oral communication skills with respect to the above requirements
  • Ability to obtain and maintain a U.S. Government security clearance
Job Responsibility
Job Responsibility
  • Lead and oversee engineering execution across multiple concurrent programs, ensuring solutions meet cost, schedule, performance, quality, and architectural expectations
  • Serve as the primary technical execution lead across the organization, with authority to make technical decisions necessary to unblock delivery and resolve engineering challenges
  • Act as the first escalation point for complex technical problems, integration failures, and cross-program dependencies, independently driving solutions for the majority of issues before CTO involvement is required
  • Apply deep systems-level technical judgment to diagnose, frame, and resolve difficult engineering problems spanning software, systems, infrastructure, deployment, and security
  • Ensure engineering decisions made under delivery pressure preserve long-term system maintainability, reliability, and scalability
  • Develop and maintain a deep understanding of VES engineering processes, standards, and technical expectations, and ensure they are applied consistently across programs
  • Partner with Principal Engineers to review and approve system architectures, technical approaches, and major design decisions
  • Ensure architectural consistency and technical coherence across programs while allowing appropriate flexibility to meet mission and customer needs
  • Identify systemic technical issues, recurring failure modes, and architectural debt across the portfolio and drive corrective action
  • Work closely with Principal Engineers (Mission Command, Land Systems, Emerging Technologies, Cyber Security, Systems Engineering) as domain technical authorities
What we offer
What we offer
  • 401(k) match
  • Highly Competitive Salary
  • Up to 15 Paid Vacation days / year
  • 11 Paid Holidays
  • Flexible work/life balance culture
  • Fulltime
Read More
Arrow Right
New

Principal Technical Program Manager

Do you enjoy meeting with customers to understand their needs and discuss the ar...
Location
Location
Australia , Brisbane
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree and 9+ years' experience in engineering, product development, or technical program management, or equivalent professional experience
  • Experience leading complex, cross-functional programs end to end, partnering with engineering, data science, and design from planning through execution
  • Experience engaging senior stakeholders, including external customers, with the ability to influence decisions in complex or strategic environments
  • Demonstrated leadership as a senior individual contributor, leading through influence and collaboration
  • Experience with AI/ML technologies, cloud architectures, or data engineering
  • Experience using AI tools and workflows in managing and creating software engineering artifacts
  • Willingness to travel up to 25% as required
  • Experience reading and/or writing code and influencing architecture decisions (e.g., sample documentation, product demos, ADR facilitation)
  • Experience with data analysis related to the management and process of program delivery
Job Responsibility
Job Responsibility
  • Own end-to-end customer engagements, from problem definition through production delivery and adoption
  • Provide direction and momentum in high-ambiguity environments, operating with a high degree of autonomy
  • Apply domain expertise to validate and govern AI-assisted solutions, ensuring quality and real-world impact
  • Drive a continuous flow of value to production, evolving delivery models beyond traditional, phase-based approaches
  • Shape Forward Deployed Engineering and AI-assisted engineering practices, influencing how teams engage customers and scale AI-powered delivery
  • Partner with Engineering, Data Science, Design, and SMEs to architect and deliver complex, multi-feature technical solutions
  • Define success metrics and delivery plans for highly complex, cross-functional initiatives, ensuring alignment across stakeholders
  • Enable continuous improvement through use-case validation, testing strategies, performance metrics, and direct customer engagement
  • Embodies our culture and values
  • Fulltime
Read More
Arrow Right

Principal Hardware Technical Program Manager - Quantum

Microsoft Quantum team is dedicated to developing the first scalable, fault-tole...
Location
Location
Germany , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND proven experience in engineering, physics or a related STEM field, product/technical program management, data analysis, or product development OR equivalent experience.
  • Demonstrated experience managing large-scale, interdisciplinary hardware technology projects from concept to delivery, including system integration, cross-functional team leadership, and coordination across multiple teams.
  • Deep knowledge of hardware product development lifecycle, with demonstrated ability to oversee complex programs involving R&D and new technology introduction.
  • Proficiency in program management methodologies, including Agile, Azure DevOps, or similar frameworks.
  • Proven data-driven decision making, issue tracking, schedule management, and reporting skills.
  • Demonstrated ability to communicate complex technical concepts clearly and appropriately at all organization levels, including executive audiences and non-technical stakeholders, and to work effectively in a highly collaborative, fast-paced, and ambiguous environment.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
  • Ability to work in an “AI-first” environment using modern AI tools to accelerate discovery through both hardware and software development.
  • Ability to design and build AI agents/copilots that assist with experiment setup, log triage, measurement report generation, protocol templating, and knowledge retrieval.
Job Responsibility
Job Responsibility
  • Program Management: Lead all phases of quantum hardware projects, from concept to delivery, working closely with architects, scientists, and engineers for success. Create concise, data-driven updates on program status, risks, dependencies, and impact for stakeholders and senior executives.
  • Planning & Roadmapping: Coordinate with leadership and engineering teams to build and maintain clear development roadmaps, align milestones, manage resources, and support long-term goals. Guide Agile processes, encourage transparency, and remove obstacles to meet critical deadlines.
  • Team Coordination: Ensure effective collaboration across device physics, cryoelectronic, materials science, manufacturing, supply chain, integration, and cloud hardware operations for scalable solutions.
  • Customer Feedback: Use input from internal and pilot customers to improve hardware and processes. This includes potential customers from US Government.
  • Risk Mitigation: Identify and reduce risks in technology, scheduling, and operations, applying continuous improvement throughout.
  • Supplier Relations: Manage external partnerships, enforce quality and safety standards, and drive cross-company compliance.
  • Culture & Mentorship: Foster respect, collaboration, integrity, inclusivity, and continuous learning within the team.
  • Other: Embody our Culture and Values.
  • Fulltime
Read More
Arrow Right
New

Principal Technical Program Manager (Quantum Hardware and Firmware Systems)

Microsoft Quantum team is dedicated to developing the first scalable, fault-tole...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in quantum information, physics, materials science, electrical engineering, hardware systems, engineering, or related technical fields OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
  • Citizenship & Citizenship Verification: This role will require access to information that is controlled for export under export control regulations, potentially under the U.S. International Traffic in Arms Regulations or Export Administration Regulations, the EU Dual Use Regulation, and/or other export control regulations. As a condition of employment, the successful candidate will be required to provide proof of citizenship, U.S. permanent residency, or other protected status (e.g., under 8 U.S.C. § 1324b(a)(3)) for assessment of eligibility to access the export-controlled information. To meet this legal requirement, and as a condition of employment, the successful candidate's citizenship will be verified with a valid passport. Lawful permanent residents, refugees, and asylees may verify status using other documents, where applicable.
  • Ability to leverage AI tools to drive innovation and efficiency (e.g., performance modeling and analysis, research gathering, day to day task automation).
  • Apply AI to accelerate engineering and lab workflows. Design and build AI agents/copilots that assist with experiment setup, log triage, measurement report generation, protocol templating, and knowledge retrieval (e.g., instrument manuals, design docs).
  • Evaluate agentic solutions with measurable metrics and humanintheloop safeguards following Microsoft Responsible AI requirements for generative AI.
  • 10+ years of experience owning and managing multi-year, highly complex hardware and firmware product portfolios involving deep-tech or first-of-a-kind technologies, including board bring-up, System-on-Chip (SoC) bring-up, BIOS and driver development, Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), quantum systems, advanced chip packaging, cryoelectronics, or other high-reliability hardware.
  • Experience managing firmware and hardware product development across the full lifecycle, including R&D, system integration, hardware-software integration, new-technology introduction, and technology transfer from R&D into scaled engineering and manufacturing, including hardware quality systems and development or auditing of test and validation protocols.
  • Experience with hands-on firmware, low-level systems, or advanced hardware R&D, including BIOS, drivers, embedded systems, quantum device development, quantum error correction, measurement/control systems, or similar advanced hardware domains.
Job Responsibility
Job Responsibility
  • Drive Program Execution: Lead comprehensive program management for pivotal quantum hardware initiatives. Oversee all phases, including concept development, engineering design, prototyping, validation, operational scaling, and ongoing delivery. Collaborate closely with system architects, research scientists, and hardware engineers to ensure successful outcomes for each project
  • Strategic Planning & Roadmapping: Work with program management leadership, engineering teams, and executive stakeholders to develop and maintain a clear roadmap for hardware platform advancement. Align technical milestones, allocate resources, manage schedules, and address risks to support Microsoft Quantum’s overarching long-term goals
  • Cross-Disciplinary Coordination: Facilitate collaboration and alignment among teams specializing in quantum device physics, cryoelectronics, materials science, hardware control, manufacturing, supply chain, integration, and cloud hardware operations. Ensure that integrated efforts result in reliable and scalable hardware solutions
  • Supplier & Partner Engagement: Manage relationships with external foundries, research laboratories, equipment vendors, and strategic partners. Foster cross-company collaboration, establish clear requirements, and ensure compliance with Microsoft’s standards for quality, safety, and data security
  • Risk Management: Identify, monitor, and mitigate technical, scheduling, and operational risks throughout program execution. Apply continuous improvement strategies and adjust programs in response to lessons learned and evolving technology trends
  • Agile Delivery: Oversee Agile program processes and ceremonies, promote transparency by conducting regular reviews and updates, and proactively remove obstacles to ensure timely achievement of critical deliverables
  • Customer Focus: Incorporate feedback from internal and pilot customers—including researchers, manufacturing partners, and Azure Quantum platform teams—to guide improvements in hardware and processes
  • Executive Communication: Develop concise, data-driven reports and executive updates that communicate program status, milestones, risks, dependencies, and impact, upholding Microsoft’s high standards for stakeholder engagement and reporting
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager

The Microsoft AI Monetization team is responsible for driving innovative monetiz...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Bachelor's Degree AND 12+ years experience engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • Experience with Search and Ads ecosystems including search engines (Bing, Google), advertising platforms (Microsoft Advertising, Google Ads), ad serving systems, or related technologies
  • 8+ years of experience managing cross-functional and/or cross-team projects
  • 1+ year(s) of experience reading and/or writing code (e.g., sample documentation, product demos)
Job Responsibility
Job Responsibility
  • Own end-to-end execution of large-scale monetization programs, driving delivery against aggressive timelines and measurable business outcomes
  • Define execution strategy, milestones, and success metrics for complex technical programs across ad delivery, AI/ML-driven targeting and bidding, traffic optimization, whole-page monetization, and cross-platform user experiences
  • Orchestrate execution across multiple engineering, product, and partner teams, proactively managing dependencies, risks, and tradeoffs in highly matrixed environments
  • Establish solid operational rigor through clear review cadences, executive-level communication, and cross-team alignment to maintain velocity and quality at scale
  • Partner closely with Finance, Product, Engineering, Data Science, and Design to model revenue impact, track performance, and translate technical complexity into business-aligned outcomes
  • Lead data-driven experimentation and analysis to validate monetization hypotheses, measure incremental impact, and inform prioritization across initiatives
  • Apply deep understanding of the Search and Ads ecosystem—including SERP rendering, ad marketplaces, ranking systems, and monetization infrastructure—to guide technical and product decisions
  • Influence senior stakeholders across Bing, Microsoft Advertising, AI Platform, and partner organizations to drive alignment, unblock decisions, and deliver cohesive solutions
  • Fulltime
Read More
Arrow Right