CrawlJobs Logo

Principal AI Safety Program Manager

United States, Redmond 139900.00 - 274800.00 USD / Year · Job Posted February 04, 2026
Apply Position
Job Link Share

Job Description

We are looking for a Principal AI Safety Program Manager to join us and to create strategies on improving our approach to AI Security & Safety to deliver on that promise. We are the Artificial Generative Intelligence Security (AeGIS) team, and we are charged with ensuring justified confidence in the safety of Microsoft’s generative AI products. This encompasses providing an infrastructure for AI safety & security; serving as a coordination point for all things AI incident response; researching the quickly evolving threat landscape; red teaming AI systems for failures; and empowering Microsoft with this knowledge. We partner closely with product engineering teams to mitigate and address the full range of threats that face AI services – from traditional security risks to novel security threats like indirect prompt injection and entirely AI-native threats like the manufacture of NCII or the use of AI to run automated scams.

Job Responsibility

  • Designing methodologies for teams to build safely and effectively, with a clear eye towards those being directly useful and applicable by real teams
  • Partnering with AI creation platforms that target non-pro AI builders to incorporate methodologies that allow non-pro AI builders to understand the risks of what their building and empowering them to make informed risk tradeoffs
  • Ideating and prototyping tools that help both pro- and non-pro AI builders understand the risks of what they’re building throughout its development – from ideation to deployment
  • Work with our education and training team to develop content in a range of formats (presentations, interactive workshops, labs and whitepapers) to bring the knowledge of how to build AI safety and securely to a wide audience
  • Build collaborative relationships with other stakeholder teams working on Responsible AI to scale out AI Safety methodologies
  • Build collaborative relationships with other security teams to scale out AI security methodologies
  • Help define new policies and procedures (or changes to existing ones) that ensure that customers can have justified trust in Microsoft’s AI services
  • Embody our Culture and Values

Requirements

  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Candidates must be able to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have

  • Bachelor's Degree AND 12+ years experience engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 8+ years of experience managing cross-functional and/or cross-team projects
  • 1+ year(s) of experience reading and/or writing code (e.g., sample documentation, product demos)
  • 5+ years product experience in any of the safety disciplines in computer science (abuse, security, privacy, etc)
  • 5+ years experience in assessing systems for practical security, privacy, or safety flaws and helping teams mitigate identified risks
  • 3+ years experience with a socio-technical safety space (e.g. online safety, privacy)
  • 2+ years experience using AI to build tools and/or agents AND 1+ year(s) of experience reading and/or writing code (e.g., sample documentation, product demos)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal AI Safety Program Manager

8 matching positions

Principal AI Safety Engineer for Autonomous Vehicles Technical Lead

The AV Safety Strategy and Assessment team is seeking an AI Safety Technical Lea...
Location
Location
United States
Salary
Salary:
250600.00 - 384600.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Electrical Engineering, Mathematics, Physics, or a related field
  • or equivalent practical experience
  • 10+ years of experience in AI/ML, engineering or a related field
  • 5+ years in autonomous vehicles, robotics or related field
  • Experience in Machine Learning & AI: Extensive experience in building large-scale models with significant focus on E2E validation. Experience using Large Language Models (LLMs), Generative AI, RAG, Deep learning, Reinforcement Learning, Natural Language Processing (NLP), SVM, XGBoost, Random Forest, Decision Trees, Clustering
  • AI Standards and Evolving Regulations: Understanding of ISO/PAS 8800, NIST AI Risk Management Framework, EU AI Act (2024-2027), other applicable industry standards and best practices for autonomous vehicles, aerospace and/or robotics.
  • Programming & Frameworks : Python, R, Java, PySpark, PyTorch, TensorFlow, Scikit-learn, LangChain, SQL
  • Cloud & Big Data Platforms: ( Preferred Microsoft Azure - Data Lake, Machine Learning, Databricks)
  • Deployment & MLOps: MLflow, Model Monitoring & Versioning, Docker & Kubernetes, GitHub, Jira
  • Data Analysis & Visualization : Tableau, PowerBI, Pandas, NumPy
Job Responsibility
Job Responsibility
  • Lead the development of AI safety strategies for ADS and establish safety engineering guidance and sufficiency criteria.
  • Actively engage with partners and seek input, provide technical expertise to inform leadership decision-making, and take ownership of technical projects
  • Define GM’s strategy for AI safety standards, engage externally to influence evolving standards, and contribute to internal and external thought leadership that strengthens GM’s position in the autonomous vehicle ecosystem.
  • Support regulatory rulemaking and policy responses related to AI safety-critical systems.
  • Establish an assurance plan and process to evaluate AI-related safety case evidence and verify that sufficiency criteria are met.
  • Provide AI expertise and safety guidance across Global Product Safety, Systems, and Certification activities.
  • Identify and drive opportunities to improve the efficiency and quality of safety work through the application of AI methodologies.
  • Mentor and develop team members, fostering a culture of technical excellence and continuous learning.
What we offer
What we offer
  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • tuition assistance programs
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager (Quantum)

At Microsoft Quantum, we aim to empower science and scientists to solve the worl...
Location
Location
Denmark , Kongens Lyngby
Salary
Salary:
912400.00 - 1559800.00 DKK / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Doctorate in Physics, Engineering, or related field AND experience in hardware development, technical program management, quantum physics (or related field)
  • OR Master's Degree in Physics, Engineering, or related field AND significant experience in hardware development, technical program management, quantum physics (or related field)
  • Demonstrated experience driving complex, cross-functional programs with multiple stakeholders and dependencies across organizational boundaries
  • Technical depth in advanced hardware or experimental systems, such as device development, semiconductor manufacturing, measurement and control systems, or related quantum or semiconductor domains
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
  • Citizenship & Citizenship Verification: This role will require access to information that is controlled for export under export control regulations
  • Ability to leverage AI tools to drive innovation and efficiency
  • Ability to work in an AI-first environment using modern AI tools to accelerate discovery through hardware development
Job Responsibility
Job Responsibility
  • Drive Program Execution & Delivery: Lead end-to-end execution of complex hardware development programs, ensuring clear milestones, dependency management, and disciplined, predictable delivery across the 1P Quantum stack—while proactively identifying and mitigating technical and program risks
  • Strategic Planning & Roadmapping: Define and drive program strategy and roadmaps across the 1P Quantum stack, setting direction, priorities, and success criteria in partnership with technical leadership to guide the transition from research to scalable, production-ready systems
  • Cross-Disciplinary Coordination & Alignment: Facilitate collaboration across quantum physicists, device engineers, process development engineers, systems engineering, and partners—bringing clarity to complex spaces and driving alignment across stakeholders and leadership to enable reliable, scalable hardware solutions
  • Supplier & Partner Management: Build and manage relationships with external partners and suppliers, including advanced fabrication and manufacturing partners, aligning on technical direction, requirements, execution plans, and delivery commitments—while ensuring compliance with Microsoft standards for quality, safety, and data security
  • AI-Driven Development Acceleration: Identify and drive opportunities to leverage AI, machine learning, and automation to optimize engineering workflows, improve decision-making, and increase development velocity across the hardware stack
  • Data, Quality & Yield Excellence: Drive a data-informed approach to program and engineering execution, and lead systemic improvements in quality, yield, and reliability by scaling industry best practices e.g., root cause analysis, statistical methods, yield optimization, enabling efficient scale-up from development to manufacturing
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager (Quantum Hardware and Firmware Systems)

Microsoft Quantum team is dedicated to developing the first scalable, fault-tole...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in quantum information, physics, materials science, electrical engineering, hardware systems, engineering, or related technical fields OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
  • Citizenship & Citizenship Verification: This role will require access to information that is controlled for export under export control regulations, potentially under the U.S. International Traffic in Arms Regulations or Export Administration Regulations, the EU Dual Use Regulation, and/or other export control regulations. As a condition of employment, the successful candidate will be required to provide proof of citizenship, U.S. permanent residency, or other protected status (e.g., under 8 U.S.C. § 1324b(a)(3)) for assessment of eligibility to access the export-controlled information. To meet this legal requirement, and as a condition of employment, the successful candidate's citizenship will be verified with a valid passport. Lawful permanent residents, refugees, and asylees may verify status using other documents, where applicable.
  • Ability to leverage AI tools to drive innovation and efficiency (e.g., performance modeling and analysis, research gathering, day to day task automation).
  • Apply AI to accelerate engineering and lab workflows. Design and build AI agents/copilots that assist with experiment setup, log triage, measurement report generation, protocol templating, and knowledge retrieval (e.g., instrument manuals, design docs).
  • Evaluate agentic solutions with measurable metrics and humanintheloop safeguards following Microsoft Responsible AI requirements for generative AI.
  • 10+ years of experience owning and managing multi-year, highly complex hardware and firmware product portfolios involving deep-tech or first-of-a-kind technologies, including board bring-up, System-on-Chip (SoC) bring-up, BIOS and driver development, Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), quantum systems, advanced chip packaging, cryoelectronics, or other high-reliability hardware.
  • Experience managing firmware and hardware product development across the full lifecycle, including R&D, system integration, hardware-software integration, new-technology introduction, and technology transfer from R&D into scaled engineering and manufacturing, including hardware quality systems and development or auditing of test and validation protocols.
  • Experience with hands-on firmware, low-level systems, or advanced hardware R&D, including BIOS, drivers, embedded systems, quantum device development, quantum error correction, measurement/control systems, or similar advanced hardware domains.
Job Responsibility
Job Responsibility
  • Drive Program Execution: Lead comprehensive program management for pivotal quantum hardware initiatives. Oversee all phases, including concept development, engineering design, prototyping, validation, operational scaling, and ongoing delivery. Collaborate closely with system architects, research scientists, and hardware engineers to ensure successful outcomes for each project
  • Strategic Planning & Roadmapping: Work with program management leadership, engineering teams, and executive stakeholders to develop and maintain a clear roadmap for hardware platform advancement. Align technical milestones, allocate resources, manage schedules, and address risks to support Microsoft Quantum’s overarching long-term goals
  • Cross-Disciplinary Coordination: Facilitate collaboration and alignment among teams specializing in quantum device physics, cryoelectronics, materials science, hardware control, manufacturing, supply chain, integration, and cloud hardware operations. Ensure that integrated efforts result in reliable and scalable hardware solutions
  • Supplier & Partner Engagement: Manage relationships with external foundries, research laboratories, equipment vendors, and strategic partners. Foster cross-company collaboration, establish clear requirements, and ensure compliance with Microsoft’s standards for quality, safety, and data security
  • Risk Management: Identify, monitor, and mitigate technical, scheduling, and operational risks throughout program execution. Apply continuous improvement strategies and adjust programs in response to lessons learned and evolving technology trends
  • Agile Delivery: Oversee Agile program processes and ceremonies, promote transparency by conducting regular reviews and updates, and proactively remove obstacles to ensure timely achievement of critical deliverables
  • Customer Focus: Incorporate feedback from internal and pilot customers—including researchers, manufacturing partners, and Azure Quantum platform teams—to guide improvements in hardware and processes
  • Executive Communication: Develop concise, data-driven reports and executive updates that communicate program status, milestones, risks, dependencies, and impact, upholding Microsoft’s high standards for stakeholder engagement and reporting
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager

The Office of the Chief Technology Officer (OCTO) for Microsoft is chartered wit...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Lead Microsoft-wide RAI initiatives that establish durable safety, compliance, and governance practices across engineering, product, and research organizations
  • Define long‑range technical strategy and architectural direction for RAI platforms, tools, and processes, partnering with architects, safety experts, and product leadership
  • Influence senior stakeholders across multiple organizations to align on safety requirements, evaluation frameworks, and regulatory readiness
  • Translate complex and emerging safety, regulatory, and policy requirements into scalable technical guidance, decision frameworks, and prioritized engineering workstreams
  • Shape and steward architectural decisions for safety review pipelines, evaluation and measurement systems, and other core RAI capabilities
  • Navigate ambiguous problem spaces, drive clarity, and guide leaders through risk tradeoffs and decision‑making
  • Represent OCTO across Microsoft and externally, helping articulate Microsoft’s RAI strategy and influencing industry direction
  • Drive execution at scale across diverse engineering teams, anticipating blockers and shaping cross‑functional solutions
  • Mentor and elevate Technical Program Manager peers, strengthening technical excellence and fostering a culture of responsible innovation that reflects our Culture and Values
  • Fulltime
Read More
Arrow Right

Principal Hardware Technical Program Manager - Quantum

Microsoft Quantum team is dedicated to developing the first scalable, fault-tole...
Location
Location
Germany , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND proven experience in engineering, physics or a related STEM field, product/technical program management, data analysis, or product development OR equivalent experience.
  • Demonstrated experience managing large-scale, interdisciplinary hardware technology projects from concept to delivery, including system integration, cross-functional team leadership, and coordination across multiple teams.
  • Deep knowledge of hardware product development lifecycle, with demonstrated ability to oversee complex programs involving R&D and new technology introduction.
  • Proficiency in program management methodologies, including Agile, Azure DevOps, or similar frameworks.
  • Proven data-driven decision making, issue tracking, schedule management, and reporting skills.
  • Demonstrated ability to communicate complex technical concepts clearly and appropriately at all organization levels, including executive audiences and non-technical stakeholders, and to work effectively in a highly collaborative, fast-paced, and ambiguous environment.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
  • Ability to work in an “AI-first” environment using modern AI tools to accelerate discovery through both hardware and software development.
  • Ability to design and build AI agents/copilots that assist with experiment setup, log triage, measurement report generation, protocol templating, and knowledge retrieval.
Job Responsibility
Job Responsibility
  • Program Management: Lead all phases of quantum hardware projects, from concept to delivery, working closely with architects, scientists, and engineers for success. Create concise, data-driven updates on program status, risks, dependencies, and impact for stakeholders and senior executives.
  • Planning & Roadmapping: Coordinate with leadership and engineering teams to build and maintain clear development roadmaps, align milestones, manage resources, and support long-term goals. Guide Agile processes, encourage transparency, and remove obstacles to meet critical deadlines.
  • Team Coordination: Ensure effective collaboration across device physics, cryoelectronic, materials science, manufacturing, supply chain, integration, and cloud hardware operations for scalable solutions.
  • Customer Feedback: Use input from internal and pilot customers to improve hardware and processes. This includes potential customers from US Government.
  • Risk Mitigation: Identify and reduce risks in technology, scheduling, and operations, applying continuous improvement throughout.
  • Supplier Relations: Manage external partnerships, enforce quality and safety standards, and drive cross-company compliance.
  • Culture & Mentorship: Foster respect, collaboration, integrity, inclusivity, and continuous learning within the team.
  • Other: Embody our Culture and Values.
  • Fulltime
Read More
Arrow Right

Principal Hardware Technical Program Manager - Quantum

Microsoft Quantum team is dedicated to developing the first scalable, fault-tole...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in engineering, physics or a related STEM field, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • 3+ years of experience managing large-scale, interdisciplinary hardware technology projects from concept to delivery, including system integration, cross-functional team leadership, and coordination across multiple teams
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Ability to apply AI to accelerate engineering and lab workflows
  • Ability to evaluate agentic solutions with measurable metrics and humanintheloop safeguards following Microsoft Responsible AI requirements for generative AI
Job Responsibility
Job Responsibility
  • Program Management: Lead all phases of quantum hardware projects, from concept to delivery, working closely with architects, scientists, and engineers for success
  • Create concise, data-driven updates on program status, risks, dependencies, and impact for stakeholders and senior executives
  • Planning & Roadmapping: Coordinate with leadership and engineering teams to build and maintain clear development roadmaps, align milestones, manage resources, and support long-term goals
  • Guide Agile processes, encourage transparency, and remove obstacles to meet critical deadlines
  • Team Coordination: Ensure effective collaboration across device physics, cryoelectronic, materials science, manufacturing, supply chain, integration, and cloud hardware operations for scalable solutions
  • Customer Feedback: Use input from internal and pilot customers to improve hardware and processes
  • This includes potential customers from US Government
  • Risk Mitigation: Identify and reduce risks in technology, scheduling, and operations, applying continuous improvement throughout
  • Supplier Relations: Manage external partnerships, enforce quality and safety standards, and drive cross-company compliance
  • Culture & Mentorship: Foster respect, collaboration, integrity, inclusivity, and continuous learning within the team
  • Fulltime
Read More
Arrow Right

Principal Hardware Technical Program Manager

Microsoft Quantum team is dedicated to developing the first scalable, fault-tole...
Location
Location
United States , Santa Barbara
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 6+ years of experience managing cross-functional and/or cross-team projects
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Ability to apply AI to accelerate engineering and lab workflows
  • Ability to evaluate agentic solutions with measurable metrics and humanintheloop safeguards following Microsoft Responsible AI requirements for generative AI
Job Responsibility
Job Responsibility
  • Program Management: Lead all phases of quantum hardware projects, from concept to delivery, working closely with architects, scientists, and engineers for success
  • Create concise, data-driven updates on program status, risks, dependencies, and impact for stakeholders and senior executives
  • Planning & Roadmapping: Coordinate with leadership and engineering teams to build and maintain clear development roadmaps, align milestones, manage resources, and support long-term goals
  • Guide Agile processes, encourage transparency, and remove obstacles to meet critical deadlines
  • Team Coordination: Ensure effective collaboration across device physics, cryoelectronic, materials science, manufacturing, supply chain, integration, and cloud hardware operations for scalable solutions
  • Customer Feedback: Use input from internal and pilot customers to improve hardware and processes
  • This includes potential customers from US Government
  • Risk Mitigation: Identify and reduce risks in technology, scheduling, and operations, applying continuous improvement throughout
  • Supplier Relations: Manage external partnerships, enforce quality and safety standards, and drive cross-company compliance
  • Culture & Mentorship: Foster respect, collaboration, integrity, inclusivity, and continuous learning within the team
  • Fulltime
Read More
Arrow Right

Principal AI Engineer

As a Principal AI Engineer on the AI Foundations team, you are an established su...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Data Science, Applied Mathematics, or related technical field
  • advanced degree preferred
  • Strong foundation in software engineering, distributed systems, and applied machine learning relevant to production AI systems
  • Demonstrated understanding of responsible AI, model/system risk, privacy/security considerations, and governance requirements for enterprise deployments
  • Demonstrated, sustained ownership of production AI/ML systems, including design, build, deployment, and ongoing lifecycle operations
  • Real-world experience shipping complex agentic systems into production, including multi-agent coordination and multi-tool integration with safe action policies
  • Hands-on experience building production pipelines for evaluation, monitoring, versioning, and continuous improvement (including retraining or policy/guardrail updates)
  • Proven ability to define and operationalize observability and reliability practices for agentic systems (traceability, telemetry, SLOs, incident management)
  • Track record of influencing architecture and standards across multiple teams or programs, and mentoring engineers to raise overall engineering rigor
Job Responsibility
Job Responsibility
  • Serve as an established subject matter expert in AI Engineering, influencing stakeholders and shaping technical direction across multiple initiatives
  • Architect, design, develop, and maintain advanced AI/ML systems, with emphasis on complex agentic solutions (multi-agent orchestration, tool/function-calling, memory, reflection/self-correction, and autonomy policies)
  • Lead production implementation of agentic AI systems, including scalable training and evaluation pipelines, deployment frameworks, and runtime orchestration patterns
  • Define and implement safe tool-use patterns: structured outputs, robust error handling, permissioning and auditability, human-in-the-loop (HITL) approval steps for sensitive actions, and guardrail enforcement
  • Establish end-to-end AgentOps/LLMOps practices for agentic systems: release pipelines for prompts/tools/policies, canary strategies, safe rollback mechanisms, and continuous regression/safety evaluations as release gates
  • Build and optimize data ingestion, preprocessing, feature/embedding engineering, and retrieval/memory workflows to improve grounding quality and reduce failure modes
  • Own production observability for agentic systems: trace capture, cost/token telemetry, latency and reliability SLOs, and incident response practices for agent failures
  • Implement drift detection and performance decay monitoring (data drift, concept drift), and automate model/agent retraining, policy updates, and redeployment to maintain output quality over time
  • Drive measurable improvements in system effectiveness, safety, and efficiency by defining success metrics (task success, intervention rate, policy violations, cost and latency per task) and continuously improving evaluation coverage
  • Mentor and grow senior and junior engineers through design reviews, code reviews, hands-on coaching, and the creation of reusable patterns, playbooks, and standards for agentic delivery
  • Fulltime
Read More
Arrow Right