Technical Program Manager - Azure (AI/ML) Job at Microsoft Corporation (Mountain View)

Senior Technical Program Manager, Infrastructure

Glean is seeking a Senior Infrastructure Technical Program Manager (TPM) to lead...

Location

United States , Palo Alto

Salary:

198000.00 - 235500.00 USD / Year

Glean

Expiration Date

Until further notice

Requirements

BS/MS in Computer Science, Engineering, or a related technical field
8-10+ years of experience in technical program management, infrastructure, or SRE, with at least 3-5 years managing infra or platform-scale programs
Proven success delivering cross-functional infrastructure programs in B2B or enterprise environments where scalability, uptime, and performance are critical
Experience working closely with Infra, SRE, and ML/AI teams on distributed systems or data infrastructure
Strong understanding of cloud infrastructure (AWS, GCP, or Azure) including compute, networking, storage, and orchestration systems
Ability to structure complex multi-quarter infrastructure programs with clear milestones and measurable impact
Strong written and verbal communication and ability to manage through ambiguity, anticipate scaling challenges, and align teams across priorities
Builder mindset with focus on automation, reliability, and efficiency

Job Responsibility

Lead end-to-end infra programs spanning compute, networking, storage, orchestration, and AI workloads
Partner with Engineering to define standards for environment provisioning, deployment automation, and configuration governance
Develop and operationalize frameworks for runtime health, scaling, and disaster recovery
Drive consistency and automation across deployment orchestration systems
Establish clear metrics for reliability, performance, and cost efficiency
Coordinate cross-team delivery of high-impact programs such as data pipeline scalability, LLM infrastructure expansion, or infra observability improvements
Communicate program status and technical risks effectively to leadership and stakeholders
Continuously identify process or system bottlenecks, and drive automation to improve speed and reliability of infra operations

What we offer

Medical, Vision, and Dental coverage
generous time-off policy
opportunity to contribute to your 401k plan
home office improvement stipend
annual education and wellness stipends
vibrant company culture through regular events
healthy lunches daily

Fulltime

Service Engineer II

Are you excited about working on one of Microsoft’s most strategic and high‑visi...

Location

India , Hyderabad

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

10+ years of experience in incident management, service engineering, program management, or related technical roles
Strong track record commanding high-pressures, complex, cross-team incidents across cloud or large-scale distributed systems
3+ years of hands-on experience working with cloud technologies (Azure preferred)
Strong understanding of Azure architecture, core services, and internal operational workflows
Exceptional communication skills, with the ability to simplify complex technical issues for senior executives and customers
Experience collaborating in matrixed engineering environments with diverse stakeholders (PG, EngOPS, Field, GPMs, PMs, SREs)
Strong analytical skills
ability to drive insight from data and influence direction through evidence
Proven experience driving pilots, building prototypes, or contributing to innovation in livesite or automation scenarios
Demonstrated experience in AI/ML-based solutions—automation, anomaly detection, NLP, or reliability tooling

Job Responsibility

Lead high‑severity Azure incidents with strong command presence and clear decision‑making under pressure
Drive the end‑to‑end incident lifecycle, including detection, triage, mitigation, communication, and post‑incident learning
Partner across Azure product groups, EngOPS, and field teams to accelerate diagnosis, reduce time‑to‑mitigation, and drive sustainable fixes
Represent the voice of the customer by surfacing systemic issues, platform gaps, and reliability risks to engineering teams
Drive operational maturity through repeatable processes, strong governance, high‑quality execution, and measurable reliability metrics
Identify live‑site patterns and hotspots across services and lead cross‑team action plans to address them
Convert customer and incident pain points into automation, AI‑assisted workflows, and process improvements
Lead or co‑own pilots, proofs‑of‑concept, and tech accelerators that enhance incident response velocity and quality
Contribute to internal playbooks, frameworks, and tooling that leverage AI/ML for improved live‑site management

Fulltime

Senior Service Engineer

Are you excited about working on one of Microsoft’s most strategic and high‑visi...

Location

India , Hyderabad

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

10+ years of experience in incident management, service engineering, program management, or related technical roles
Strong track record commanding high-pressures, complex, cross-team incidents across cloud or large-scale distributed systems
5+ years of hands-on experience working with cloud technologies (Azure preferred)
Strong understanding of Azure architecture, core services, and internal operational workflows
Exceptional communication skills, with the ability to simplify complex technical issues for senior executives and customers
Experience collaborating in matrixed engineering environments with diverse stakeholders (PG, EngOPS, Field, GPMs, PMs, SREs)
Strong analytical skills
ability to drive insight from data and influence direction through evidence
Proven experience driving pilots, building prototypes, or contributing to innovation in live‑site or automation scenarios
Demonstrated experience in AI/ML-based solutions—automation, anomaly detection, NLP, or reliability tooling. Exposure to Power BI, Kusto (KQL), or other analytical tooling

Job Responsibility

Lead high‑severity Azure incidents with strong command presence and clear decision‑making under pressure
Drive the end‑to‑end incident lifecycle, including detection, triage, mitigation, communication, and post‑incident learning
Partner across Azure product groups, EngOPS, and field teams to accelerate diagnosis, reduce time‑to‑mitigation, and drive sustainable fixes
Represent the voice of the customer by surfacing systemic issues, platform gaps, and reliability risks to engineering teams
Drive operational maturity through repeatable processes, strong governance, high‑quality execution, and measurable reliability metrics
Identify live‑site patterns and hotspots across services and lead cross‑team action plans to address them
Convert customer and incident pain points into automation, AI‑assisted workflows, and process improvements
Lead or co‑own pilots, proofs‑of‑concept, and tech accelerators that enhance incident response velocity and quality
Contribute to internal playbooks, frameworks, and tooling that leverage AI/ML for improved live‑site management

Fulltime

Analytics & AI Delivery Lead

We are seeking a highly motivated and experienced Delivery Leader to oversee the...

Location

United States

Salary:

107000.00 - 179000.00 USD / Year

Avanos

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Information Systems, Computer Science, Engineering, or a related field (Master’s preferred)
8+ years of experience in project/program management with a focus on data, analytics, or AI initiatives
Demonstrated ability to manage complex, multi-disciplinary programs using Agile, Waterfall, and hybrid methodologies
Experience delivering projects involving Azure Data Services, including Synapse Analytics, Power BI, Microsoft Fabric, and Azure DevOps
Strong stakeholder management skills, with a proven ability to influence, communicate, and collaborate at all levels of the organization
Knowledge of data governance, data modeling, and AI/ML deployment frameworks is a plus
PMP, Scrum Master, or SAFe certification is advantageous

Job Responsibility

Lead end-to-end delivery of Analytics and AI projects, from initiation through implementation and transition to operations
Partner closely with business stakeholders to align project goals with strategic objectives and ensure value realization
Drive project planning activities including scoping, scheduling, resource planning, risk management, and reporting
Facilitate agile ceremonies or stage-gate processes based on project needs (Scrum or Waterfall)
Serve as a liaison between technical teams and business functions to translate requirements and remove roadblocks
Ensure strong governance and compliance with delivery standards, documentation, and stakeholder communication
Track key metrics such as scope, budget, timeline, and benefit realization to ensure successful project outcomes
Contribute to the continuous improvement of delivery practices within the analytics and AI domain

What we offer

Comprehensive and competitive range of benefits
Health care benefits
Retirement plans
Work/life benefits
Generous 401(k) employer match of 100% of each pretax dollar you contribute on the first 4% and 50% of the next 2% of pay contributed with immediate vesting
Benefits on day 1
Free onsite gym
Onsite cafeteria
HQ region voted 'best place to live' by USA Today
Uncapped sales commissions

Senior Azure ACE Engineer - Sovereign Cloud

As a customer focused Advanced Cloud Engineer, you are the primary engineering c...

Location

Ireland , Dublin

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree Engineering, Computer Science, Information Technology (IT), Data Analytics/Science, Artificial Intelligence (AI), or related field AND relevant experience in technology industry, cloud, technical support, and/or customer experience engineering OR equivalent experience.
Demonstrated experience supporting and troubleshooting enterprise level, mission-critical applications and infrastructure resolving complex issues/situations and driving technical resolution across cross-functional organizations.
Familiarity with operating in regulated or restricted‑access environments, such as sovereign cloud, high‑security, or compliance‑driven workloads is an advantage.
Experience with being on-call and driving mitigation for mission critical incidents.
Demonstrated hands-on experience with expertise in one or more of the following Cloud technologies: Core IaaS: Compute (Windows/Linux), Storage, Networking, Kubernetes, High Availability
Data Platform and Bigdata: Azure SQL DB, Cosmos DB, PostgreSQL on Azure, Azure Data Bricks, Azure Data Factory, AI/ML
Azure PaaS Services: App Services, Azure Functions, Redis Cache, and Event Hub.
Monitoring technologies: Azure Monitor, Log Analytics, Grafana, Datadog, Confluent and similar technologies.
Communication skills: ability to empathize with customers and convey confidence. Able to explain highly technical issues to varied audiences. Able to prioritize and advocate customer’s needs to the proper channels. Take ownership and work towards a resolution.
Customer Obsession: Passion for customers and focus on delivering the right customer experience.

Job Responsibility

With minimal oversight, track customer incidents, engage with strategic customers and partners to understand issues, contribute to troubleshooting through diagnostics, communicate progress and next steps to customers with a focus on reducing time taken to mitigate critical incidents.
Use engineering and support tools, customer telemetry and/or direct customer input to detect and flag issues in the products or with the customer usage of the products.
Help customers stay current with best practices by sharing content.
Identify and leverage developmental opportunities across product areas and business processes (e.g., mentorships, shadowing, trainings) for professional growth and to develop technical skills to resolve customer issues.
With minimal guidance, serve as a connecting point between the product team and customers throughout the engagement life cycle, engage with customers to understand their business and availability needs, develop and offer proactive guidance on designing configurations and deploying solutions on Azure with support from subject matter experts.
Handle critical escalations on customer issues from the customer or support or field teams, conduct impact analysis, help customers with answers to their technical questions, and serve as an escalation resource in areas of subject matter expertise.
Conduct in-depth root cause analysis of issues and translates findings into opportunities for improvement and track and drive them as repair items.
Act as the voice of customers and channel product feedback from strategic customers to product groups. Identify customer usage patterns and drive resolutions on reoccurring issues with product groups. Close the feedback loop with the customers on product features.
With minimal guidance, partner with other teams (e.g., program managers, software engineers, product, customer service support teams), prioritize, unblock, and resolve critical customer issues.
Collaborate with stakeholders to support delivery of solutions to strategic customers and resolving customer issues.

Fulltime

Principal Product Manager - AI Governance (Azure AI Foundry)

AI is transforming how organizations operate, and with it comes a new frontier o...

Location

United States , Redmond

Salary:

139900.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor’s Degree AND 8+ years in product management, program management, or technical leadership roles OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Deep familiarity with AI/ML systems, model governance, or enterprise compliance frameworks
Proven experience driving cross-functional initiatives with engineering, security, and policy teams
Excellent communication skills with demonstrated ability to influence across organizational boundaries
10+ years of product management or applied AI experience, ideally in enterprise cloud or responsible AI domains
Knowledge of AI governance frameworks (EU AI Act, NIST AI RMF, ISO 42001, SOC 2, etc.)
Experience building or integrating security, compliance, or observability products
Familiarity with agentic AI systems and associated risk classes (e.g., sensitive data leakage, prohibited actions, task drift, jailbreaks)

Job Responsibility

Lead the AI Governance product area within Azure AI Foundry — defining the long-term vision, strategy, and roadmap for policy management, compliance automation, and regulatory readiness
Design and deliver core governance experiences, including agent-level policies, data sensitivity signals, prohibited action controls, and AI system compliance dashboards
Integrate Foundry governance with Microsoft’s broader security and compliance stack — Entra (identity and A2A policies), Purview (data classification and DLP), and Defender (threat insights)
Translate emerging AI regulations (EU AI Act, ISO 42001, NIST AI RMF) into actionable platform capabilities and customer experiences
Partner with Responsible AI researchers and engineering teams to operationalize ethical principles into measurable safeguards and evaluators
Collaborate with customers, industry bodies, and policymakers to help shape standards for trustworthy AI deployment
Establish and track success metrics (governance coverage, compliance posture, customer adoption), ensuring measurable impact and clarity across engineering and partner orgs
Represent the product in executive and customer forums, evangelizing Microsoft’s approach to responsible, governed AI systems

Fulltime

Senior AI Project Manager – Broker Dealer & Wealth Management

Seeking a Senior AI Project Manager to lead AI and data-driven initiatives withi...

Location

United States , Los Angeles

Salary:

90.00 USD / Hour

Beacon Hill

Expiration Date

Until further notice

Requirements

7+ years of project or program management experience, including AI/ML or data-driven initiatives
Direct experience in Broker Dealer & Wealth Management environments (required)
Proven delivery experience in financial services or highly regulated environments
Hands-on experience managing large, complex programs with minimal supervision
Strong understanding of the AI/ML lifecycle: data pipelines, model training/testing, evaluation, deployment, and MLOps
Working knowledge of data quality, governance, bias, privacy, and ethical AI considerations
Familiarity with cloud platforms (AWS, Azure, or GCP) and AI/engineering tools (e.g., Jira, Git, TensorFlow, PyTorch)
Define and manage scope, schedule, cost, risk, resources, and quality
Create and maintain detailed project plans, milestones, dependencies, and reporting
Lead cross-functional teams including data scientists, ML engineers, data engineers, and business stakeholders

Job Responsibility

Lead AI and data-driven initiatives within a Broker Dealer & Wealth Management environment
Own delivery end-to-end-from project definition through deployment
Ensure alignment between business objectives, data teams, and regulatory requirements

Fulltime

Senior Manager, AI & ML Engineering

You will be a leader in Alter Domus' AI & ML engineering organization driving en...

Location

United Kingdom , London

Salary:

Not provided

Alter Domus

Expiration Date

Until further notice

Requirements

10+ years of experience in software engineering, data engineering, or AI/ML engineering roles
5+ years managing technical teams, including experience managing managers
Deep expertise with Python, modern ML frameworks (PyTorch, TensorFlow), and data science ecosystems
Production experience with LLM APIs (OpenAI, Anthropic, AWS Bedrock) and agentic frameworks (LangChain, LangGraph etc)
Strong understanding of vector databases, RAG and GraphRAG architectures, and semantic search
Experience with cloud platforms (AWS, Azure or GCP), microservices, APIs, and containerization (Docker/Kubernetes)
Proven track record delivering enterprise AI/ML solutions at scale
Experience with portfolio management, budget ownership, and ROI tracking and OKRs

Job Responsibility

Help define and drive the multi-year technical roadmap for Alter Domus' AI platforms
Make critical build-buy-partner decisions for AI/ML capabilities
Sponsor platform modernization programs and guide the evolution from proof-of-concept to production-scale AI solutions
Drive measurable and accurate business outcomes through AI adoption
Lead the technical architecture for RAG and GraphRAG pipelines, multi-agent orchestration, and LLM based documents processing technologies
Manage portfolio resource mix and capital allocation
Collaborate with business leaders to define product strategy
Monitor AI/ML market trends, competitor capabilities, and emerging technologies
Build business cases with clear ROI tracking
Design sustainable cost structure for the AI/ML portfolio

What we offer

Support for professional accreditations such as ACCA and study leave
Flexible arrangements, generous holidays, plus an additional day off for your birthday
Continuous mentoring along your career progression
Active sports, events and social committees across our offices
24/7 support available from our Employee Assistance Program
The opportunity to invest in our growth and success through our Employee Share Plan
Plus additional local benefits depending on your location

Technical Program Manager - Azure (AI/ML)

Microsoft Corporation

Location:
United States , Mountain View

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
April 01, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Technical Program Manager - Azure (AI/ML)