CrawlJobs Logo

Principal Applied AI Engineering Manager

United States, Redmond · Job Posted June 02, 2026
Apply Position
Job Link Share

Job Description

Are you a customer-obsessed, AI-curious engineering leader who thrives in an inclusive, collaborative global team? The Azure Engineering Operations (EngOps) team's mission is to transform Microsoft Cloud customers into fans. Through our deep engineering engagements with customers and teams across Microsoft, we analyze and amplify customer needs and drive the vision to improve Cloud quality, security, and reliability. Our culture of growth mindset and empowerment are central to who we are and how we work. Our ACES engineering team is building domain specific agents and services that are fundamentally transforming Azure customer support — from reactive, human-only workflows to AI-first systems that resolve customer issues at Azure scale. We are seeking a Principal Applied AI Engineering Manager to build and lead a high-performing AI engineering pod focused on shipping production agentic AI services. You will own the engineering execution for next-generation AI agents — LLM orchestration, multi-agent coordination, RAG-based systems, and evaluation frameworks — that handle thousands of customer cases per month and drive measurable volume reduction across Azure. This is a leadership role building production AI services that directly impact millions of Azure customers. You will build the team, set the technical direction, own the delivery, and be accountable for engineering outcomes. Every day, our customers stake their business and reputation on our cloud. You can help Azure EngOps provide our customers with the world-class cloud services they need to succeed. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Job Responsibility

  • Build and lead the AI engineering pod
  • Own engineering execution for agentic AI services
  • Set technical direction and engineering standards
  • Own production health and reliability
  • Build and maintain evaluation systems
  • Influence product and platform roadmaps
  • Drive measurable business impact
  • Ensure responsible AI and compliance
  • Develop engineering talent

Requirements

  • Bachelor's Degree AND 6+ years experience in low-code application development, engineering product/technical program management, data analysis, or product development OR equivalent experience
  • Proficiency in Python and C# with hands-on experience building production AI/ML systems
  • Experience with LLM-based systems, including prompt engineering, RAG architectures, or agent frameworks
  • Experience with cloud platforms (Azure) and cloud-native service development (microservices, containers, CI/CD)
  • 3+ years people management and/or informal/indirect team leadership experience
  • 4+ years of experience using low-code/no-code platforms (e.g., Dataverse, Power Applications)
  • 3+ years of experience managing and configuring artificial intelligence solutions (e.g., chatbots)
  • 4+ years of experience with programming/coding

Nice to have

  • Bachelor's Degree AND 12+ years experience in low-code application development, engineering product/technical program management, data analysis, or product development OR equivalent experience
  • Proficiency in Python and C# with hands-on experience building production AI/ML systems
  • Experience with LLM-based systems, including prompt engineering, RAG architectures, or agent frameworks
  • Experience with cloud platforms (Azure) and cloud-native service development (microservices, containers, CI/CD)
  • 3+ years people management and/or informal/indirect team leadership experience
  • 4+ years of experience using low-code/no-code platforms (e.g., Dataverse, Power Applications)
  • 3+ years of experience managing and configuring artificial intelligence solutions (e.g., chatbots)
  • 4+ years of experience with programming/coding

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal Applied AI Engineering Manager

8 matching positions

Principal Software Engineering Manager - Data Science & Engineering

The MSRC Data Science team is responsible in building data pipelines, data minin...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Leads team on the disciplined use of, and improving artificial intelligence (AI) tools and practices across the software development lifecycle (SDLC)
  • Guides team on proactively taking responsibility for the content of their AI-generated requirements, design documents, code, and other assets, and assisting other members of the team to do the same
  • Leads team on incorporating Responsible AI practices into the SDLC to ensure appropriate controls over AI-generated assets
  • Coaches team on applying SDLC and engineering health measures (e.g., Accelerate, SPACE framework, Engineering System Success Playbook [ESSP]) to guide improvements to processes and practices, especially those involving AI
  • Leads team on experimenting with AI tools and practices to improve their own capabilities, and providing recommendations on how to adopt them to others
  • Reviews debugging tools, tests, logs, telemetry, and other methods, and acts as an expert for others to proactively verify assumptions while developing code before issues occur across products in production
  • Guides team to perform machine learning/data extraction, transformation, and loading (ETL) pipelines (e.g., data collection, cleaning) based on data prepared
  • Guides the architecture of scalable pipelines and datasets
  • Influences the direction of the team
  • Begins to anticipate potential data pipeline issues and provides solutions
  • Fulltime
Read More
Arrow Right

Principal Product Manager - AI Governance (Azure AI Foundry)

AI is transforming how organizations operate, and with it comes a new frontier o...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree AND 8+ years in product management, program management, or technical leadership roles OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Deep familiarity with AI/ML systems, model governance, or enterprise compliance frameworks
  • Proven experience driving cross-functional initiatives with engineering, security, and policy teams
  • Excellent communication skills with demonstrated ability to influence across organizational boundaries
  • 10+ years of product management or applied AI experience, ideally in enterprise cloud or responsible AI domains
  • Knowledge of AI governance frameworks (EU AI Act, NIST AI RMF, ISO 42001, SOC 2, etc.)
  • Experience building or integrating security, compliance, or observability products
  • Familiarity with agentic AI systems and associated risk classes (e.g., sensitive data leakage, prohibited actions, task drift, jailbreaks)
Job Responsibility
Job Responsibility
  • Lead the AI Governance product area within Azure AI Foundry — defining the long-term vision, strategy, and roadmap for policy management, compliance automation, and regulatory readiness
  • Design and deliver core governance experiences, including agent-level policies, data sensitivity signals, prohibited action controls, and AI system compliance dashboards
  • Integrate Foundry governance with Microsoft’s broader security and compliance stack — Entra (identity and A2A policies), Purview (data classification and DLP), and Defender (threat insights)
  • Translate emerging AI regulations (EU AI Act, ISO 42001, NIST AI RMF) into actionable platform capabilities and customer experiences
  • Partner with Responsible AI researchers and engineering teams to operationalize ethical principles into measurable safeguards and evaluators
  • Collaborate with customers, industry bodies, and policymakers to help shape standards for trustworthy AI deployment
  • Establish and track success metrics (governance coverage, compliance posture, customer adoption), ensuring measurable impact and clarity across engineering and partner orgs
  • Represent the product in executive and customer forums, evangelizing Microsoft’s approach to responsible, governed AI systems
  • Fulltime
Read More
Arrow Right

Principal Engineering Manager

Are you a customer-obsessed, AI-curious problem-solver who thrives in an inclusi...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, or related technical discipline AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • 4+ years people management experience
Job Responsibility
Job Responsibility
  • Understanding of the distributed systems design, interactions between cloud technology layers and components, basic dependencies at scale, and the code that defines infrastructures
  • Managers deliver success through empowerment and accountability by modeling, coaching, and caring
  • Shares and defines insights, best practices, and standards that can be applied to improve system, platform, and/or product development and operations across the business
  • Expands end-to-end technical expertise in the architecture, code, features, operations and comprehensive use scenarios of products in order to drive continuous improvements
  • Contribute to the product fundamentals and architecture, share knowledge, and code, always looking for ways to make what we build useful to multiple teams and products
  • Demonstrates end-to-end expertise in distributed systems design, interactions between cloud technology layers
  • Support ongoing engagements with product engineering teams by participating in test maturity reviews, static analysis reviews, meetings, on-call rotations, and incident responses throughout product development and operations cycles
  • Provides deep business and technical expertise as required to resolve major incidents
  • Fulltime
Read More
Arrow Right

Principal Applied AI Engineer

Microsoft Dynamics 365 powers mission-critical business operations across the gl...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • 8+ years of hands-on software engineering experience with deep expertise in languages such as C#, Python, Java, or equivalent
  • 2+ years of experience delivering AI/ML-based systems at production scale, ideally including LLMs, transformers, RAG pipelines, or similar architectures
  • Demonstrated experience leading engineering teams or cross-functional initiatives involving AI systems in cloud environments
  • Proven track record of designing and deploying AI-first applications at scale, with deep understanding of performance, privacy, compliance, and operational constraints in enterprise SaaS
  • Expertise in MLOps/LLMOps, including model versioning, retraining pipelines, A/B testing, monitoring, and rollout strategies
  • Deep knowledge of cloud platforms (preferably Azure) and experience deploying containerized AI services using Kubernetes, Docker, or similar
Job Responsibility
Job Responsibility
  • Own architecture, strategy, and execution of AI-powered features across Dynamics 365 Sales and Service, ensuring technical alignment with Microsoft’s cloud-scale services and AI platform direction
  • Design and deliver production-ready AI solutions that leverage large language models (LLMs), natural language understanding, speech, and real-time reasoning to improve agent productivity and customer satisfaction
  • Lead complex technical initiatives, including AI model integration, platform scalability, reliability, and long-term maintainability
  • Collaborate deeply with applied scientists, product managers, and UX teams to translate customer needs into intelligent capabilities that deliver measurable business value
  • Drive engineering rigor across the team by establishing high standards for code quality, observability, testing, MLOps, and secure deployment practices
  • Mentor engineers across levels, fostering a culture of innovation, inclusivity, and continuous learning
  • Proactively identify technology gaps, evaluate emerging AI frameworks/tools (including open-source and Azure AI offerings), and champion adoption where appropriate
  • Act as a technical advisor across the broader organization, contributing to cross-team initiatives and long-term architectural planning
  • Fulltime
Read More
Arrow Right

Principal Engineering Manager

Are you interested in designing and coding a next-generation application used by...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Solid passion and proven experience delivering high quality services at scale spanning multiple systems and groups
  • Exceptional problem solving, coding & debugging skills
  • Experience developing, debugging, and shipping software products on large code bases that span platforms and tools
  • At least 3+ years experiences of being a people manager
  • Have proven track record of forming, mentoring and growing strong engineering teams
  • Thought leader and a change agent
  • Obsessed about great customer experiences and outcomes
  • Great communicator, able to convey complex issues, ideas and concepts clearly
  • Excellent collaboration skills with partners
Job Responsibility
Job Responsibility
  • Works with appropriate stakeholders (e.g., project manager, technical lead) to determine user requirements for a set of features
  • Begins to leverage a variety of feedback channels to incorporate insights into future designs or solution fixes
  • Incorporates appropriate continuous feedback loops measuring customer value, usage patterns, and other actionable metrics of value
  • Contributes to processes for the architecture of a product/solution feature and helps to create proposals for architecture by testing design hypotheses and helping to refine code and design plans, demonstrating technical leadership
  • Provides initial reactions and input to engineers in the team
  • Owns architecting of solutions, demonstrating technical leadership as applicable
  • Contributes to the development of design documents for designs or User Stories and determines the technology that will be leveraged and how it will interact
  • Escalates and shares findings from investigations with the team and owns design decisions
  • Helps to assure system architecture meets security and compliance requirements and expectations
  • Creates and implements code for a product, service, or feature, reusing code as applicable
  • Fulltime
Read More
Arrow Right

Principal Applied AI Engineer

Security represents the most critical priorities for our customers in a world aw...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, Data Science or related technical field
  • Minimum 9+ Years of total Experience
  • 5+ years technical engineering experience with coding in languages including C#, Java AND Python
  • Should have 5+ years in Data Science experience
  • 3 years of experience with LLMs and open-source GenAI frameworks, such as LangChain, LlamaIndex, Haystack, or equivalents (e.g., Transformers, AutoGen, DSPy), including agent-based orchestration, prompt engineering, retrieval-augmented generation (RAG), and fine-tuning and evaluation
  • Proficiency in writing production-quality software code in one or more modern programming languages (Python, C#)
  • 3+ years experience developing software systems end-to-end, from design to implementation
  • 2+ years experience in shipping at least 2 large scale ML/AI-based services or applications on cloud platforms (Azure, AWS, GCP, etc.)
Job Responsibility
Job Responsibility
  • Design, develop, and deploy end-to-end AI/ML systems, including data ingestion, model training, evaluation, and integration into production environments
  • Build and optimize applications leveraging LLMs and open-source GenAI frameworks such as LangChain, LlamaIndex, Haystack, Transformers, AutoGen, and DSPy
  • Implement advanced GenAI techniques including agent-based orchestration, prompt engineering, retrieval-augmented generation (RAG), and model fine-tuning
  • Write production-grade software in Python and C# or Java, ensuring maintainability, scalability, and performance
  • Collaborate with cross-functional teams to translate business requirements into technical solutions
  • Ship and maintain large-scale AI applications, with a focus on performance monitoring and continuous improvement
  • Conduct rigorous evaluation of AI models using appropriate metrics and benchmarks
  • Optimize models for latency, throughput, and accuracy in real-world scenarios
  • Work closely with data scientists, product managers, and other engineers to drive AI initiatives
  • Stay current with the latest advancements in GenAI, LLMs, and AI frameworks
  • Fulltime
Read More
Arrow Right

Principal Engineering Manager

Are you excited by the idea of shaping how Microsoft builds and operates cloud s...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Computer Science or a related technical field AND 8+ years of technical engineering experience with coding in one or more of the following languages: C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Master’s Degree in Computer Science or a related technical field AND 8+ years of technical engineering experience with coding in one or more of the following languages: C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor’s Degree in Computer Science or a related technical field AND 12+ years of technical engineering experience with coding in one or more of the following languages: C, C++, C#, Java, JavaScript, or Python
  • OR Equivalent experience
  • 4+ years of people management experience
  • Ability to meet Microsoft, customer, and/or government security screening requirements for this role
  • Passing the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Guides partnership with appropriate stakeholders (product manager, primary developer, co-developing engineering teams) to determine user requirements within and across teams
  • Guides teams and leads identification of dependencies and the development of design documents for a product, application, service, or platform
  • Optimizes, debugs, refactors, and reuses code to improve performance and maintainability, effectiveness, and return on investment (ROI)
  • Guides team to drive multiple group's project plans, release plans, and work items in coordination with appropriate stakeholders (e.g., project managers)
  • Guides team and acts as an expert for Designated Responsible Individual (DRI) and monitors other engineers across product lines, working on call to monitor system/product/service for degradation, downtime, or interruptions
  • Leads product development and scaling to customer requirements and applies best practices for meeting scaling needs and performance expectations and holds accountability for products that do not meet expectations
  • Fulltime
Read More
Arrow Right

Principal Applied AI Engineer

Microsoft Dynamics 365 powers mission-critical business operations across the gl...
Location
Location
United States , Multiple Locations
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 2+ years of experience delivering AI/ML-based systems at production scale, ideally including LLMs, transformers, RAG pipelines, or similar architectures
  • Demonstrated experience leading engineering teams or cross-functional initiatives involving AI systems in cloud environments
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Own architecture, strategy, and execution of AI-powered features across Dynamics 365 Sales and Service, ensuring technical alignment with Microsoft’s cloud-scale services and AI platform direction
  • Design and deliver production-ready AI solutions that leverage large language models (LLMs), natural language understanding, speech, and real-time reasoning to improve agent productivity and customer satisfaction
  • Lead complex technical initiatives, including AI model integration, platform scalability, reliability, and long-term maintainability
  • Collaborate deeply with applied scientists, product managers, and UX teams to translate customer needs into intelligent capabilities that deliver measurable business value
  • Drive engineering rigor across the team by establishing high standards for code quality, observability, testing, MLOps, and secure deployment practices
  • Mentor engineers across levels, fostering a culture of innovation, inclusivity, and continuous learning
  • Proactively identify technology gaps, evaluate emerging AI frameworks/tools (including open-source and Azure AI offerings), and champion adoption where appropriate
  • Act as a technical advisor across the broader organization, contributing to cross-team initiatives and long-term architectural planning.
  • Fulltime
Read More
Arrow Right