CrawlJobs Logo
Microsoft Corporation Logo Microsoft Corporation · IT - Software Development

Principal Software Engineering Manager - AI Frameworks

United States, Redmond Employment contract 139900.00 - 304200.00 USD / Year · Job Posted April 24, 2026
Apply Position
Job Link Share

Job Description

As a Principal Software Engineering Manager - AI Frameworks on the team, you will lead and grow a group of engineers working across multiple layers of the AI software serving stack, including fundamental abstractions, runtimes, libraries, and application programming interfaces (APIs). You will be responsible for setting technical direction, prioritizing investments, and ensuring the team delivers high-impact performance improvements that enable large-scale model training and inference. In this role, you will guide the team’s work on benchmarking OpenAI and other large language models (LLMs) across GPUs and Microsoft hardware, driving performance optimization, monitoring regressions, and accelerating time-to-deployment. You will partner closely with researchers, product teams, and platform owners to translate performance insights into production-ready improvements that reduce hardware footprint and support Microsoft Azure’s capex efficiency goals.

Job Responsibility

  • Lead and develop a team of engineers working across multiple layers of the AI software stack to enable large-scale training and inference
  • Set technical vision and execution strategy for model performance benchmarking, optimization, and deployment across GPUs and Microsoft hardware
  • Drive performance outcomes by prioritizing and overseeing efforts to benchmark, profile, debug, and optimize training and inference workloads
  • Own performance health by establishing mechanisms to monitor regressions, measure impact, and continuously improve time-to-deploy and hardware efficiency
  • Partner cross-functionally with research, product, infrastructure, and hardware teams to deliver scalable, production-ready AI performance improvements
  • Balance short-term delivery and long-term investments, ensuring the team’s work aligns with organizational goals, platform roadmaps, and Azure capex objectives
  • Build a strong engineering culture through coaching, feedback, hiring, and career development, enabling the team to operate with increasing autonomy and impact

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Master’s Degree in Computer Science or related technical field AND 10+ years of software engineering experience, including 6+ years in engineering management, OR Bachelor’s Degree in Computer Science or related technical field AND 12+ years of software engineering experience, including 6+ years in engineering management, or equivalent experience
  • Strong technical foundation in software engineering principles, computer architecture, GPU architecture, and hardware acceleration for neural networks, with the ability to guide teams working in these areas
  • Experience leading teams responsible for end-to-end performance analysis and optimization of LLMs, AI systems, or HPC workloads, including use of GPU profiling and performance analysis tools
  • Demonstrated ability to lead cross-team initiatives, align stakeholders, and translate research or platform capabilities into scalable, production-ready solutions
  • Proven people leadership skills, including hiring, coaching, performance management, and career development, with a track record of building high-performing, inclusive teams
  • Exposure to AI / ML infrastructure, including DNN or LLM training and/or inference systems, and experience with at least one modern deep learning framework (e.g., PyTorch, TensorFlow, ONNX Runtime)
  • Familiarity with GPU software stacks and acceleration technologies such as CUDA, ROCm, Triton, or equivalent, sufficient to guide technical direction and evaluate tradeoffs
Microsoft Corporation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal Software Engineering Manager - AI Frameworks

8 matching positions

Principal Software Engineering - AI Frameworks

Are you looking for opportunities to deliver innovations to hundreds of millions...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Experience developing Inference software stack
  • Experience working on systems performance optimization
  • Working with Open-Source code
Job Responsibility
Job Responsibility
  • Partnering with appropriate stakeholders to determine user requirements for one or more complex scenarios
  • Providing technical leadership for the identification of dependencies and the development of design documents for a product, application, service, or platform
  • Leading by example and mentoring others to produce extensible and maintainable code used across the company
  • Leveraging deep subject-matter expertise of cross-product features with appropriate stakeholders (e.g., project managers) to lead multiple product's project plans, release plans, and work items
  • Holding accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions
  • Proactively seeking new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and shares knowledge with other engineers
  • Embodying our Culture and Values
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager - Data Science & Engineering

The MSRC Data Science team is responsible in building data pipelines, data minin...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Leads team on the disciplined use of, and improving artificial intelligence (AI) tools and practices across the software development lifecycle (SDLC)
  • Guides team on proactively taking responsibility for the content of their AI-generated requirements, design documents, code, and other assets, and assisting other members of the team to do the same
  • Leads team on incorporating Responsible AI practices into the SDLC to ensure appropriate controls over AI-generated assets
  • Coaches team on applying SDLC and engineering health measures (e.g., Accelerate, SPACE framework, Engineering System Success Playbook [ESSP]) to guide improvements to processes and practices, especially those involving AI
  • Leads team on experimenting with AI tools and practices to improve their own capabilities, and providing recommendations on how to adopt them to others
  • Reviews debugging tools, tests, logs, telemetry, and other methods, and acts as an expert for others to proactively verify assumptions while developing code before issues occur across products in production
  • Guides team to perform machine learning/data extraction, transformation, and loading (ETL) pipelines (e.g., data collection, cleaning) based on data prepared
  • Guides the architecture of scalable pipelines and datasets
  • Influences the direction of the team
  • Begins to anticipate potential data pipeline issues and provides solutions
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager - Substrate Efficiency

M365 Copilot inference is a high-impact engineering team advancing applied AI an...
Location
Location
United States , Redmond
Salary
Salary:
142800.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Build and lead a high-performing engineering team focused on inference runtime efficiency and model execution performance
  • Define and drive strategy to improve throughput per GPU through runtime optimizations
  • Increase engineering agility, enabling faster experimentation, iteration, and rollout of performance improvements
  • Partner across M365 Core, AI Core, Azure, and Microsoft Research to co-design and productionize advanced inference optimizations
  • Establish metrics, telemetry, and experimentation frameworks to measure efficiency gains and guide investment decisions
  • Own live-site performance, reliability, and operational excellence for inference engines at scale
  • Drive alignment across partner teams on engine interfaces, performance goals, and optimization priorities.
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager, Simulation Platform - CoreAI

The AI Frameworks team at Microsoft develops AI software that enables running AI...
Location
Location
United States , Multiple Locations
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, or related technical discipline
  • 5+ years of experience building/managing team of software engineers
  • 5+ years of experience managing a software project
  • 10+ years of experience in computer architecture and/or embedded systems/software
  • 10+ years of software development experience
  • 10+ years of experience with C++ based object-oriented programming and design
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • 1+ years’ experience with Python
  • A deep technical background and solid foundation in computer architecture, system/hardware simulation, embedded software development and/or firmware
  • Experience designing and/or managing large C++ OOP, scalable, multi-threaded and multi-process software
Job Responsibility
Job Responsibility
  • Managing a team of software engineers
  • Managing development of AI chip simulator, which involves writing requirements, scoping and planning solutions, estimating and assigning work, scheduling and tracking deliverables, integration and releases to partner team, documentation
  • Technical contribution to design, code quality reviews, and capable to step in with hands-on code development when necessary (C++ and Python)
  • Collaborate broadly across multiple disciplines and with various partner teams from hardware designers to AI models developers
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager - Business Enablement

Xbox's Creator Onboarding, Release, and Support (CORS) organization is on a miss...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 4+ years people management experience
  • Experience with CRM platforms (e.g., Dynamics 365), data engineering pipelines, or business process automation
  • Experience leading distributed and geographically diverse engineering teams, including vendor partner management
  • Familiarity with cloud-scale service operations, incident management, and SRE practices
  • Track record of building inclusive teams and fostering psychological safety in engineering organizations
  • Experience with security compliance frameworks and secure-by-design engineering practices
Job Responsibility
Job Responsibility
  • Lead, coach, and grow a diverse engineering organization spanning software engineering, CRM/Dynamics 365, data engineering, and site reliability across multiple geographies and vendor partnerships fostering a culture of belonging, continuous learning, and high performance
  • Own the technical vision and engineering roadmap for Xbox's core business systems including partner onboarding, developer identity, CRM, contract automation, and data platforms ensuring alignment with CORS's strategic priorities and long-term organizational goals
  • Drive production reliability and security excellence across a broad service portfolio, championing Secure Future Initiative (SFI) compliance, incident readiness, and operational rigor as foundational engineering practices
  • Lead AI-driven modernization of business processes, replacing manual workflows with scalable, intelligent automation that accelerates the creator journey and unlocks new partner capabilities
  • Collaborate across CORS and Xbox Business teams with Product Management, Business Development, and peer engineering teams to align on priorities, resolve cross-team dependencies, and deliver cohesive end-to-end creator experiences
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager - Package Ingestion

Xbox's Creator Onboarding, Release, and Support (CORS) organization is on a miss...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • 4+ years people management experience
  • Experience building and operating large-scale distributed systems, high-throughput data pipelines, or content delivery platforms
  • Familiarity with packaging technologies, build/release engineering, or CI/CD infrastructure at scale
  • Experience with Azure cloud services, storage systems, and globally distributed architectures
  • Track record of building inclusive teams and fostering psychological safety in engineering organizations
  • Experience managing teams through leadership transitions with empathy and stability
  • Experience with security compliance frameworks, encryption/signing pipelines, and secure-by-design engineering practices
Job Responsibility
Job Responsibility
  • Lead, coach, and grow a backend engineering team of approximately 10 full-time engineers plus vendor staff, building the high-throughput systems that power Xbox's publishing pipeline reestablishing strong people management practices including career development, performance coaching, and team ceremonies
  • Own the technical vision and engineering roadmap for the end-to-end package ingestion pipeline from upload and validation through encryption, signing, and CDN delivery driving modernization toward next-generation packaging formats and reduced-latency processing
  • Drive production reliability and security excellence across mission-critical backend services, championing Secure Future Initiative (SFI) compliance, encryption and certificate management, DRI on-call practices, and BCDR readiness
  • Lead AI-driven innovation in the publishing pipeline, applying disciplined AI adoption and engineering automation to reduce end-to-end latency, improve global upload parity, and accelerate the creator publishing experience
  • Collaborate across the publishing ecosystem with Product Management, TPM, peer engineering teams, and downstream partners in CDN, Partner Center, and Xbox Live runtime to deliver a seamless, reliable experience for creators worldwide
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager

Are you a customer obsessed, AI curious engineering leader who thrives in inclus...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 4+ years people management experience
  • Experience with one or more cloud platforms (e.g., Azure, AWS, etc.)
  • Expertise in one or more web application dev frameworks (e.g., Angular, React, etc.)
  • A proven track record of technical leadership and experience in shipping high quality products or service
Job Responsibility
Job Responsibility
  • Lead the team in defining goals, planning work, and executing against clear priorities—delivering results with a dedicated focus on quality, reliability, and customer impact
  • Provide technical leadership and guidance across system architecture, design, development, deployment, and live‑site operations for a large‑scale, mission‑critical service
  • Partner closely with Product Management, Engineering Operations leaders, and Azure product teams to align on strategy, roadmap, and execution across short‑ and long‑term horizons
  • Establish and manage priorities in a fast‑paced, evolving environment, balancing feature delivery, operational excellence, and technical debt reduction
  • Build, develop, and retain a high‑performing engineering team through thoughtful hiring, coaching, feedback, and career development
  • Foster a culture of inclusion, accountability, learning, and continuous improvement within the team
  • Drive effective engineering practices, including modern design patterns, secure and resilient service design, and agile delivery models
  • Enable effective cross‑group collaboration, sound technical decision‑making, and healthy conflict resolution
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager

Are you an experienced Group Engineering Manager with a passion for solving hard...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Current M2s and M1.5s with past experience of managing Engineering leads preferred
  • Exceptional teamwork and values that foster a positive team culture
  • Experience in collaborating with teams across different time zones and geographies
  • Experience driving strategy, roadmap and business vision across product groups and business units
  • Experience in leading and coaching teams of Engineering managers providing expert guidance, hands-on assistance, best practices, and training
  • Strong and applied knowledge of service infrastructure, frameworks, and technologies such as Azure Cloud Services, Azure Service Fabric, ASP.NET Core 2, .Net Framework, NuGet packages, and Git
  • Knowledge of common services design patterns and application development best practices
  • Demonstrated ability to ramp up on both new and legacy technologies
Job Responsibility
Job Responsibility
  • You will be a highly technical and experienced cloud services GEM who determines the right strategy and roadmap to grow the developer ecosystem on Windows and Microsoft Store
  • You will work closely with Engineering managers and ICs to build services to support Store developer experiences leveraging MCP and Agentic AI
  • You will be a strong people manager who is committed to creating clarity, generating energy, and delivering success
  • As a people manager, you will deliver success through empowerment and accountability by modeling, coaching, and caring
  • You will provide direction to the team through breaking down service specs and architecture, and work across multiple disciplines to make implementation decisions
  • In your role you will work with peers across Product management and software engineering to launch new experiences that integrate with existing systems
  • Fulltime
Read More
Arrow Right