CrawlJobs Logo

Principal Software Engineering Manager - CoreAI

United States, Redmond Employment contract 165600.00 - 296400.00 USD / Year · Job Posted July 13, 2026
Apply Position
Job Link Share

Job Description

CoreAI is at the forefront of Microsoft's mission to redefine how software is built and experienced. We are responsible for building the foundational platforms, services, programming models, and developer experiences that power the next generation of applications using Generative AI. Our work enables developers and enterprises to harness the full potential of AI to create intelligent, adaptive, and transformative software. Microsoft Foundry Experiences team within CoreAI builds SDKs, UI, and agentic experiences that span core AI capabilities including model inferencing, knowledge and memory systems, AI services, model customization, and multi-agent solutions. As a Principal Software Engineering Manager on this team, you will lead and grow a team of engineers responsible for delivering cohesive, scalable, and intuitive experiences that enable developers and enterprises to effectively build, deploy, and operate AI applications. You will set technical direction, coach engineers, and ensure the team deeply understands customer and developer needs in complex scenarios, translating them into durable platform capabilities and delightful experiences. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Job Responsibility

  • Lead, grow, and coach a diverse and inclusive team of engineers to thrive in the fast-changing world of AI.
  • Set technical and product direction for the team, aligning engineering investments with customer needs and business priorities.
  • Create clarity and accountability by establishing goals, decision-making mechanisms, and execution rhythms that help the team deliver with predictability and impact.
  • Build a culture of ownership, inclusion, and continuous growth by setting high standards, building sustainable systems, and reinforcing learning through regular feedback and reflection.
  • Model and coach the team in AI-first engineering practices grounded in software engineering fundamentals, driving up both speed of execution and product quality.
  • Champion a customer-obsessed culture by guiding the team to turn customer and developer feedback into innovative platform improvements that address real-world needs.
  • Establish clear ownership and operating mechanisms that ensure live site health, effective incident response, and continuous improvement.

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice to have

  • Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • 6+ years of experience as a people manager.
  • 5+ years of technical leadership in defining and building developer experiences and scalable systems, preferably in the Generative AI, Machine Learning domain.
  • 10+ years of experience shipping software products, product development expertise, taking special pride in shipping delightful experiences that solve clear customer needs.
  • 5+ years of experience in JavaScript, React, Python, .NET, C#, or similar programming languages or platforms.
  • Experience leading cross-functional engineering efforts across distributed teams.
  • Experience delivering customer-facing software products or platform capabilities in production environments.
  • Demonstrated proficiency around leveraging AI to build AI systems and a passion to make this technology accessible to everyone
  • Proven record of identifying challenges, making clear judgment calls on tradeoffs, and making systemic changes for lasting impact, while bringing value to customer quickly.
  • Clarity in communication and ability to influence without authority when stakes are high.

What we offer

Certain roles may be eligible for benefits and other compensation.

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal Software Engineering Manager - CoreAI

8 matching positions

Principal Software Engineering Manager-CoreAI

CoreAI is at the forefront of Microsoft’s mission to redefine how software is bu...
Location
Location
United States , Redmond
Salary
Salary:
165600.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Lead, grow, and coach a diverse and inclusive team of engineers to thrive in the fast-changing world of AI
  • Set technical and product direction for the team, aligning engineering investments with customer needs and business priorities
  • Create clarity and accountability by establishing goals, decision-making mechanisms, and execution rhythms that help the team deliver with predictability and impact
  • Build a culture of ownership, inclusion, and continuous growth by setting high standards, building sustainable systems, and reinforcing learning through regular feedback and reflection
  • Model and coach the team in AI-first engineering practices grounded in software engineering fundamentals, driving up both speed of execution and product quality
  • Champion a customer-obsessed culture by guiding the team to turn customer and developer feedback into innovative platform improvements that address real-world needs
  • Establish clear ownership and operating mechanisms that ensure live site health, effective incident response, and continuous improvement.
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager, Simulation Platform - CoreAI

The AI Frameworks team at Microsoft develops AI software that enables running AI...
Location
Location
United States , Multiple Locations
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, or related technical discipline
  • 5+ years of experience building/managing team of software engineers
  • 5+ years of experience managing a software project
  • 10+ years of experience in computer architecture and/or embedded systems/software
  • 10+ years of software development experience
  • 10+ years of experience with C++ based object-oriented programming and design
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • 1+ years’ experience with Python
  • A deep technical background and solid foundation in computer architecture, system/hardware simulation, embedded software development and/or firmware
  • Experience designing and/or managing large C++ OOP, scalable, multi-threaded and multi-process software
Job Responsibility
Job Responsibility
  • Managing a team of software engineers
  • Managing development of AI chip simulator, which involves writing requirements, scoping and planning solutions, estimating and assigning work, scheduling and tracking deliverables, integration and releases to partner team, documentation
  • Technical contribution to design, code quality reviews, and capable to step in with hands-on code development when necessary (C++ and Python)
  • Collaborate broadly across multiple disciplines and with various partner teams from hardware designers to AI models developers
  • Fulltime
Read More
Arrow Right

Principal Software Engineer Manager, CoreAI

Core AI is at the forefront of Microsoft's mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
165600.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Lead and Develop the Team - Manage and coach engineers across levels, foster collaboration and inclusion, and drive career growth through mentoring and feedback
  • Drive Strategic Clarity: Leverage data-driven insights and competitive intelligence to inform product direction, identify opportunities, and guide decision-making
  • Foster Engineering Alignment: Work with the engineering teams and partner organizations by driving clarity, alignment, and shared ownership of technical direction
  • Deliver Cohesive End-to-End Experiences: Collaborate closely with partner teams—including experience, SDK, and platform groups—to ensure seamless integration and delivery of features across the stack
  • Build Foundational Capabilities: Contribute to and lead the development of core platform components and reusable building blocks that accelerate team velocity and product innovation
  • Champion Customer-Centric Development: Engage directly with customers and product teams to capture feedback, understand demand signals, and refine product messaging—ensuring the voice of the customer shapes product evolution
  • Lead Live Site Excellence: Drive operational excellence in managing and operating large-scale distributed systems with a high bar for service-level agreements (SLAs). Lead root cause analyses (RCAs) for key live site incidents and outages, identify systemic improvements, and set high standards for reliability and performance
What we offer
What we offer
  • Benefits and other compensation
  • Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
  • Fulltime
Read More
Arrow Right

Principal Product Manager - CoreAI

At Microsoft, we are building a unified AI platform that enables developers and ...
Location
Location
United States , Redmond
Salary
Salary:
142800.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Own onboarding, execution, and lifecycle management of ISV partners, driving successful integration, adoption, and scale on Azure & Foundry while maintaining engagement through partner connects, executive syncs, and operational reviews
  • Act as the single point of contact for partner execution escalations, ensuring timely alignment and resolution across engineering, product, and field teams, while upholding execution accountability and delivery commitments
  • Lead Quarterly Business Reviews with executives from Microsoft & ISV, including preparation of business narratives, metrics tracking, and end-to-end follow-through on commitments and action items
  • Execute AI ISV ecosystem priorities by aligning partner capabilities with platform needs across AI, data, storage, networking, and observability, while coordinating closely with Category PMs, Engineering, Field Sales, EPS, and Marketing to deliver consistent partner experiences
  • Drive executive alignment with Microsoft and partner leadership on priorities and outcomes, while ensuring structured handoffs, clear ownership, seamless partner transitions, and proactive identification of risks, growth signals, and escalation trends to enable timely leadership intervention.
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - CoreAI

At CoreAI, we empower developers and organizations to shape the future with Arti...
Location
Location
United States , Redmond
Salary
Salary:
142800.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • 5+ years of experience leading software engineering and analytics projects that delivered measurable product and growth wins
  • Deep experience architecting and operating large scale data pipelines in cloud environment, preferably Azure
  • Ability to write clean, working code using core algorithms, data structures, and analytics-oriented problem-solving
  • Understanding of data governance, privacy, lineage, and security best practices, especially within highly regulated or enterprise environments
  • Excellent communication skills to convey complex technical concepts to both technical and non-technical audiences
  • Experience using AI tools in software engineering, data science, and analytics workflows
  • Experience both prototyping and deploying data products
Job Responsibility
Job Responsibility
  • Leads by example and mentors others to produce extensible and maintainable code used across the company
  • Leverages deep subject-matter expertise of cross-product features with appropriate stakeholders to lead multiple product's project plans, release plans, and work items
  • Own and define end-to-end data and analytics architecture for CoreAI and Foundry platforms, setting long-term technical direction for scalable, reliable, and cost-effective analytics supporting AI workloads
  • Design, build, and optimize large-scale, robust data pipelines and architectures that support CoreAI's analytics initiatives
  • Data Governance & Trust: follow best practices for data quality, lineage, security, and compliance
  • Collaborate with stakeholders to define trustworthy data sets and implement rigorous data validation protocols, ensuring CoreAI's analytics are both accurate and auditable
  • Analytics Enablement: Partner with data scientists, analysts, and business leaders to translate business needs into technical solutions
  • Enable self-service analytics and empower teams by building data models, semantic layers, and tools that streamline access to trusted information
  • Cross-Functional Collaboration: Work closely with product managers, software engineers, AI researchers, and business stakeholders to align data solutions with business goals
  • Contribute actively to the infrastructure and culture needed to scale quantity and quality of data insights across CoreAI
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, CoreAI Workload Engines

The CoreAI Workloads team builds the foundational inference engines and APIs tha...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 331200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field and 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python, or equivalent experience
  • Proven ability to design and operate large-scale, production inference services with high reliability and performance requirements, and to ship performance improvements safely via disciplined experimentation
  • Strong skills in performance analysis: benchmarking, profiling, diagnosing regressions, and turning results into concrete engine/runtime changes
  • Strong problem-solving skills and the ability to debug complex, cross layer systems issues
  • Demonstrated technical leadership, including mentoring engineers, driving cross-team architectural alignment, and leveraging AI tools and AI-assisted workflows to accelerate engineering velocity and quality
  • Hands-on experience with Kubernetes (building and operating services on k8s), including debugging production issues and designing platform abstractions (e.g., custom resources/controllers) and scheduling-aware deployments (e.g., node affinity, taints/tolerations, resource requests/limits)
  • Strong collaboration and communication skills, with the ability to work across organizational boundaries
Job Responsibility
Job Responsibility
  • Optimize inference engines for OpenAI and open-source models by implementing and shipping performance/efficiency improvements across runtime, scheduling, and serving paths (latency, throughput, utilization, availability, and cost)
  • Run experiments end-to-end: formulate hypotheses, implement engine changes (including Python/PyTorch integration points where relevant), analyze results, and ship improvements behind guardrails
  • Build and use experimentation capabilities for large-scale AI inference (experiment lifecycle, tracking, metric modeling, comparability standards, automated analysis) so the team can iterate quickly and safely
  • Own serving availability and efficiency for Azure OpenAI Service workloads through tiered experimentation, lean segmentation, and multi-modal utilization across heterogeneous fleets—turning findings into shipped engine improvements
  • Design and evolve inference serving architectures to improve utilization and latency using techniques such as disaggregated serving, multi-token prediction, KV offload/retrieval, and quantization—validated via staged rollouts and production guardrails
  • Extend AI infrastructure abstractions to support elastic, heterogeneous inference engines reliably at scale (e.g., dynamic scaling across model families, modalities, and workload classes while maintaining isolation and SLOs)
  • Tune and scale inference engines across NVIDIA GPU generations (A100, H100, H200) for state-of-the-art OpenAI models, focusing on serving efficiency, utilization, and reliability (not hardware bring-up)
  • Partner with networking and storage teams to leverage high-performance interconnects (e.g., RDMA/InfiniBand-class fabrics such as RoCE over IB) for distributed inference, without owning low-level kernel/driver enablement
  • Drive end-to-end features from design through production: observability, diagnostics, performance regression detection, and operational excellence for inference serving
  • Influence platform architecture and technical direction across teams through design reviews, clear metrics, and technical leadership focused on experimentation velocity and production reliability
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, CoreAI

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years
Job Responsibility
Job Responsibility
  • Shape the Product Vision: Define and influence the product roadmap by aligning technical strategy with business goals and customer needs
  • Drive Strategic Clarity: Leverage data-driven insights and competitive intelligence to inform product direction, identify opportunities, and guide decision-making
  • Architect for Scale and Sustainability: Design and evolve durable, scalable system architectures that balance long-term maintainability with short-term delivery needs, making thoughtful engineering trade-offs
  • Foster Engineering Alignment: Work with the engineering teams and partner organizations by driving clarity, alignment, and shared ownership of technical direction
  • Deliver Cohesive End-to-End Experiences: Collaborate closely with partner teams—including experience, SDK, and platform groups—to ensure seamless integration and delivery of features across the stack
  • Build Foundational Capabilities: Contribute to and lead the development of core platform components and reusable building blocks that accelerate team velocity and product innovation
  • Champion Customer-Centric Development: Engage directly with customers and product teams to capture feedback, understand demand signals, and refine product messaging—ensuring the voice of the customer shapes product evolution
  • Lead Live Site Excellence: Drive operational excellence in managing and operating large-scale distributed systems with a high bar for service-level agreements (SLAs). Lead root cause analyses (RCAs) for key live site incidents and outages, identify systemic improvements, and set high standards for reliability and performance
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - CoreAI

Software quality is being redefined by AI. As part of the Microsoft Playwright t...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Bachelor's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • 3+ years of experience with AI LLM models, such as OpenAI, Azure AI, ML
  • 3+ years of experience with browser engineering
  • 3+ years of experience with network security
Job Responsibility
Job Responsibility
  • Leads identification of dependencies and the development of design documents for a product, application, service, or platform
  • Leads by example and mentors others to produce extensible and maintainable code used across products
  • Leverages subject-matter expertise of cross-product features with appropriate stakeholders (e.g., project managers) to drive multiple group's project plans, release plans, and work items
  • Holds accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions
  • Proactively seeks new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and shares knowledge with other engineers
  • Fulltime
Read More
Arrow Right