CrawlJobs Logo

Principal Software Engineer, CoreAI

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

139900.00 - 274800.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

Join Microsoft’s AI Core team building high performance runtime systems that serve OpenAI chat and multimodal AI models at scale. This role focuses on systems level optimization for large scale LLM inferencing with deep C++ expertise.

Job Responsibility:

  • Design and implement high performance microservices and runtime components in C++
  • Optimize AI inferencing systems for latency, throughput, cost, and reliability at large scale
  • Debug and resolve complex production issues related to performance, scaling, and service reliability
  • Collaborate with cross-functional partners to integrate model inference pipelines into scalable infrastructure
  • Contribute to state-of-the-art multimodal inferencing systems supporting text, speech, and vision workloads
  • Drive systems level innovations for realtime and batch inferencing efficiency
  • Participate in code reviews and provide technical mentorship to senior and peer engineers

Requirements:

  • 6+ years of experience in systems programming with strong expertise in C++
  • Proven experience building, deploying, and operating scalable cloud services
  • Strong debugging skills and experience using performance profiling and diagnostic tools
  • Hands-on experience with distributed systems, Kubernetes, and containerized workloads
  • Experience with largescale LLM inferencing infrastructure, including CUDA
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice to have:

  • Experience optimizing AI model inference distributed GPU/CPU stack
  • Exposure to Azure OpenAI or similar largescale AI serving platforms
  • Understanding of service reliability engineering (SRE) principles and operational excellence

Additional Information:

Job Posted:
January 18, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Microsoft Corporation - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Software Engineer, CoreAI

New

Principal Software Engineer, CoreAI

The GenAI Infrastructure and Solutions team is building large-scale GenAI traini...
Location
Location
United States , Redmond
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field and 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python or equivalent experience.
  • 6+ years designing, developing, and shipping high quality software.
  • 3+ years of experience with distributed systems and cloud-based infrastructure.
  • 2+ years of experience with containerization tools (e.g., Docker, Kubernetes).
  • 2+ years of experience with DevOps practices (CI/CD, automated testing, deployment, etc.).
  • Passionate and self-motivated. Strong ability in self-learning, entering new domain, managing through uncertainty in an innovative team environment.
  • Familiarity with virtualization technology.
  • Familiarity with production ML systems and concepts like model serving, caching, batching, and monitoring.
Job Responsibility
Job Responsibility
  • Lead the collaboration with engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models.
  • Design, build and improve services with high scalability and reliability.
  • Design and implement the services to serve the prod traffic and fulfill the security and privacy requirements.
  • Lead the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments.
  • Contribute to the deployment and monitoring of services in production environments.
  • Fulltime
Read More
Arrow Right

Principal Software Engineer (CoreAI)

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Strong advocate for AI-first development with hands-on experience leveraging AI tools to accelerate engineering productivity
  • 6+ years technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems
  • 1+ years of technical engineering experience with machine learning or Artificial Intelligence (AI) systems
Job Responsibility
Job Responsibility
  • Define technical vision and drive strategic direction for Microsoft Foundry's enterprise platform
  • Design and develop platform services including agent tooling frameworks, authentication flows, and control plane APIs
  • Deliver unified APIs and advanced security features (private networking, data encryption, cache resiliency)
  • Lead cross-org collaboration with partner teams across Azure, M365, and Security to deliver end-to-end solutions
  • Champion AI-first development practices and serve as a role model for leveraging AI to accelerate innovation and productivity
  • Drive livesite excellence through infrastructure reliability and operational excellence
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - CoreAI

The CoreAI organization at Microsoft builds the end-to-end Azure AI stack/PaaS a...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Lead architecture design, testing, and security compliance for products
  • Create design documents, oversee team efforts, and ensure test coverage, automation, and quality assurance
  • Address system dependencies and enable cross-team collaboration
  • Collaborate with stakeholders to identify user requirements, incorporate continuous feedback, and define critical metrics for product improvement and customer value
  • Mentor others in producing high-quality, maintainable code
  • Optimize, debug, and establish best practices
  • Conduct code reviews to ensure adherence to standards and resolve issues proactively using telemetry and diagnostics
  • Drive project planning, experimentation, and solution deployment
  • Optimize implementations to meet business objectives and ensure safe deployments while considering broader system impacts
  • Manage live service operations, resolve complex incidents, and create playbooks for issue resolution
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Growth (CoreAI)

We’re building AI‑first growth and experimentation systems that scale across Mic...
Location
Location
United States , Mountain View
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Own growth through engineering excellence and experimentation — at a systems level
  • Architect and build paved paths for online experimentation: standardized metrics, guardrails, analysis workflows, and rollout automation that improve reliability and decision quality across teams
  • Lead multi‑workstream initiatives that span teams/products (e.g., unified growth measurement, cross‑surface funnels, experimentation quality improvements)
  • Build and evolve core capabilities: telemetry foundations, experiment assignment/targeting, feature flighting, and risk controls (kill‑switches, guardrails, progressive delivery)
  • Partner with Product, Data Science, Design, and Research to turn ambiguous goals into shippable, measurable systems
  • Stay close to the work: write production code, review designs/PRs, and coach others through architecture and implementation tradeoffs
  • Fulltime
Read More
Arrow Right

Principal Software Architect - CoreAI

Are you passionate about making Artificial Intelligence (AI) systems security, t...
Location
Location
United States , Multiple Locations
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, or related technical discipline or equivalent experience AND 8+ years of technical engineering experience with coding in languages including, but not limited to, C++, C#, Go, Java, or Python
  • 6+ years technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems
  • Experience designing AI powered products and services
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Architect, design, and develop large-scale distributed cloud services and solutions with a focus on high availability, scalability, robustness, and observability
  • Lead project development across the organization and work with subject matter experts and stakeholders to drive development and release plans
  • Evaluate alternative architectures and technologies that best fit the business requirements and service KPIs
  • Take end-to-end responsibility for the development lifecycle and production readiness of the services you build and drive the team’s DevOps culture
  • Drive and uphold the best practices of modern software engineering through code and design reviews and take effective service decisions based on data and telemetry
  • Understand Microsoft businesses and collaborate with stakeholders towards cohesive, end-to-end experiences for Microsoft customers
  • Embrace a growth mindset and stay up to date with the current and state-of-the-art technologies to improve customer experience and better serve the product’s business needs
  • Fulltime
Read More
Arrow Right
New

Principal ML Engineer, CoreAI

You’ll help build core generative AI and multimodal capabilities that power cust...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field and 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python or equivalent experience
  • Advanced degree in Computer Science, Machine Learning, or related field
  • Demonstrated technical leadership through influence (e.g., leading designs, setting architecture direction, mentoring engineers)
  • Experience with prompt engineering, retrieval-augmented generation (RAG), and memory/agent frameworks
  • Experience building and shipping generative AI systems (including multimodal scenarios)
  • Familiarity with compliance and security standards in enterprise AI solutions
  • Track record of delivering enterprise-facing AI products at scale
  • Experience building and operating ML/AI systems in cloud environments
  • familiarity with MLOps practices (Azure a plus)
  • Experience partnering with cross-functional stakeholders to define requirements and drive technical decisions
Job Responsibility
Job Responsibility
  • Design, build, and operate production-grade generative AI and multimodal systems, with end-to-end ownership from concept through deployment and service operations
  • Lead technical design for core GenAI capabilities (e.g., retrieval-augmented generation, context and memory, orchestration) and make data-driven tradeoffs across quality, latency, cost, and safety
  • Define and improve model and system quality using evaluation frameworks, experiment design, and production telemetry
  • ensure robust testing and regression coverage
  • Collaborate with security, privacy, and compliance partners to build solutions that meet enterprise requirements and align with Responsible AI standards and practices
  • Provide technical leadership across teams by setting direction, reviewing designs, unblocking execution, and mentoring engineers on architecture, coding standards, and ML engineering best practices
  • Partner with product and customers to understand scenarios, translate requirements into well-designed APIs and developer experiences, and drive adoption through documentation and samples
  • Fulltime
Read More
Arrow Right

Principal Product Manager - CoreAI

The Microsoft CoreAI team is at the forefront of the AI revolution, and the Foun...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • 2+ years of experience working with developer tools, cloud platforms (Azure/AWS/GCP), or AI/Machine Learning technologies
  • Demonstrated understanding of the current AI landscape, including experience with LLMs, Agentic frameworks (e.g., LangChain, Agent Framework), or prompt engineering
  • Experience shipping B2B or enterprise-grade software, with a grasp of security, compliance, and governance needs
  • DevEx Passion, specifically empathy for developers and experience building APIs, SDKs, or CLI tools
  • Proven ability to work in an ambiguous environment where requirements evolve rapidly
  • Exceptional storytelling skills, with the ability to communicate complex technical concepts to both engineering teams and business executives
Job Responsibility
Job Responsibility
  • Product Strategy & Roadmap: Define and drive the product vision for key workstreams in Foundry Agent Service, focusing on enterprise requirements and developer ergonomics. Translate complex AI agent patterns into a cohesive, intuitive product roadmap
  • Customer-First Innovation: Engage directly with enterprise customers and internal adopters to understand their friction points in building agents. Translate these insights into features that solve for reliability, security, and scalability
  • Developer Experience (DevEx): Champion a "delightful" developer journey. Ensure our integration with VS Code, GitHub, and Azure CLI is seamless, allowing developers to iterate fast and deploy with confidence
  • Cross-Team Orchestration: Partner closely with engineering, design, and counterparts in GitHub, M365, and Core AI to deliver a unified platform. Navigate ambiguity to align stakeholders on shared outcomes
  • Hands-on Technical Leadership: Actively use the product to build your own agents. Stay ahead of the curve on agentic workflows (e.g., LangGraph, Copilot CLI) and leverage AI in your daily workflows to demonstrate "customer zero" behavior
  • Go-to-Market Support: Collaborate with PMM and documentation teams to create compelling demos, tutorials, and messaging that showcase the power of the platform
  • Fulltime
Read More
Arrow Right

Principal Product Manager - Microsoft Foundry (CoreAI)

We are building the industry’s leading AI-first application stack with enhanced ...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Lead the model launch program for OpenAI models
  • Drive the model release backlog and roadmap
  • Ensure Microsoft Engineering teams can release with the newest models on the same day
  • OpenAI Knowledge Transfer program owner
  • Improve the launch program investing in clear metrics, automation, and operating models
  • Collaborate with engineering, marketing, sales, and support to delivery successful launches
  • Provide clarity in ambiguous environments, influence stakeholders, and foster a culture of innovation and accountability
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy