CrawlJobs Logo

Senior Software Engineer, CoreAI

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Multiple Locations

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

119800.00 - 234700.00 USD / Year

Job Description:

Joining the CoreAI organization at Microsoft means becoming part of the team that builds the end-to-end AI stack powering Azure’s innovation. As a member of the FIT training team within CoreAI, you will help develop the AI infrastructure that accelerates the creation of agentic AI systems across Microsoft. This role is dedicated to advancing scientific methods and scalable infrastructure for training agentic models to achieve frontier-level performance. You will contribute to LLMs, SLMs, and agentic models using both proprietary and open-source frameworks, all aimed at delivering reliable, enterprise-grade agentic workflows.

Job Responsibility:

  • Collaboration with engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models
  • Design, build and improve services with high scalability and reliability
  • Design and implement the services to serve the prod traffic and fulfill the security and privacy requirements
  • Participate in efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments
  • Contribute to the deployment and monitoring of services in production environments

Requirements:

  • Bachelor's Degree in Computer Science or related technical field and 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python, or equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years

Nice to have:

  • Experience working with engineering teams to deliver large-scale software systems, preferably in AI, machine learning, graphics or related fields
  • Thrive in a fast-paced, collaborative environment and are comfortable making progress in ambiguity
  • Enjoy working closely with cross-functional partners and teammates in an inclusive, curious culture
  • Have strong opinions about best investments to make in establishing the most delightful and performant AI companion engineering system

Additional Information:

Job Posted:
March 19, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Software Engineer, CoreAI

New

Senior Software Engineer - CoreAI

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Go, Java, or Python
  • OR equivalent experience
  • 6+ years technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems
  • 1+ years of technical engineering experience with machine learning or Artificial Intelligence (AI) systems
Job Responsibility
Job Responsibility
  • Design, implement and deliver AI services to support product offerings for large-scale agent observability
  • Collaborate closely with product management and partner teams to align technical direction with business goals
  • Take end-to-end responsibility for the development lifecycle and production readiness of the services you build and drive the team’s DevOps culture
  • Engage with customers to gather feedback and resolve complex issues
  • Understand Microsoft businesses and collaborate with stakeholders towards cohesive, end-to-end experiences for Microsoft customers
  • Innovate on technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - CoreAI

Are you passionate about building high-performance, low-latency systems that pow...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 4+ years of experience with cloud platforms such as Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP)
  • 1+ years of proficiency with AI-assisted development tools (e.g., GitHub Copilot, IntelliCode)
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Own and operate highly scalable, reliable, and low-latency distributed systems that power mission-critical workloads
  • Design and implement features that enable configuration management, monitoring, analytics, and observability for modern cloud applications
  • Drive integration with other Azure services to deliver seamless customer experiences
  • Write high-quality, well-tested code and own the DevOps lifecycle, including monitoring, alerting, and incident response
  • Integrate AI-assisted development tools to improve engineering productivity and code quality
  • Contribute to AI-enhanced features using technologies such as Large Language Models (LLMs), Model Context Protocol (MCP) servers, and Retrieval-Augmented Generation (RAG)
  • Mentor others, fostering technical growth, promoting engineering best practices, and leading initiatives to enhance team capabilities and collaboration
  • MS Culture & Values: Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - CoreAI

The Azure Platform as a Service (PaaS) and Serverless team is building the next ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, JavaScript and/or Typescript and React OR equivalent experience
  • 2+ years of professional software engineering experience, with a focus on: Front-end or full-stack development
  • 6+ months of experience using AI-assisted development tools (e.g., GitHub Copilot, or similar) to enhance productivity and code quality
  • Build and service infrastructure systems maintenance and design Azure DevOps, GitHub Actions, or equivalent CICD pipeline frameworks
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Take on more complex technical challenges, lead feature areas from design through implementation, and contribute to shaping the long-term architecture of our portal experiences
  • Write high-quality, maintainable code and have deep involvement in all stages of product development—from customer feedback and prototyping to performance tuning and production readiness
  • Use AI-powered tools to accelerate development and build or integrate AI services directly into our products—enhancing diagnostics, recommendations, and the overall developer experience
  • Foster a culture of engineering excellence through design reviews, mentoring other engineers, and driving best practices in front-end development
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - CoreAI

The Azure AI Knowledge team is leading the way to deliver the next chapter in re...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, build, and maintain Azure backend services and associated APIs
  • Leverage AI Tooling to accelerate the delivery of production services
  • Partner with Applied Science to bring high quality prompts, ML models and pre and post processing components into production in a secure, reliable, and scalable way
  • Providing evaluation tooling and support of production integrations to ensure end-to-end AI quality of Applied Science deliverables
  • Focus on high quality goods which includes evaluation support
  • Understanding of state and state management for a production service at scale
  • Contribute to team plans, documents, and communication in a clear and efficient way
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Simulation Platform - CoreAI

The AI Frameworks team at Microsoft develops AI software that enables running AI...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Developing hardware simulator of next generation AI chips
  • Technical contribution to design, implementation, verification, and documentation of code ensuring on-time deliveries of simulator releases used daily by parter teams (C++ and Python)
  • Collaborate broadly across multiple disciplines and with various partner teams from hardware designers to AI models developers.
  • Identify requirements, scope solutions, estimate work, schedule deliverables.
  • Fulltime
Read More
Arrow Right

Software Engineer II, AI Data Platform (CoreAI)

The GenAI Infrastructure and Solutions team is building large-scale GenAI traini...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Collaborate with senior engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models
  • Design, build and improve the services with high scalability and reliability
  • Contribute to the deployment and monitoring of services in production environments
  • Participate in the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, CoreAI

Join Microsoft’s AI Core team building high performance runtime systems that ser...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in systems programming with strong expertise in C++
  • Proven experience building, deploying, and operating scalable cloud services
  • Strong debugging skills and experience using performance profiling and diagnostic tools
  • Hands-on experience with distributed systems, Kubernetes, and containerized workloads
  • Experience with largescale LLM inferencing infrastructure, including CUDA
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Design and implement high performance microservices and runtime components in C++
  • Optimize AI inferencing systems for latency, throughput, cost, and reliability at large scale
  • Debug and resolve complex production issues related to performance, scaling, and service reliability
  • Collaborate with cross-functional partners to integrate model inference pipelines into scalable infrastructure
  • Contribute to state-of-the-art multimodal inferencing systems supporting text, speech, and vision workloads
  • Drive systems level innovations for realtime and batch inferencing efficiency
  • Participate in code reviews and provide technical mentorship to senior and peer engineers
  • Fulltime
Read More
Arrow Right

Senior Product Manager - CoreAI

Microsoft’s mission is to empower every person and every organization on the pla...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 5+ years experience in product/service/program management or software development OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • 4+ years of product management experience in security, compliance, or developer tooling domains
  • Domain knowledge of software supply chain security, including risks associated with open source package consumption
  • Hands‑on experience with AI models applied to security risk detection and remediation
  • Understanding of DevOps lifecycle and modern engineering practices
  • Track record of delivering complex, cross‑company initiatives with measurable impact
  • Communication and collaboration skills, with the ability to influence senior stakeholders across engineering and compliance
  • Experience of using and managing security aspects of MCP servers
Job Responsibility
Job Responsibility
  • Drive product vision and strategy for software supply chain security within 1ES, specifically for securing AI agents, MCP servers, and ensuring alignment with Microsoft’s compliance and security goals
  • Lead AI‑assisted risk remediation across Microsoft repositories, defining requirements and guiding engineering execution
  • Develop deep insights into open source consumption patterns, specifically across NuGet, NPM, PyPI, Maven, Cargo, and Go ecosystems, to inform risk mitigation strategies
  • Collaborate across engineering, security, compliance, and legal teams to ensure solutions meet both technical and regulatory requirements
  • Define success metrics and outcomes, track progress, and iterate based on data‑driven insights
  • Champion secure DevOps practices, integrating supply chain security into the full lifecycle of software development
  • Fulltime
Read More
Arrow Right