CrawlJobs Logo

Software Engineer II - CoreAI

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

100600.00 - 199000.00 USD / Year

Job Description:

Within Microsoft CoreAI, the Azure SRE Agent Platform team builds and operates production AI agents that help engineers detect, diagnose, and mitigate reliability issues across Azure services and customer workloads. Our work turns modern AI systems into reliable, production-grade operational tooling for AI ops scenarios, with a focus on quality, safety, and real-world impact. We are looking for a Software Engineer II to help build the next generation of agentic systems for cloud operations. This role is for engineers who care deeply about product quality, end-to-end ownership, and the details that separate an exciting prototype from a system people trust during critical moments. Our work spans the full lifecycle of agentic systems in production. We design and improve the core capabilities that shape agent behavior, including tool design, planning and execution loops, orchestration, evaluation, and safety guardrails. We also build the operational foundations that make those systems dependable in practice, including observability, progressive delivery, reliability engineering, and live-site learning. Engineers on this team operate with high autonomy in a highly agile environment: short cycles, thin slices, feature flags, progressive delivery, and constant learning. We are looking for people with high agency and a strong bias for action - engineers who take ownership of ambiguous problems, move quickly, learn from production, and continuously raise the quality bar as they ship.

Job Responsibility:

  • Take ownership of important areas of the Azure SRE Agent Platform, including agent capabilities, orchestration, evaluation, and supporting platform services
  • Build and iterate on agentic systems, including tools, planning and execution loops, evaluations, and safety mechanisms
  • Design and ship reliable capabilities that improve incident detection, diagnosis, mitigation, and operational learning
  • Use telemetry, experiments, evaluations, and user feedback to guide iteration and investment
  • Contribute to resilient, observable systems that operate safely and effectively in production
  • Partner closely with engineers, SREs, and product counterparts to turn ambiguous problems into high-quality shipped solutions
  • Participate in debugging, live-site learning, and post-incident hardening to continuously improve system quality
  • Contribute to architecture, engineering standards, and development practices across the team

Requirements:

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have:

  • Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Hands-on experience building and operating generative AI or agentic systems in production, with direct ownership over quality, reliability, and iteration
  • 3+ years of experience building and operating cloud platforms or distributed services, with depth in service architecture, deployment, and observability
  • Strong product mindset with a track record of owning ambiguous problem spaces and driving them to high-quality outcomes
  • Solid engineering fundamentals, including systems design, performance, and debugging in complex production environments
  • Experience designing, running, and optimizing evaluations for agentic systems, including tools, prompts, and agent loops
  • Experience with Kubernetes, container orchestration, or cloud-native infrastructure is a strong plus
  • Experience contributing to or leading open-source projects at scale is a plus

Additional Information:

Job Posted:
March 21, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer II - CoreAI

New

Software Engineer II - CoreAI

Are you passionate about building high-performance, low-latency systems that pow...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Own and operate highly scalable, reliable, and low-latency distributed systems that power mission-critical workloads
  • Design and implement features that enable configuration management, monitoring, analytics, and observability for modern cloud applications
  • Drive integration with other Azure services to deliver seamless customer experiences
  • Write high-quality, well-tested code and own the DevOps lifecycle, including monitoring, alerting, and incident response
  • Integrate AI-assisted development tools to improve engineering productivity and code quality
  • Contribute to AI-enhanced features using technologies such as Large Language Models (LLMs), Model Context Protocol (MCP) servers, and Retrieval-Augmented Generation (RAG)
  • Mentor others and share knowledge to improve team capabilities and engineering practices
  • Fulltime
Read More
Arrow Right
New

Software Engineer II - CoreAI

App Service is a platform-as-a-service (PaaS) offering and one of the top servic...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Manage deployment and buildout of the services
  • Troubleshoot production issues
  • Automate manual processes
  • Support on-call rotations every few months
  • Write technical support guides, incident post-mortems, deployment documentation, and other types of technical documents
  • Ensure security and compliance
  • Collaborate with other Azure teams
  • Fulltime
Read More
Arrow Right

Software Engineer II - CoreAI

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Drive the creation of feature designs and lead design discussions with team members, leveraging your expertise to make informed decisions that align with the overall product vision
  • Participate in code reviews to maintain a high standard of code quality and consistency across the codebase, providing constructive feedback and guidance to team members
  • Implement comprehensive unit and functional tests, ensuring robust test coverage and reliability of the codebase, and deploy production bits to the Azure environment with a focus on automation and scalability
  • Establish and maintain telemetry to monitor usage and performance, proactively identifying and addressing potential issues to ensure optimal service delivery and customer satisfaction
  • Respond to incidents in a timely manner, working with cross-functional teams to mitigate impact and restore service availability, and contribute to the ongoing operation of the services in a cost-effective manner
  • Contribute to and collaborate on open-source projects, sharing knowledge and expertise with the broader developer community, and leveraging external contributions to enhance our offerings
  • Collaborate with Grafana Labs to enhance security and enrich features based on customer scenarios, leveraging their expertise to drive continuous improvement and innovation in our offerings
  • Fulltime
Read More
Arrow Right

Software Engineer II, AI Data Platform (CoreAI)

The GenAI Infrastructure and Solutions team is building large-scale GenAI traini...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Collaborate with senior engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models
  • Design, build and improve the services with high scalability and reliability
  • Contribute to the deployment and monitoring of services in production environments
  • Participate in the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments
  • Fulltime
Read More
Arrow Right
New

Software Engineer II, Agent Services (CoreAI)

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Shape the Product Vision: Define and influence the product roadmap by aligning technical strategy with business goals and customer needs
  • Drive Strategic Clarity: Leverage data-driven insights and competitive intelligence to inform product direction, identify opportunities, and guide decision-making
  • Architect for Scale and Sustainability: Design and evolve durable, scalable system architectures that balance long-term maintainability with short-term delivery needs, making thoughtful engineering trade-offs
  • Foster Engineering Alignment: Build consensus across engineering teams and partner organizations by driving clarity, alignment, and shared ownership of technical direction
  • Deliver Cohesive End-to-End Experiences: Collaborate closely with partner teams—including experience, SDK, and platform groups—to ensure seamless integration and delivery of features across the stack
  • Build Foundational Capabilities: Contribute to and lead the development of core platform components and reusable building blocks that accelerate team velocity and product innovation
  • Champion Customer-Centric Development: Engage directly with customers and product teams to capture feedback, understand demand signals, and refine product messaging—ensuring the voice of the customer shapes product evolution
  • Lead Live Site Excellence: Drive operational excellence in managing and operating large-scale distributed systems with a high bar for service-level agreements (SLAs). Lead root cause analyses (RCAs) for key live site incidents and outages, identify systemic improvements, and set high standards for reliability and performance
  • Fulltime
Read More
Arrow Right
New

Software Engineer II - CoreAI

Do you want to work on the .NET Roslyn Team as a Software Engineer II building l...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • 4+ years of experience programming and unit testing commercial software in one of the following programming languages – C#, VB.NET, Java or C++
  • 6+ months of experience using AI-assisted development tools (e.g., GitHub Copilot, or similar) to enhance productivity and code quality
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Use creativity, teamwork, and accountability to master new complex technical areas that build best in class C# developer productivity features
  • Design, develop and test new features and bug fixes for IDEs like VS and VS Code
  • Analyze how your code and features are performing in production
  • Participate in your team’s sprint and product direction planning activities
  • Collaborate with partner teams in both open and closed source to solve challenging architectural problems
  • Use Copilot to enhance AI driven feature enhancements
  • Stay up to date on .NET platform and ecosystem developments
  • Fulltime
Read More
Arrow Right

Software Engineer II - CoreAI

As an AI Engineer on the CoreAI Platform team, you will apply artificial intelli...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, build, and scale AI models to detect anomalies, identify regressions across large-scale AI systems
  • Analyze patterns in telemetry, logs, and real‑time signals to uncover root causes, predict failures, and drive proactive mitigations
  • Apply AI to identify emerging usage trends, performance hotspots, and workload irregularities that impact system health and user experience
  • Build lightweight automation that leverages anomaly detection signals and pattern analysis to improve live‑site reliability and engineering velocity
  • Contribute to hotfixes, performance tuning, and reliability improvements in production AI engines (e.g., GPU savings, SLA reliability, customer satisfaction)
  • Build intuitive, responsive UI components for AI dashboards and telemetry tools using React and modern web technologies
  • Communicate technical concepts with clarity and initiative, proactively seeking feedback and driving continuous improvement
  • Stay current with industry trends in applied AI, observability, and performance engineering
  • Fulltime
Read More
Arrow Right
New

Product Manager II - Foundry Model Inference (CoreAI)

We are building the industry’s leading AI-first application stack with enhanced ...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree AND 2+ years experience in product/service/project/program management or software development
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Develop the product offerings that span across the model portfolio in Foundry
  • Identify high-impact opportunities to increase quality across internal and external customer segments
  • Define and track quality metrics, manage dependencies, and lead experimentation to validate Foundry Models quality proposition
  • Collaborate with engineering, marketing, and go-to-market teams to deliver integrated solutions
  • Develop compelling product narratives and performance dashboards for executive-level communication and decision-making
  • Provide clarity in ambiguous environments, influence stakeholders, and foster a culture of innovation and accountability
  • Fulltime
Read More
Arrow Right