CrawlJobs Logo
Microsoft Corporation Logo Microsoft Corporation · IT - Software Development

Senior Software Engineer - CoreAI

United States, Redmond 119800.00 - 234700.00 USD / Year · Job Posted March 05, 2026
Apply Position
Job Link Share

Job Description

Are you passionate about building high-performance, low-latency systems that power mission-critical workloads? The Azure Dev Services team delivers a suite of fully managed Azure services including Azure App Configuration, Azure Managed Grafana, Azure Managed Redis, and Azure Diagnostics that help developers build, monitor, and scale modern cloud applications with confidence. As a Senior Software Engineer on the Azure Dev Services team, you’ll take ownership of key product areas, collaborate across Azure, take a leading role in product development, and help shape the future of developer infrastructure and observability. This opportunity will allow you to deepen your distributed systems expertise, work with cutting-edge Artificial Intelligence (AI) technologies, and grow your impact across Azure. This role is part of a dynamic and collaborative team in the Developer Division under the CoreAI business group.

Job Responsibility

  • Own and operate highly scalable, reliable, and low-latency distributed systems that power mission-critical workloads
  • Design and implement features that enable configuration management, monitoring, analytics, and observability for modern cloud applications
  • Drive integration with other Azure services to deliver seamless customer experiences
  • Write high-quality, well-tested code and own the DevOps lifecycle, including monitoring, alerting, and incident response
  • Integrate AI-assisted development tools to improve engineering productivity and code quality
  • Contribute to AI-enhanced features using technologies such as Large Language Models (LLMs), Model Context Protocol (MCP) servers, and Retrieval-Augmented Generation (RAG)
  • Mentor others, fostering technical growth, promoting engineering best practices, and leading initiatives to enhance team capabilities and collaboration
  • MS Culture & Values: Embody our Culture and Values

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 4+ years of experience with cloud platforms such as Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP)
  • 1+ years of proficiency with AI-assisted development tools (e.g., GitHub Copilot, IntelliCode)
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Experience with .NET is a plus
  • Experience developing, deploying, or integrating AI-powered solutions in production environments
  • Experience building or integrating AI applications using technologies such as LLMs, Model Context Protocol (MCP) servers, or RAG pipelines
  • Working knowledge of web and cloud technologies, including containers, microservices, and CI/CD pipelines
  • Familiarity with distributed systems, cloud-native architectures, or managed cloud services
Microsoft Corporation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Software Engineer - CoreAI

8 matching positions

Senior Software Engineer - CoreAI

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Go, Java, or Python
  • OR equivalent experience
  • 6+ years technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems
  • 1+ years of technical engineering experience with machine learning or Artificial Intelligence (AI) systems
Job Responsibility
Job Responsibility
  • Design, implement and deliver AI services to support product offerings for large-scale agent observability
  • Collaborate closely with product management and partner teams to align technical direction with business goals
  • Take end-to-end responsibility for the development lifecycle and production readiness of the services you build and drive the team’s DevOps culture
  • Engage with customers to gather feedback and resolve complex issues
  • Understand Microsoft businesses and collaborate with stakeholders towards cohesive, end-to-end experiences for Microsoft customers
  • Innovate on technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - CoreAI

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years
Job Responsibility
Job Responsibility
  • Shape the Product Vision: Define and influence the product roadmap by aligning technical strategy with business goals and customer needs.
  • Drive Strategic Clarity: Leverage data-driven insights and competitive intelligence to inform product direction, identify opportunities, and guide decision-making.
  • Architect for Scale and Sustainability: Design and evolve durable, scalable system architectures that balance long-term maintainability with short-term delivery needs, making thoughtful engineering trade-offs.
  • Foster Engineering Alignment: Work with the engineering teams and partner organizations by driving clarity, alignment, and shared ownership of technical direction.
  • Deliver Cohesive End-to-End Experiences: Collaborate closely with partner teams—including experience, SDK, and platform groups—to ensure seamless integration and delivery of features across the stack.
  • Build Foundational Capabilities: Contribute to and lead the development of core platform components and reusable building blocks that accelerate team velocity and product innovation.
  • Champion Customer-Centric Development: Engage directly with customers and product teams to capture feedback, understand demand signals, and refine product messaging—ensuring the voice of the customer shapes product evolution.
  • Lead Live Site Excellence: Drive operational excellence in managing and operating large-scale distributed systems with a high bar for service-level agreements (SLAs). Lead root cause analyses (RCAs) for key live site incidents and outages, identify systemic improvements, and set high standards for reliability and performance.
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - CoreAI

Within the CoreAI organization, the Azure Managed Redis team is responsible for ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Lead architecture, design, and technical direction for the runtime infrastructure of Azure Managed Redis
  • Design and build robust deployment, upgrade, and orchestration systems for distributed Redis clusters running across 70+ Azure regions worldwide
  • Drive the integration of Redis Enterprise software from Redis Inc. into Azure's managed environment
  • Architect the end-to-end release platform across infrastructure, application, and observability layers to accelerate release velocity and improve deployment safety
  • Write high-quality, production-grade code in languages such as C# and Go while modeling best practices for reliability, testability, and operational excellence
  • Lead design and review of testing strategies with strong coverage across unit, integration, and end-to-end system tests for distributed infrastructure
  • Apply AI techniques (e.g., GitHub Copilot, LLMs, anomaly-detection models) to enhance DevOps, operations, and engineering workflows
  • Build and improve observability, monitoring, and diagnostics tooling to enable rapid incident detection, root-cause analysis, and self-healing capabilities at scale
  • Mentor engineers on distributed systems design patterns, operational best practices, and verification strategies
  • Set high standards for code reviews, diagnosability, and maintainability across the team
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - CoreAI

The Azure Platform as a Service (PaaS) and Serverless team is building the next ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, JavaScript and/or Typescript and React OR equivalent experience
  • 2+ years of professional software engineering experience, with a focus on: Front-end or full-stack development
  • 6+ months of experience using AI-assisted development tools (e.g., GitHub Copilot, or similar) to enhance productivity and code quality
  • Build and service infrastructure systems maintenance and design Azure DevOps, GitHub Actions, or equivalent CICD pipeline frameworks
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Take on more complex technical challenges, lead feature areas from design through implementation, and contribute to shaping the long-term architecture of our portal experiences
  • Write high-quality, maintainable code and have deep involvement in all stages of product development—from customer feedback and prototyping to performance tuning and production readiness
  • Use AI-powered tools to accelerate development and build or integrate AI services directly into our products—enhancing diagnostics, recommendations, and the overall developer experience
  • Foster a culture of engineering excellence through design reviews, mentoring other engineers, and driving best practices in front-end development
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - CoreAI

The Azure AI Knowledge team is leading the way to deliver the next chapter in re...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, build, and maintain Azure backend services and associated APIs
  • Leverage AI Tooling to accelerate the delivery of production services
  • Partner with Applied Science to bring high quality prompts, ML models and pre and post processing components into production in a secure, reliable, and scalable way
  • Providing evaluation tooling and support of production integrations to ensure end-to-end AI quality of Applied Science deliverables
  • Focus on high quality goods which includes evaluation support
  • Understanding of state and state management for a production service at scale
  • Contribute to team plans, documents, and communication in a clear and efficient way
  • Fulltime
Read More
Arrow Right

Software Engineer / Senior Software Engineer - CoreAI

Azure DevOps is a suite of modern development services that enables software dev...
Location
Location
Czech Republic , Prague
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid software development experience
  • Demonstrable experience with C#, C++, Java or any other OOP language
  • Strong analytical skills as well as communication skills both verbal and written
  • Ability to understand unfamiliar code bases, debug client and service side applications (including database stored procedures)
  • Knowledge and experience with Microsoft Azure, AWS or similar cloud computing platforms is preferred
  • Experience with SQL performance tuning (preferably Microsoft SQL Server)
  • Solid understanding of testing principles
  • Ability to prioritize and handle multiple tasks completely and independently and generate clarity in ambiguous situations
  • Troubleshooting skills across network, application, caching, queuing, load-balancing storage and distributed services layers
Job Responsibility
Job Responsibility
  • Design, develop, test and support features, experiences
  • Collaborate on the design and development of features and solutions, contributing to technical direction across business scenarios
  • Support highly available services used by top companies and millions of developers on a daily basis
  • Troubleshooting of complex issues through the entire tech stack including frontend and database layers
  • Participate in on-call rotations with your team. Triage and respond to issues and advocate for opportunities to improve service health
  • Collaborate through pairing and code reviews and contribute to a culture of learning and growth
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, CoreAI Workload Engines

The CoreAI Workloads team builds the foundational inference engines and APIs tha...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field and 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python, or equivalent experience.
  • Proven ability to design and operate large-scale, production inference services with high reliability and performance requirements, and to ship performance improvements safely via disciplined experimentation.
  • Strong skills in performance analysis: benchmarking, profiling, diagnosing regressions, and turning results into concrete engine/runtime changes.
  • Strong problem-solving skills and the ability to debug complex, cross layer systems issues.
  • Demonstrated technical leadership, including mentoring engineers, driving cross-team architectural alignment, and leveraging AI tools and AI-assisted workflows to accelerate engineering velocity and quality.
  • Hands-on experience with Kubernetes (building and operating services on k8s), including debugging production issues and designing platform abstractions (e.g., custom resources/controllers) and scheduling-aware deployments (e.g., node affinity, taints/tolerations, resource requests/limits).
  • Strong collaboration and communication skills, with the ability to work across organizational boundaries.
Job Responsibility
Job Responsibility
  • Optimize inference engines for OpenAI and open-source models by implementing and shipping performance/efficiency improvements across runtime, scheduling, and serving paths (latency, throughput, utilization, availability, and cost).
  • Run experiments end-to-end: formulate hypotheses, implement engine changes (including Python/PyTorch integration points where relevant), analyze results, and ship improvements behind guardrails.
  • Build and use experimentation capabilities for large-scale AI inference (experiment lifecycle, tracking, metric modeling, comparability standards, automated analysis) so the team can iterate quickly and safely.
  • Own serving availability and efficiency for Azure OpenAI Service workloads through tiered experimentation, lean segmentation, and multi-modal utilization across heterogeneous fleets—turning findings into shipped engine improvements.
  • Design and evolve inference serving architectures to improve utilization and latency using techniques such as disaggregated serving, multi-token prediction, KV offload/retrieval, and quantization—validated via staged rollouts and production guardrails.
  • Extend AI infrastructure abstractions to support elastic, heterogeneous inference engines reliably at scale (e.g., dynamic scaling across model families, modalities, and workload classes while maintaining isolation and SLOs).
  • Tune and scale inference engines across NVIDIA GPU generations (A100, H100, H200) for state-of-the-art OpenAI models, focusing on serving efficiency, utilization, and reliability (not hardware bring-up).
  • Partner with networking and storage teams to leverage high-performance interconnects (e.g., RDMA/InfiniBand-class fabrics such as RoCE over IB) for distributed inference, without owning low-level kernel/driver enablement.
  • Drive end-to-end features from design through production: observability, diagnostics, performance regression detection, and operational excellence for inference serving.
  • Influence platform architecture and technical direction across teams through design reviews, clear metrics, and technical leadership focused on experimentation velocity and production reliability.
What we offer
What we offer
  • Benefits and other compensation
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - CoreAI Model Inference & Serving

Join our team within CoreAI, where we are building the AI data-plane that powers...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Java
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • 4+ years of design and problem-solving experience, with understanding of system performance, scalability, and engineering best practices
  • Understanding of distributed systems specifically in request serving at scale
  • (e.g. inferencing, L7 gateways, high-performance storage, distributed databases across global-scale infrastructure)
  • Demonstrated experience in building high-quality, reliable systems at scale
  • Experience using modern AI-assisted development tools and workflows to move faster, improve quality, and amplify engineering impact
  • Customer-obsessed approach to problem solving, with empathy and a drive to deliver impactful solutions
Job Responsibility
Job Responsibility
  • Be a hands-on technical leader, designing, coding, and shipping core serving systems, smart routing, and request distribution for a broad portfolio of LLMs
  • Build large-scale AI services and platform capabilities that power new products and customer experiences
  • Drive cutting-edge innovation in AI systems alongside world-class engineers and cross-functional partners
  • Lead through architecture, code reviews, mentorship, and technical excellence while staying close to implementation
  • Improve reliability, scalability, observability, efficiency, and performance across mission-critical services
  • Fulltime
Read More
Arrow Right