CrawlJobs Logo
Microsoft Corporation Logo Microsoft Corporation · IT - Software Development

Software Engineer 2 - Core AI

China, Beijing · Job Posted March 03, 2026
Apply Position
Job Link Share

Job Description

The Experimentation Platform (ExP) team powers Microsoft’s end-to-end experimentation ecosystem, enabling product teams across the company—including Copilot, Bing, Office, Windows, Edge, Xbox, and Azure — to make data-driven decisions at massive scale. We build the experimentation framework, compute platform, data pipelines, agent-driven automation and insights and that run millions of experiments each year. We focus on delivering world-class reliability, scalable experiment execution, transparent compute fundamentals, automated workflows, and AI-assisted agentic capabilities that accelerate experimentation velocity across Microsoft. This role offers the opportunity to build modern user experience, high-performant distributed systems, modernize a mission-critical experimentation stack, integrate AI-driven agents, and improve end-to-end fundamentals such as efficiency, observability, and resiliency. As a platform software Engineer, you’ll collaborate with cross-functional teams across engineering, data science, and AI to deliver a seamless experimentation experience at global scale.

Job Responsibility

  • Design and build components of the experimentation platform, including large-scale data pipelines, metrics/analysis authoring, distributed workflows, and critical experiment lifecycle services
  • Develop high-performance and reliable systems using C#, .NET, Spark pipelines, Azure services, and modern data/compute frameworks
  • Integrate AI-driven agents and automation to improve debugging, monitoring, validation, and self-service capabilities for experiment owners
  • Optimize efficiency, cost, resource utilization, and pipeline throughput across a global fleet
  • Improve platform fundamentals including observability, reliability, test automation and recovery workflows
  • Collaborate with PMs, data scientists, platform engineers, and partner teams (across global Microsoft engineering centers) to design scalable solutions
  • Participate in code reviews, incident response, performance tuning, and architectural discussions
  • Engineer features with a strong focus on quality, transparency, resiliency, and operational excellence

Requirements

  • 4+ years of experience in software engineering OR equivalent experience
  • Strong coding skills in one or more languages: C#, Java, Scala, Python, or C++
  • Proven ability to design and deliver components of large distributed systems or data platforms
  • Solid understanding of data structures, algorithms, distributed system fundamentals, and debugging complex systems
  • Fast learner with strong communication skills and the ability to work effectively across teams

Nice to have

  • AI native, embrace AI agents in everyday job. Hands-on experience with Github Copilot, Claude Code and Codex will be a big plus
  • Familiarity with popular A/B testing products such as Statsig
  • Experience in large-scale data processing, including Spark, Cosmos, Data Lake, or equivalent systems
  • Knowledge of AI agents, agent frameworks, automation systems, or interest in building agentic workflows
  • Hands-on experience with Azure services (e.g., EventHub, Storage, Container Apps, Kubernetes, Functions)
  • Strong understanding of performance optimization, resource efficiency, observability, and distributed compute debugging
  • Experience building or supporting experimentation platforms, A/B testing systems, or data-driven product infrastructure
  • Familiarity with CI/CD pipelines, reliability engineering, and large-production-scale service operations
Microsoft Corporation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer 2 - Core AI

8 matching positions

Software Engineer II/Sr. Software Engineer

Join Microsoft’s Core AI team and help shape the future of intelligent software ...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements is required for this role
  • This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design and ship AI-assisted features in Visual Studio that help developers generate, explain, and refactor code—measured by adoption, reliability, and user satisfaction
  • Bring intelligence into IDE by integrating GitHub Copilot/MCP tools into core IDE workflows with strong attention to performance, privacy, and safety-by-default
  • Collaborate with partner teams across Microsoft and GitHub to deliver secure, performant solutions and iterate quickly based on real developer feedback
  • Contribute to designs (APIs, data flows, extensibility points) and participate in code/design reviews to maintain quality and scalability for a large codebase
  • Instrument and learn using telemetry, experimentation, and diagnostics to improve latency, reliability, and relevance over time
  • Fulltime
Read More
Arrow Right

Software Engineer 2

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
  • 3+ to 7 years of professional software engineering experience, including hands‑on development in one or more modern programming languages but not limited to C#, Java, Python
  • Strong understanding of core software engineering fundamentals, including data structures, algorithms, object‑oriented design, and scalable system principles
  • Experience developing, testing, debugging, and maintaining production‑quality code, following established coding standards and development processes
  • Working knowledge of cloud, distributed systems, or service‑based architectures, with exposure to reliability, performance, and monitoring concepts
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Design, implement, and deliver well‑scoped software features using clean, maintainable, and well‑tested code in accordance with established engineering standards
  • Contribute to technical design discussions by understanding system components, dependencies, and trade‑offs, and executing approved designs effectively
  • Debug, troubleshoot, and resolve issues across the codebase, improving performance, reliability, and service quality through effective use of telemetry and diagnostics
  • Follow secure coding, testing, and compliance practices to ensure solutions meet Microsoft’s security, privacy, and engineering quality standards
  • Continuously learn and improve engineering skills by incorporating feedback, adopting best practices, and contributing positively to team engineering culture
  • Ensure reliability and supportability of services, act as DRI when needed, improve telemetry, reduce incident volume, and integrate operational learnings into engineering decisions
  • Understand customer and user requirements deeply, using feedback, data, and telemetry insights to shape features, improve usability, and guide iterative product improvements
  • Fulltime
Read More
Arrow Right

Software Engineer - AI Platform

We are building an agentic mesh network for US healthcare, deploying multimodal ...
Location
Location
United States of America , New York City
Salary
Salary:
Not provided
Armory Medical
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years building production software
  • You've shipped real systems — not just side projects, not demos
  • You've debugged something at 2am and know what it means to own what you build
  • You're excited by distributed agent systems — state machines, message guarantees, fault tolerance, consensus
  • You're drawn to pushing the envelope of Applied AI
  • You operate with extreme ownership
  • You're drawn to a sense of mission and purpose
Job Responsibility
Job Responsibility
  • Design and build core systems that power autonomous agent orchestration across US healthcare
  • Build Agent runtime — execution engine, task scheduling, state management, exception handling, and human-escalation pathways
  • Build Complex agent orchestration — multi-agent coordination, tool use, real-time decision-making pipelines
  • Build Federated interoperability protocols that enforce data residency while enabling cross-entity agent collaboration
  • Build Developer-facing abstractions — APIs, SDKs, and workflow primitives
What we offer
What we offer
  • Top-of-market cash compensation
  • Significant founding-team equity
  • Fulltime
Read More
Arrow Right

Software Engineer 2

The ECS (Experimentation and Configuration Service) team is a globally distribut...
Location
Location
Vietnam , Ho Chi Minh City
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Familiarity with agentic workflows and AI-assisted development practices (e.g., AI coding agents, prompt-driven tooling, or similar)
  • Experience with large-scale cloud or distributed systems
  • Familiarity with CI/CD pipelines, agile methodologies, and modern development practices
Job Responsibility
Job Responsibility
  • Adopt and advance agentic development workflows — using AI coding agents, prompt-driven design, and human-in-the-loop automation as core parts of the daily engineering process
  • Build features and tooling that leverage agent capabilities (e.g., SKILLs, MCP interfaces) to accelerate development velocity and operational intelligence
  • Design actionable troubleshooting guides, decision trees, and automation playbooks
  • Develop self-healing and self-diagnosing capabilities that reduce manual toil and improve system resilience at scale
  • Contribute to the architecture of a mega-scale configuration platform — designing distributed, highly available, and resilient systems. Iterate rapidly through prototyping, hypothesis testing, and continuous refinement
  • Partner with product managers, designers, and engineers across organizational boundaries to define requirements and ship end-to-end solutions
  • Drive technical excellence through architecture discussions, code reviews, and mentoring
  • Instrument systems for deep observability — tracking performance, reliability, and usage patterns. Proactively analyze production signals to prevent availability risks before they become incidents
  • Translate customer pain points into technical solutions. Champion user experience and operational simplicity in every design decision
  • Fulltime
Read More
Arrow Right

Software Engineer 2 - Processing Unit for Copilot

We are seeking an expert GPU Engineer 2 to join our AI Infrastructure team. In t...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Architectural Mastery: Expertise in the CUDA programming model and NVIDIA GPU architectures (specifically Ampere/Hopper)
  • Deep understanding of the memory hierarchy (Shared Memory, L2 cache, Registers), warp-level primitives, occupancy optimization, and bank conflict resolution
  • Familiarity with advanced hardware features: Tensor Cores, TMA (Tensor Memory Accelerator), and asynchronous copy
  • Proven ability to navigate and modify complex, large-scale codebases (e.g., PyTorch internals, Linux kernel)
  • Experience with build and binding ecosystems: CMake, pybind11, and CI/CD for GPU workloads
  • Performance Engineering: Mastery of NVIDIA Nsight Systems/Compute
  • Ability to mathematically reason about performance using the Roofline Model, memory bandwidth utilization, and compute throughput
Job Responsibility
Job Responsibility
  • Custom Operator Development: Design and implement highly optimized GPU kernels (CUDA/Triton) for critical deep learning operations (e.g., FlashAttention, GEMM, LayerNorm) to outperform standard libraries
  • Inference Engine Architecture: Contribute to the development of our high-performance inference engine, focusing on graph optimizations, operator fusion, and dynamic memory management (e.g., KV Cache optimization)
  • Performance Optimization: Deeply analyze and profile model performance using tools like Nsight Systems/Compute. Identify bottlenecks in memory bandwidth, instruction throughput, and kernel launch overheads
  • Model Acceleration: Implement advanced acceleration techniques such as Quantization (INT8, FP8, AWQ), Kernel Fusion, and continuous batching
  • Distributed Computing: Optimize communication primitives (NCCL) to enable efficient multi-GPU and multi-node inference (Tensor Parallelism, Pipeline Parallelism)
  • Hardware Adaptation: Ensure the software stack fully utilizes modern GPU architecture features (e.g., NVIDIA Hopper/Ampere Tensor Cores, Asynchronous Copy)
  • Fulltime
Read More
Arrow Right

Software Engineer 2

Microsoft Azure AI Inference platform is the next generation cloud business posi...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or a related technical field AND 2+ years of technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, or Golang, OR equivalent experience
  • Ability to meet Microsoft, customer, and/or government security screening requirements for this role
  • Technical background with a solid foundation in software engineering principles, distributed computing, and system architecture
  • Experience working on high-scale, reliable online systems
  • Experience with real-time online services requiring low latency and high throughput
  • Experience working with Layer 7 (L7) network proxies and gateways
  • Knowledge of network architecture and concepts, including HTTP and TCP protocols, authentication, and session management
  • Knowledge and experience with OSS, Docker, Kubernetes, C++, Golang, or equivalent programming languages
  • Cross-team collaboration skills and the desire to collaborate in a team of researchers and developers
  • Ability to independently lead projects
Job Responsibility
Job Responsibility
  • Design and implement core inference infrastructure for serving frontier AI models in production
  • Identify and drive improvements to end-to-end inference performance and efficiency of state-of-the-art LLMs and GenAI models from OpenAI, Anthropic and xAI hosted on AI Foundary
  • Design and implement efficient load scheduling and balancing strategies, by leveraging key insights and features of the model and workload
  • Scale the platform to support the growing inferencing demand and maintain high availability
  • Deliver critical capabilities required to serve the latest and greatest Gen AI models such as GPT5, Realtime audio, Sora, and enable fast time to market for them
  • Drive generic features to cater to the needs of customers such as GitHub, M365, Microsoft AI and third-party companies
  • Collaborate with our partners both internal and external
  • Embody Microsoft's Culture and Values
  • Fulltime
Read More
Arrow Right

Software Engineer 2

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • 2+ years of experience designing, building, and operating production-grade software and services at scale
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Creates and implements code for a product, service, or feature, reusing code as applicable
  • Provides feedback for proposals for architecture, with technical leadership from others
  • Tests and explores various design options for a product/solution feature, outlining strengths and weaknesses of each option
  • Collaborates with architects to build and modify a product/solution feature, providing feedback as needed
  • Contributes to the development of design documents that support user stories and other product requirements with oversight
  • Contributes to the refinement of product features by escalating findings from analyses to inform decisions regarding the engineering of products
  • Build Foundational Capabilities: Contribute to and lead the development of core platform components and reusable building blocks that accelerate team velocity and product innovation
  • Champion Customer-Centric Development: Engage directly with customers and product teams to capture feedback, understand demand signals, and refine product messaging—ensuring the voice of the customer shapes product evolution
  • Lead Live Site Excellence: Drive operational excellence in managing and operating large-scale distributed systems with a high bar for service-level agreements (SLAs). Lead root cause analyses (RCAs) for key live site incidents and outages, identify systemic improvements, and set high standards for reliability and performance
  • Fulltime
Read More
Arrow Right

Software Engineer 2

Join Microsoft AI (MAI), the team behind Copilot, Bing, MSN, Microsoft Advertisi...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 2+ years of professional experience in iOS development using Swift and/or Objective‑C, with strong understanding of iOS frameworks, system behaviors, and performance characteristics
  • Proven experience building and maintaining large-scale, high-quality mobile applications with complex architecture and long-term maintainability requirements
  • Solid understanding of mobile system design, including modularization, dependency management, concurrency, memory management, and networking
  • Demonstrated ability to diagnose and resolve deep technical issues across performance, stability, and reliability dimensions
  • A growth mindset and willingness to adopt new tools, technologies, and AI-assisted engineering workflows
Job Responsibility
Job Responsibility
  • Strengthen the core quality and reliability of the app, building guardrails, diagnostics, and automated protections that prevent regressions and ensure consistent performance at scale
  • Drive optimizations across the app, using deep platform knowledge to identify systemic bottlenecks and implement durable improvements
  • Partner closely with cross-functional teams (Product, Design, Research, Backend, AI) to translate complex requirements into robust, scalable client-side solutions
  • Explore and integrate AI-assisted development workflows to improve code quality, reduce iteration time, and enhance developer productivity across the mobile organization
  • Own critical incident response and long-term remediation, ensuring the app remains stable, observable, and resilient under real-world conditions
  • Fulltime
Read More
Arrow Right