CrawlJobs Logo

Senior Software Engineer - Core AI

China, Beijing · Job Posted March 03, 2026
Apply Position
Job Link Share

Job Description

The Experimentation Platform (ExP) team powers Microsoft’s end-to-end experimentation ecosystem, enabling product teams across the company—including Copilot, Bing, Office, Windows, Edge, Xbox, and Azure — to make data-driven decisions at massive scale. We build the experimentation framework, compute platform, data pipelines, agent-driven automation and insights and that run millions of experiments each year. We focus on delivering world-class reliability, scalable experiment execution, transparent compute fundamentals, automated workflows, and AI-assisted agentic capabilities that accelerate experimentation velocity across Microsoft. This role offers the opportunity to build modern user experience, high-performant distributed systems, modernize a mission-critical experimentation stack, integrate AI-driven agents, and improve end-to-end fundamentals such as efficiency, observability, and resiliency. As a platform software Engineer, you’ll collaborate with cross-functional teams across engineering, data science, and AI to deliver a seamless experimentation experience at global scale.

Job Responsibility

  • Design and build components of the experimentation platform, including large-scale data pipelines, metrics/analysis authoring, distributed workflows, and critical experiment lifecycle services
  • Develop high-performance and reliable systems using C#, .NET, Spark pipelines, Azure services, and modern data/compute frameworks
  • Integrate AI-driven agents and automation to improve debugging, monitoring, validation, and self-service capabilities for experiment owners
  • Optimize efficiency, cost, resource utilization, and pipeline throughput across a global fleet
  • Improve platform fundamentals including observability, reliability, test automation and recovery workflows
  • Collaborate with PMs, data scientists, platform engineers, and partner teams (across global Microsoft engineering centers) to design scalable solutions
  • Participate in code reviews, incident response, performance tuning, and architectural discussions
  • Engineer features with a strong focus on quality, transparency, resiliency, and operational excellence

Requirements

  • 5+ years of experience in software engineering OR equivalent experience
  • Strong coding skills in one or more languages: C#, Java, Scala, Python, or C++
  • Proven ability to design and deliver components of large distributed systems or data platforms
  • Solid understanding of data structures, algorithms, distributed system fundamentals, and debugging complex systems
  • Fast learner with strong communication skills and the ability to work effectively across teams

Nice to have

  • AI native, embrace AI agents in everyday job. Hands-on experience with Github Copilot, Claude Code and Codex will be a big plus
  • Familiarity with popular A/B testing products such as Statsig
  • Experience in large-scale data processing, including Spark, Cosmos, Data Lake, or equivalent systems
  • Knowledge of AI agents, agent frameworks, automation systems, or interest in building agentic workflows
  • Hands-on experience with Azure services (e.g., EventHub, Storage, Container Apps, Kubernetes, Functions)
  • Strong understanding of performance optimization, resource efficiency, observability, and distributed compute debugging
  • Experience building or supporting experimentation platforms, A/B testing systems, or data-driven product infrastructure
  • Familiarity with CI/CD pipelines, reliability engineering, and large-production-scale service operations

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer - Core AI

8 matching positions

Senior and Principal Software Engineer - Core AI

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Go, Java, or Python
  • OR equivalent experience
  • 6+ years technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems
  • Experience building AI or ML related applications
  • 1+ years of technical engineering experience with machine learning or Artificial Intelligence (AI) systems
Job Responsibility
Job Responsibility
  • Design, implement and deliver AI services to support product offerings for large-scale agent observability
  • Collaborate closely with product management and partner teams to align technical direction with business goals
  • Take end-to-end responsibility for the development lifecycle and production readiness of the services you build and drive the team’s DevOps culture
  • Engage with customers to gather feedback and resolve complex issues
  • Understand Microsoft businesses and collaborate with stakeholders towards cohesive, end-to-end experiences for Microsoft customers
  • Innovate on technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Managed AI - AI model LifeCycle

The Senior Software Engineer for the Model LifeCycle team will contribute to bui...
Location
Location
United States , San Francisco
Salary
Salary:
172425.00 - 209000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Experience delivering production-ready features
  • Familiarity with essential cloud-based services (e.g., compute, storage, networking)
  • Familiarity with Generative AI (Large Language Models, Multimodal)
  • Experience with AI infrastructure components (training, inference)
  • 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
Job Responsibility
Job Responsibility
  • Implement and maintain systems for fine-tuning large foundation models (SFT, PEFT, LoRA, adapters), including multi-node orchestration, checkpointing, failure recovery, and cost-efficient scaling
  • Implement and maintain end-to-end training pipelines for Large Language Models
  • Implement components for distillation and reinforcement learning pipelines (e.g., preference optimization, policy optimization, reward modeling)
  • Develop and maintain core agent execution infrastructure
  • Implement features for dataset, model, and experiment management, focusing on versioning, lineage, evaluation, and reproducible fine-tuning
  • Work closely with Senior Engineers and Principal Engineers, as well as product and platform teams, to implement system abstractions and APIs
  • Contribute to technical discussions on training runtimes, scheduling, storage, and model lifecycle management
  • Engage with the open-source LLM ecosystem
What we offer
What we offer
  • Restricted Stock Units
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Managed AI - AI Platform

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'...
Location
Location
United States , San Francisco, CA; Sunnyvale, CA
Salary
Salary:
172425.00 - 209000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree in Computer Science/Engineering
  • 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
  • Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly
  • Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines)
  • Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD
Job Responsibility
Job Responsibility
  • Lead the design and implementation of core AI services, including: Resilient fault-tolerant queues for efficient task distribution
  • Model catalogs for managing and versioning AI models
  • Scheduling mechanisms optimized for cost and performance
  • Architect and scale infrastructure to handle millions of API requests per second
  • Implement robust monitoring and alerting to ensure system health and 24/7 availability
  • Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap
  • Influence the long-term vision and architectural decisions of the platform
  • Contribute to open-source AI frameworks and actively participate in the AI community
  • Prototype and rapidly iterate on emerging technologies and new features
What we offer
What we offer
  • Restricted Stock Units
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Senior Engineer - AI Core Services

At Codvo, software and people transformations go hand-in-hand. We are a global e...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in software engineering, preferably in platform or cloud-native service development using Microsoft and .NET technologies
  • Hands-on experience with Microsoft Azure and associated PaaS services (e.g., Azure Functions, AKS, API Management)
  • Strong expertise in RESTful API design, versioning, testing, and lifecycle management
  • Proficient in securing APIs, managing authentication/authorization and data privacy practices
  • Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions
  • Experience working in Agile teams and collaborating across global R&D locations
  • Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation
  • Demonstrated experience with AI frameworks, tools and Python
Job Responsibility
Job Responsibility
  • Build scalable, fault-tolerant cloud-native services on Microsoft Azure, ensuring high performance and reliability
  • Develop secure, well-documented public APIs and SDKs for consumption by internal and external developers
  • Collaborate with cross-functional teams to deliver end-to-end solutions across data pipelines, orchestration, and service APIs
  • Embed robust security controls to protect sensitive data and ensure secure access to AI services
  • Contribute to design reviews, code reviews, and architectural discussions to ensure engineering excellence
  • Mentor junior developers, encourage continuous learning, and contribute to a culture of innovation
  • Work with multiple teams to create AI solutions, which include AI model deployment, training, and AI tooling development
  • Fulltime
Read More
Arrow Right

Senior Engineer - AI Core Services

We are looking for passionate and skilled Software Developers to join our Core A...
Location
Location
United Kingdom , Cambridge
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in software engineering, preferably in platform or cloud-native service development using Microsoft and .NET technologies
  • Hands-on experience with Microsoft Azure and associated PaaS services (e.g., Azure Functions, AKS, API Management)
  • Strong expertise in RESTful API design, versioning, testing, and lifecycle management
  • Proficient in securing APIs, managing authentication/authorization and data privacy practices
  • Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions
  • Experience working in Agile teams and collaborating across global R&D locations
  • Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation
  • Demonstrated experience with AI frameworks, tools and Python
Job Responsibility
Job Responsibility
  • Build scalable, fault-tolerant cloud-native services on Microsoft Azure, ensuring high performance and reliability
  • Develop secure, well-documented public APIs and SDKs for consumption by internal and external developers
  • Collaborate with cross-functional teams to deliver end-to-end solutions across data pipelines, orchestration, and service APIs
  • Embed robust security controls to protect sensitive data and ensure secure access to AI services
  • Contribute to design reviews, code reviews, and architectural discussions to ensure engineering excellence
  • Mentor junior developers, encourage continuous learning, and contribute to a culture of innovation
  • Work with multiple teams to create AI solutions, which include AI model deployment, training, and AI tooling development
  • Fulltime
Read More
Arrow Right

Principal AI Software Engineer, Senior Vice President

Are you looking for a career move that will put you at the heart of a global fin...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Exceptional Python Expertise: Demonstrated mastery of core Python, including advanced features, performance optimization, and a deep understanding of the FastAPI framework
  • Prior hands-on experience with Generative AI, Large Language Model (LLM) frameworks (e.g. LangChain, LlamaIndex), and their application in enterprise environments is a must. This must be underpinned by a profound understanding of core machine learning principles, algorithms, and data science methodologies
  • Full Lifecycle Ownership: Extensive hands-on experience and technical authority throughout the entire software development lifecycle, from conceptualization and design to implementation, deployment, and operational ownership of enterprise software solutions, involving significant cross-functional collaboration
  • Strategic System Design: Significant hands-on experience in architecting and designing (architecture, design patterns, reliability, scaling) highly complex new and current systems with broad technical impact
  • Hands-on expertise with containerized deployment technologies (e.g. Kubernetes, OpenShift, Docker) and orchestration strategies
  • Hands-on experience and in-depth understanding of C++ is a significant bonus, particularly for complex code analysis, parsing, and integration into knowledge graph structures
Job Responsibility
Job Responsibility
  • Architect and implement cutting-edge software systems, defining the technical design for our AI solutions to ensure scalability, performance, and reliability
  • Drive the hands-on design, implementation, and deployment of sophisticated systems that automate the analysis of data, code, and documentation
  • Apply deep expertise to structure extracted knowledge within a Credit Risk Domain-aware knowledge graph, including advanced strategies for effectively modelling complex codebases, particularly C++, within this graph
  • Act as a critical technical partner with data scientists, business analysts, and other engineering teams to translate challenging business requirements into robust technical solutions and ensure successful, high-quality project delivery
  • Tackle the most complex technical challenges within our AI initiatives, providing solutions that set the standard for engineering excellence
What we offer
What we offer
  • Generous holiday allowance starting at 27 days plus bank holidays
  • increasing with tenure
  • A discretional annual performance related bonus
  • Private medical insurance packages to suit your personal circumstances
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - AI Infrastructure (Scheduler) - CoreAI

The AI Platform organization builds the end-to-end Azure AI stack, from the infr...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Java, Scala, Rust, Go, TypeScript | OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Work on the design and development of the core AI Infrastructure distributed and in-cluster services that support large scale AI training and inferencing
  • Develop, test, and maintain control plane services written in C#, hosted on Service Fabric or Kubernetes (AKS) clusters
  • Enhance systems and applications to ensure high stability, efficiency and maintainability, low latency, tight cloud security
  • Provide operational support and DRI (on-call) responsibilities for the service
  • Develop and foster a deep understanding of the machine learning concepts, use cases, and relevant services used by our customers
  • Collaborate closely with service engineers, product managers, and internal applied research and data science teams within Microsoft to build better solutions together
  • Provide vision, expertise, and technical leadership to other team members
  • Help to grow talent in these areas
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - AI Cloud

Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serv...
Location
Location
United States , San Francisco
Salary
Salary:
255000.00 - 445000.00 USD / Year
lambda.ai Logo
Lambda
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Frontend Experience (6+ years): Responsive web apps using TypeScript, React (or equivalent experience in Vue or Svelte), HTML and modern CSS, Vite
  • Backend Experience (8+ years): Business-critical services using Python, Unix/Command line, Django or FastAPI, Relational databases like PostgreSQL or MySQL
  • Additional Core Experience: CI/CD: Automation around testing and deployment
  • Reliability & Observability: Logging, alerting, and building highly available systems
  • Cloud Native Services: AWS, Okta, Cloudflare, etc.
Job Responsibility
Job Responsibility
  • Design and build intuitive, beautiful web interfaces for ML/AI cloud users
  • Integrate top-tier tooling, workflows, and models from the AI space
  • Own features end-to-end—from design to deployment to monitoring
  • Help build the world’s best deep learning cloud by delivering frontend and backend systems that power Lambda's ML and AI platform
What we offer
What we offer
  • Generous cash & equity compensation
  • Health, dental, and vision coverage for you and your dependents
  • Wellness and commuter stipends for select roles
  • 401k Plan with 2% company match (USA employees)
  • Flexible paid time off plan
  • Fulltime
Read More
Arrow Right