CrawlJobs Logo

(Senior) Software Engineer, Experimentation Platform - CoreAI

United States, Redmond Employment contract 102100.00 - 202200.00 USD / Year · Job Posted July 03, 2026
Apply Position
Job Link Share

Job Description

CoreAI sits at the center of Microsoft’s mission to redefine how software is built and experienced, providing the foundational platforms, services, and developer experiences that power the next generation of AI-driven applications. As part of CoreAI, the Experimentation Platform (ExP) enables trustworthy, high-scale online experimentation that accelerates product learning and drives progress across Microsoft’s AI ecosystem. You will play a key role in helping teams ship better AI experiences faster by providing the experimentation capabilities needed to evaluate, refine, and safely deploy new innovations. In this role, you will help strengthen one of the highest-scale experimentation platforms - critical infrastructure that enables rapid iteration in AI systems and product features. You will contribute to services that empower engineers and scientists across the company to measure impact, validate hypotheses, and advance state-of-the-art AI capabilities through rigorous experimentation. This is a unique opportunity to build systems at scale while deepening your expertise in distributed systems, service reliability, and experimentation methodologies. You will thrive in this role if you enjoy solving complex distributed systems challenges, learning experimentation fundamentals, and building reliable infrastructure that accelerates Microsoft’s progress in AI. Microsoft’s mission is to empower every person and every organization on the planet to achieve more, and we’re dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.

Job Responsibility

  • Design, implement, and maintain clean, reliable, testable code using best practices and responsible AI-assisted development while escalating blockers early
  • Use AI tools responsibly across the SDLC, reviewing and validating AI-generated changes to ensure correctness and maintainability
  • Work with partner engineering teams, PMs, and experts (privacy, security, SRE) to understand requirements, apply customer feedback/telemetry, and deliver scalable, reliable, user-centric features
  • Build extensible, maintainable services and features with strong diagnosability, reliability, and production-readiness
  • Participate in on-call rotations, troubleshoot live-site issues using least-privileged access, and improve TSGs, telemetry, and fixes that reduce future incidents
  • Contribute to engineering and operational excellence through automation, tooling, documentation, and process improvements

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice to have

  • Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Experience working with cloud platforms (Azure, AWS, GCP), building and maintaining distributed systems including deployment, monitoring and troubleshooting of production workloads
  • Experience using observability tools (logging, metrics, tracing) to diagnose service issues and improve system reliability
  • Experience with experimentation platforms, A/B testing at scale, and statistical methodologies for measuring product impact and driving data-informed ship decisions
  • Familiarity with AI-assisted development workflows or responsible use of AI coding tools

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

(Senior) Software Engineer, Experimentation Platform - CoreAI

8 matching positions

Senior Software Engineer, CoreAI Workload Engines

The CoreAI Workloads team builds the foundational inference engines and APIs tha...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field and 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python, or equivalent experience.
  • Proven ability to design and operate large-scale, production inference services with high reliability and performance requirements, and to ship performance improvements safely via disciplined experimentation.
  • Strong skills in performance analysis: benchmarking, profiling, diagnosing regressions, and turning results into concrete engine/runtime changes.
  • Strong problem-solving skills and the ability to debug complex, cross layer systems issues.
  • Demonstrated technical leadership, including mentoring engineers, driving cross-team architectural alignment, and leveraging AI tools and AI-assisted workflows to accelerate engineering velocity and quality.
  • Hands-on experience with Kubernetes (building and operating services on k8s), including debugging production issues and designing platform abstractions (e.g., custom resources/controllers) and scheduling-aware deployments (e.g., node affinity, taints/tolerations, resource requests/limits).
  • Strong collaboration and communication skills, with the ability to work across organizational boundaries.
Job Responsibility
Job Responsibility
  • Optimize inference engines for OpenAI and open-source models by implementing and shipping performance/efficiency improvements across runtime, scheduling, and serving paths (latency, throughput, utilization, availability, and cost).
  • Run experiments end-to-end: formulate hypotheses, implement engine changes (including Python/PyTorch integration points where relevant), analyze results, and ship improvements behind guardrails.
  • Build and use experimentation capabilities for large-scale AI inference (experiment lifecycle, tracking, metric modeling, comparability standards, automated analysis) so the team can iterate quickly and safely.
  • Own serving availability and efficiency for Azure OpenAI Service workloads through tiered experimentation, lean segmentation, and multi-modal utilization across heterogeneous fleets—turning findings into shipped engine improvements.
  • Design and evolve inference serving architectures to improve utilization and latency using techniques such as disaggregated serving, multi-token prediction, KV offload/retrieval, and quantization—validated via staged rollouts and production guardrails.
  • Extend AI infrastructure abstractions to support elastic, heterogeneous inference engines reliably at scale (e.g., dynamic scaling across model families, modalities, and workload classes while maintaining isolation and SLOs).
  • Tune and scale inference engines across NVIDIA GPU generations (A100, H100, H200) for state-of-the-art OpenAI models, focusing on serving efficiency, utilization, and reliability (not hardware bring-up).
  • Partner with networking and storage teams to leverage high-performance interconnects (e.g., RDMA/InfiniBand-class fabrics such as RoCE over IB) for distributed inference, without owning low-level kernel/driver enablement.
  • Drive end-to-end features from design through production: observability, diagnostics, performance regression detection, and operational excellence for inference serving.
  • Influence platform architecture and technical direction across teams through design reviews, clear metrics, and technical leadership focused on experimentation velocity and production reliability.
What we offer
What we offer
  • Benefits and other compensation
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - GitHub Copilot - CoreAI

Do you want to help shape the future of AI-assisted software development for mil...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, implement, and maintain high-quality desktop client and plugin features for GitHub Copilot in 3rd Party IDEs, including JetBrains IDEs, Xcode, and Eclipse
  • Build AI-powered developer experiences such as code suggestions, chat, contextual assistance, and agentic workflows in IDE environments
  • Drive engineering excellence in client architecture, performance, startup, responsiveness, diagnostics, reliability, and maintainability
  • Partner with teams across time zones, including the China engineering team, to plan, develop, and ship end-to-end product experiences
  • Collaborate with shared platform and service teams to integrate capabilities such as telemetry, experimentation, model support, and context/tool orchestration
  • Ensure that our products and engineering systems meet security, privacy, compliance, and enterprise readiness requirements
  • Investigate and resolve customer and partner issues with urgency, using telemetry, debugging, and root cause analysis to improve product quality at scale
  • Contribute technical leadership through design reviews, code reviews, mentoring, and adoption of engineering best practices
  • Fulltime
Read More
Arrow Right

Senior Product Manager - Microsoft Foundry Platform (CoreAI)

Foundry powers a rapidly growing model ecosystem, working with flagship model la...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree AND 5+ years of experience in product/service/project/program management or software development
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Define product strategy and roadmap for platform capabilities that support AI application development, model integration, and runtime services
  • Work with flagship model providers, open-source communities, and ecosystem partners to expand the range of models and capabilities available through the Foundry platform
  • Collaborate with engineering and design teams to translate customer needs into product requirements and deliver scalable solutions
  • Define success metrics and lead experimentation to validate product hypotheses and drive product-led growth
  • Partner with marketing, developer relations, and go-to-market teams to launch new capabilities and grow adoption
  • Navigate ambiguity, drive alignment across stakeholders, and foster a culture of customer obsession and continuous innovation
  • Fulltime
Read More
Arrow Right

Senior Product Manager - Microsoft Foundry (CoreAI Efficiency)

We are building the industry’s leading AI-first application stack with enhanced ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree AND 5+ years experience in product/service/project/program management or software development OR equivalent experience
  • 3+ years of experience in product development
  • Experience delivering one or more AI, cloud services, enterprise grade solutions, and mobile apps
  • Proven success in launching and scaling multi-million dollar revenue products, ideally in AI, ML, or platform domains
  • Background in enterprise compliance requirements
  • Product led growth focus with data-driven decision-making skills
  • Excellent executive presence and stakeholder management capabilities
  • Experience leading cross-functional teams and managing complex dependencies
  • Ability to thrive in fast-paced environments with a bias for action
Job Responsibility
Job Responsibility
  • Develop the product offerings that increase overall fleet utilization while delivering cost-effective, high-performance solutions for customers
  • Identify high-impact opportunities to increase inference efficiency and growth across internal and external customer segments
  • Define and track efficiency metrics, manage dependencies, and lead experimentation to drive Microsoft Foundry product growth and infrastructure utilization
  • Develop creative programs and pricing/incentive models to encourage usage during non-peak periods and to onboard new customers, ultimately driving up platform usage and revenue
  • Collaborate with engineering, data science, finance, marketing, and go-to-market teams to deliver integrated solutions
  • Develop compelling product narratives and performance dashboards for executive-level communication and decision-making
  • Provide clarity in ambiguous environments, influence stakeholders, and foster a culture of innovation and accountability
  • Fulltime
Read More
Arrow Right

Principal Product Manager - Foundry Inferencing & Training (CoreAI - multiple roles)

Microsoft Foundry sits at the center of Microsoft’s AI strategy, powering how mo...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 331200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree and 8+ years of experience in product management, technical program management, software engineering, or related technical fields (or equivalent experience)
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Product Strategy & Ownership: Own product strategy and roadmap across AI model training, inference, experimentation, and platform enablement, balancing near-term delivery with long-term scale
  • Maintain end-to-end accountability from concept through launch, iteration, and measurable impact
  • Model Lifecycle & Platform Enablement: Drive initiatives across the AI model lifecycle, partnering with engineering and research to bring new capabilities from research into production
  • Enable internal teams and customers to access, integrate, and adopt models through high-quality platform experiences
  • Execution, Velocity & Operating Rigor: Lead complex, multi-quarter initiatives with high visibility, managing dependencies, risks, and tradeoffs across teams
  • Improve execution velocity by reducing friction in planning, experimentation, launches, and iteration cycles
  • Experimentation, Metrics & Continuous Improvement: Define and track metrics for efficiency, performance, reliability, and adoption, using experimentation and data to drive decisions
  • Identify opportunities for automation, simplification, and continuous improvement as systems scale
  • Cross-Functional Leadership & Communication: Act as a connective leader across engineering, data science, research, infrastructure, and go-to-market teams
  • Influence senior stakeholders through clear decision framing, executive-ready narratives, and data-backed recommendations
  • Fulltime
Read More
Arrow Right

Senior Product Manager

At Microsoft, we bring together passionate innovators who imagine what’s possibl...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree (or equivalent) in engineering, computer science or related field
  • 6+ years in product management or software development with product responsibilities
  • At least 2 years leading the launch of complex products targeted at developers or ML/AI professionals
  • Deep curiosity about how developers build, and a drive to simplify complex workflows through great product experiences
  • Hands-on experience with AI/ML technologies and cloud platforms
  • Demonstrated track record of delivering products that resonate with technical audiences and drive measurable business outcomes
  • Strong analytical mindset and ability to make data-driven decisions
  • Excellent communication skills – able to engage both technical and non-technical stakeholders
  • Comfortable working in fast-paced, ambiguous environments and driving clarity through complexity
Job Responsibility
Job Responsibility
  • Define and drive the long-term product strategy for core AI platform capabilities that power Azure AI and developer experiences
  • Own end-to-end product outcomes, from strategy through execution, using OKRs and data insights to measure success
  • Lead cross-functional initiatives across engineering, design, and partner teams, driving alignment and clarity in complex, multi-team environments
  • Engage deeply with developers, data scientists, and enterprise customers to uncover needs, synthesize insights, and translate them into scalable product capabilities
  • Launch, iterate, and optimize high-impact features through experimentation and data-driven learning
  • Drive Product-Led Growth, enabling self-service adoption and expanding the developer ecosystem through extensible platform experiences
  • Mentor junior PMs and help strengthen product management practices across the CoreAI organization
  • Champion an inclusive, responsible AI culture that emphasizes customer trust, scalability, and innovation
  • Fulltime
Read More
Arrow Right

Principal Product Manager

At Microsoft, we are building the world’s most trusted and developer‑centric AI ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in engineering, computer science, or a related technical field
  • Significant experience (typically 8–12+ years) in product management or software engineering with substantial product ownership, including experience working on platform or infrastructure products
  • Demonstrated ability to operate effectively in large, ambiguous, multi‑team environments with shared ownership and complex dependencies
  • Strong technical depth in cloud platforms, distributed systems, or AI/ML infrastructure, with the ability to engage credibly with senior engineers and architects
  • Proven track record of influencing strategy, driving alignment, and delivering outcomes through collaboration rather than direct authority
  • Strong analytical and systems‑thinking skills, with experience making high‑quality decisions in fast‑moving, evolving problem spaces
Job Responsibility
Job Responsibility
  • Act as a senior contributor to platform strategy for Azure AI Foundry and Azure ML, helping shape multi-year investments across model training, customization, deployment, and lifecycle management
  • Drive alignment and progress across federated, cross-organizational initiatives, working with peer Principal PMs and multiple engineering teams on shared platform outcomes
  • Contribute to the definition and evolution of high-leverage platform abstractions (APIs, SDKs, workflows) that enable scalable adoption of GenAI and custom code training workloads
  • Partner closely with senior engineering leaders to influence architectural direction, surface trade-offs, and ensure platform capabilities meet scale, reliability, and security expectations
  • Engage with strategic customers and internal stakeholders to gather insights, validate requirements, and translate learnings into durable, reusable platform capabilities
  • Use data, metrics, and experimentation to evaluate impact and inform product decisions across shared ownership areas
  • Serve as a thought leader and mentor within CoreAI, elevating product craft, platform thinking, and responsible AI practices across the organization
  • Fulltime
Read More
Arrow Right

Senior Product Manager

At Microsoft, we bring together passionate innovators who imagine what’s possibl...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree (or equivalent) in engineering, computer science or related field
  • 6+ years in product management or software development with product responsibilities
  • At least 2 years leading the launch of complex products targeted at developers or ML/AI professionals
  • Deep curiosity about how developers build, and a drive to simplify complex workflows through great product experiences
  • Hands-on experience with AI/ML technologies and cloud platforms
  • Demonstrated track record of delivering products that resonate with technical audiences and drive measurable business outcomes
  • Strong analytical mindset and ability to make data-driven decisions
  • Excellent communication skills – able to engage both technical and non-technical stakeholders
  • Comfortable working in fast-paced, ambiguous environments and driving clarity through complexity
Job Responsibility
Job Responsibility
  • Define and drive the long-term product strategy for core AI platform capabilities that power Azure AI and developer experiences
  • Own end-to-end product outcomes, from strategy through execution, using OKRs and data insights to measure success
  • Lead cross-functional initiatives across engineering, design, and partner teams, driving alignment and clarity in complex, multi-team environments
  • Engage deeply with developers, data scientists, and enterprise customers to uncover needs, synthesize insights, and translate them into scalable product capabilities
  • Launch, iterate, and optimize high-impact features through experimentation and data-driven learning
  • Drive Product-Led Growth, enabling self-service adoption and expanding the developer ecosystem through extensible platform experiences
  • Mentor junior PMs and help strengthen product management practices across the CoreAI organization
  • Champion an inclusive, responsible AI culture that emphasizes customer trust, scalability, and innovation
  • Fulltime
Read More
Arrow Right