CrawlJobs Logo

Principal ML Engineer, CoreAI

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

139900.00 - 274800.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

You’ll help build core generative AI and multimodal capabilities that power customer-facing AI services at global scale. In this role, you’ll combine strong software engineering with applied ML expertise to design, ship, and operate production systems—using techniques like context engineering, synthetic data generation, and rigorous evaluation/metrics to continuously improve quality. You’ll partner closely across product, research, and service engineering to deliver secure, performant improvements for enterprise customers.

Job Responsibility:

  • Design, build, and operate production-grade generative AI and multimodal systems, with end-to-end ownership from concept through deployment and service operations
  • Lead technical design for core GenAI capabilities (e.g., retrieval-augmented generation, context and memory, orchestration) and make data-driven tradeoffs across quality, latency, cost, and safety
  • Define and improve model and system quality using evaluation frameworks, experiment design, and production telemetry
  • ensure robust testing and regression coverage
  • Collaborate with security, privacy, and compliance partners to build solutions that meet enterprise requirements and align with Responsible AI standards and practices
  • Provide technical leadership across teams by setting direction, reviewing designs, unblocking execution, and mentoring engineers on architecture, coding standards, and ML engineering best practices
  • Partner with product and customers to understand scenarios, translate requirements into well-designed APIs and developer experiences, and drive adoption through documentation and samples

Requirements:

  • Bachelor's Degree in Computer Science or related technical field and 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python or equivalent experience
  • Advanced degree in Computer Science, Machine Learning, or related field
  • Demonstrated technical leadership through influence (e.g., leading designs, setting architecture direction, mentoring engineers)
  • Experience with prompt engineering, retrieval-augmented generation (RAG), and memory/agent frameworks
  • Experience building and shipping generative AI systems (including multimodal scenarios)
  • Familiarity with compliance and security standards in enterprise AI solutions
  • Track record of delivering enterprise-facing AI products at scale
  • Experience building and operating ML/AI systems in cloud environments
  • familiarity with MLOps practices (Azure a plus)
  • Experience partnering with cross-functional stakeholders to define requirements and drive technical decisions

Additional Information:

Job Posted:
March 05, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Microsoft Corporation - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal ML Engineer, CoreAI

Principal Software Engineer - CoreAI

Software quality is being redefined by AI. As part of the Microsoft Playwright t...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Bachelor's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • 3+ years of experience with AI LLM models, such as OpenAI, Azure AI, ML
  • 3+ years of experience with browser engineering
  • 3+ years of experience with network security
Job Responsibility
Job Responsibility
  • Leads identification of dependencies and the development of design documents for a product, application, service, or platform
  • Leads by example and mentors others to produce extensible and maintainable code used across products
  • Leverages subject-matter expertise of cross-product features with appropriate stakeholders (e.g., project managers) to drive multiple group's project plans, release plans, and work items
  • Holds accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions
  • Proactively seeks new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and shares knowledge with other engineers
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, CoreAI

The GenAI Infrastructure and Solutions team is building large-scale GenAI traini...
Location
Location
United States , Redmond
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field and 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python or equivalent experience.
  • 6+ years designing, developing, and shipping high quality software.
  • 3+ years of experience with distributed systems and cloud-based infrastructure.
  • 2+ years of experience with containerization tools (e.g., Docker, Kubernetes).
  • 2+ years of experience with DevOps practices (CI/CD, automated testing, deployment, etc.).
  • Passionate and self-motivated. Strong ability in self-learning, entering new domain, managing through uncertainty in an innovative team environment.
  • Familiarity with virtualization technology.
  • Familiarity with production ML systems and concepts like model serving, caching, batching, and monitoring.
Job Responsibility
Job Responsibility
  • Lead the collaboration with engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models.
  • Design, build and improve services with high scalability and reliability.
  • Design and implement the services to serve the prod traffic and fulfill the security and privacy requirements.
  • Lead the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments.
  • Contribute to the deployment and monitoring of services in production environments.
  • Fulltime
Read More
Arrow Right

Principal Product Manager

At Microsoft, we are building the world’s most trusted and developer‑centric AI ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in engineering, computer science, or a related technical field
  • Significant experience (typically 8–12+ years) in product management or software engineering with substantial product ownership, including experience working on platform or infrastructure products
  • Demonstrated ability to operate effectively in large, ambiguous, multi‑team environments with shared ownership and complex dependencies
  • Strong technical depth in cloud platforms, distributed systems, or AI/ML infrastructure, with the ability to engage credibly with senior engineers and architects
  • Proven track record of influencing strategy, driving alignment, and delivering outcomes through collaboration rather than direct authority
  • Strong analytical and systems‑thinking skills, with experience making high‑quality decisions in fast‑moving, evolving problem spaces
Job Responsibility
Job Responsibility
  • Act as a senior contributor to platform strategy for Azure AI Foundry and Azure ML, helping shape multi-year investments across model training, customization, deployment, and lifecycle management
  • Drive alignment and progress across federated, cross-organizational initiatives, working with peer Principal PMs and multiple engineering teams on shared platform outcomes
  • Contribute to the definition and evolution of high-leverage platform abstractions (APIs, SDKs, workflows) that enable scalable adoption of GenAI and custom code training workloads
  • Partner closely with senior engineering leaders to influence architectural direction, surface trade-offs, and ensure platform capabilities meet scale, reliability, and security expectations
  • Engage with strategic customers and internal stakeholders to gather insights, validate requirements, and translate learnings into durable, reusable platform capabilities
  • Use data, metrics, and experimentation to evaluate impact and inform product decisions across shared ownership areas
  • Serve as a thought leader and mentor within CoreAI, elevating product craft, platform thinking, and responsible AI practices across the organization
  • Fulltime
Read More
Arrow Right

Principal Product Manager - Microsoft Foundry (CoreAI Efficiency)

We are building the industry’s leading AI-first application stack with enhanced ...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
  • 10+ years of experience in product development
  • Experience delivering one or more AI, cloud services, enterprise grade solutions, and mobile apps
  • Proven success in launching and scaling multi-million dollar revenue products, ideally in AI, ML, or platform domains
  • Technical fluency in model performance evaluation, usability, and integration strategies
  • Product led growth focus with data-driven decision-making skills
  • Executive presence and stakeholder management capabilities
  • Experience leading cross-functional teams and managing complex dependencies
  • Ability to thrive in fast-paced environments with a bias for action
Job Responsibility
Job Responsibility
  • Lead strategy and execution for increasing experimentation velocity, reducing time-to-insight, and accelerating time-to-realize efficiency
  • Reduce friction in the end-to-end experimentation process from hypothesis generation and experiment design to deployment and analysis
  • Define and track efficiency metrics, manage dependencies, and lead experimentation to drive Microsoft Foundry product growth and demonstrate efficiency gains
  • Collaborate with engineering, data science, and partner teams to develop and enhance our experimentation platform and tools
  • Drive alignment across teams to support experimentation initiatives, and ensure that insights from experiments translate into tangible improvements in our generative AI platform
  • Foster an organization-wide culture of experimentation and evidence-based innovation
  • Promote agility and learning, empowering teams to make data-driven decisions and continuously improve our AI systems at a faster pace
  • Develop compelling product narratives and performance dashboards for executive-level communication and decision-making
  • Provide clarity in ambiguous environments, influence stakeholders, and foster a culture of innovation and accountability
  • Fulltime
Read More
Arrow Right

Principal Product Manager - Core AI

We are part of the CoreAI – Platform and Tools division at Microsoft. Our missio...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in product management or related fields OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • 5+ years of experience designing and shipping complex products for developers, ML professionals, or similar
  • 3+ years of experience with distributed platform ecosystem (multi-tenant / real-time processing, batch computing etc.)
  • Proven experience in product management/technical program management, preferably in AI infrastructure or cloud services
  • Experience with and a deep understanding of GPUs, VM, OS and cloud infrastructure fundamentals
  • Ability to navigate ambiguity and drive clarity across complex, cross-functional initiatives
  • Experience creating solutions using Azure, AWS, or Google Cloud
  • Experience writing Python, particularly for machine learning
Job Responsibility
Job Responsibility
  • Join the CoreAI Infrastructure team at Microsoft, where we accelerate the transition and scaling of Generative AI models
  • Deliver a world-class AI Infrastructure stack that will host AI Foundry Services
  • Accountable for the platform roadmap for platform to scale AI workloads from research to production
  • Own a product area and be responsible for understanding developer needs and behaviors, defining product requirements, managing end-to-end product development, launches and iterations
  • Find a path to get things done despite roadblocks to get your work into the hands of customers quickly and iteratively
  • Enjoy working in a fast-paced, customer-first, product development cycle
  • Translate business goals into strategy, user experience and technical requirements in close collaboration with UX, Data Science, Engineering, AI research, and Product Marketing teams
  • Define goals and performance indicators, set up and oversee experiments, measure success with data and research
  • Collaborate effectively and communicate clearly with cross-functional teams, including product managers, designers, and other engineers, to build exceptional consumer-grade applications
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right
New

Inclusion Key Worker/Teaching Assistant

Transform Young Lives: Become an Inclusion Key Worker/Teaching Assistant. Are yo...
Location
Location
United Kingdom , Worthing
Salary
Salary:
20000.00 - 23000.00 GBP / Year
https://www.randstad.com Logo
Randstad
Expiration Date
May 28, 2026
Flip Icon
Requirements
Requirements
  • Minimum of a Level 2 (GCSE 4-9 or equivalent) qualification in Maths and English
  • Valid UK driving licence and access to own vehicle
  • Experience in working with young people with SEMH needs (desirable)
  • Excellent communication and interpersonal skills
  • Proactive, resilient, and able to work independently
  • Strong time management and organisational skills
Job Responsibility
Job Responsibility
  • Provide one-to-one and small group support to pupils within their mainstream school setting
  • Work collaboratively with school staff to implement strategies that promote positive behaviour and engagement
  • Support pupils to develop their SEMH skills and make positive choices
  • Act as a key point of contact for pupils, families, and school staff
  • Work proactively to prevent exclusions by addressing underlying needs and challenges
  • Maintain accurate records and contribute to multi-agency meetings
  • Ensure pupils are supported to meet the expectations of mainstream school policies, including behaviour standards
What we offer
What we offer
  • £300 refer a friend scheme
  • Mileage paid in line with West Sussex CC policies
  • Fulltime
Read More
Arrow Right
New

Special Educational Needs (SEN) Teaching Assistant

We're looking for an exceptional and compassionate Special Educational Needs (SE...
Location
Location
United Kingdom , Lancing
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
June 10, 2026
Flip Icon
Requirements
Requirements
  • Experience in supporting children with complex learning needs
  • Passionate about inclusive education and empowering every child
  • Patient, empathetic, and adaptable
  • Excellent communicator
  • Committed to safeguarding and promoting the welfare of children
Job Responsibility
Job Responsibility
  • Support pupils both individually and in small groups
  • Work closely with class teachers to implement highly personalised learning plans
  • Assist with classroom activities
  • Contribute to a nurturing and engaging learning environment
  • Fulltime
Read More
Arrow Right
New

Sen teaching assistant

Make a Difference Every Day: Join A Supportive Team at This Exceptional School! ...
Location
Location
United Kingdom , Worthing
Salary
Salary:
18760.00 - 19057.41 GBP / Year
https://www.randstad.com Logo
Randstad
Expiration Date
May 28, 2026
Flip Icon
Requirements
Requirements
  • Be committed to safeguarding and promoting the welfare of children
  • Have the ability to follow all safeguarding policies and procedures
  • Be caring and understanding of children's needs
  • Have high expectations of children's attainment and behaviour
  • Be very well organised & efficient
  • Be open to advice, feedback and guidance from colleagues
  • Be able to work as part of a team
  • Have experience of directly working with children with SEN
  • Have at least NVQ level 3 or equivalent
Job Responsibility
Job Responsibility
  • Be a Champion for Students: Work alongside teachers to create a stimulating learning environment and provide individual support to students
  • Contribute to a Positive Learning Culture: Help create a welcoming and supportive atmosphere where every student feels valued and empowered
  • Promote Student Well-being: Ensure that students feel safe, nurtured, and confident in their learning journey
What we offer
What we offer
  • Competitive Pay: £18,760.00 -£19,057.41 actual salary
  • Term-time only working
  • An attractive and well-resourced school
  • Opportunities for professional development
  • Enrolment onto their company pension scheme
  • £300 Refer a Friend Bonus
  • Fulltime
Read More
Arrow Right