CrawlJobs Logo

Principal ML Engineer, CoreAI

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

139900.00 - 274800.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

You’ll help build core generative AI and multimodal capabilities that power customer-facing AI services at global scale. In this role, you’ll combine strong software engineering with applied ML expertise to design, ship, and operate production systems—using techniques like context engineering, synthetic data generation, and rigorous evaluation/metrics to continuously improve quality. You’ll partner closely across product, research, and service engineering to deliver secure, performant improvements for enterprise customers.

Job Responsibility:

  • Design, build, and operate production-grade generative AI and multimodal systems, with end-to-end ownership from concept through deployment and service operations
  • Lead technical design for core GenAI capabilities (e.g., retrieval-augmented generation, context and memory, orchestration) and make data-driven tradeoffs across quality, latency, cost, and safety
  • Define and improve model and system quality using evaluation frameworks, experiment design, and production telemetry
  • ensure robust testing and regression coverage
  • Collaborate with security, privacy, and compliance partners to build solutions that meet enterprise requirements and align with Responsible AI standards and practices
  • Provide technical leadership across teams by setting direction, reviewing designs, unblocking execution, and mentoring engineers on architecture, coding standards, and ML engineering best practices
  • Partner with product and customers to understand scenarios, translate requirements into well-designed APIs and developer experiences, and drive adoption through documentation and samples

Requirements:

  • Bachelor's Degree in Computer Science or related technical field and 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python or equivalent experience
  • Advanced degree in Computer Science, Machine Learning, or related field
  • Demonstrated technical leadership through influence (e.g., leading designs, setting architecture direction, mentoring engineers)
  • Experience with prompt engineering, retrieval-augmented generation (RAG), and memory/agent frameworks
  • Experience building and shipping generative AI systems (including multimodal scenarios)
  • Familiarity with compliance and security standards in enterprise AI solutions
  • Track record of delivering enterprise-facing AI products at scale
  • Experience building and operating ML/AI systems in cloud environments
  • familiarity with MLOps practices (Azure a plus)
  • Experience partnering with cross-functional stakeholders to define requirements and drive technical decisions

Additional Information:

Job Posted:
March 05, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Microsoft Corporation - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal ML Engineer, CoreAI

Principal Software Engineer - CoreAI

Software quality is being redefined by AI. As part of the Microsoft Playwright t...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Bachelor's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • 3+ years of experience with AI LLM models, such as OpenAI, Azure AI, ML
  • 3+ years of experience with browser engineering
  • 3+ years of experience with network security
Job Responsibility
Job Responsibility
  • Leads identification of dependencies and the development of design documents for a product, application, service, or platform
  • Leads by example and mentors others to produce extensible and maintainable code used across products
  • Leverages subject-matter expertise of cross-product features with appropriate stakeholders (e.g., project managers) to drive multiple group's project plans, release plans, and work items
  • Holds accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions
  • Proactively seeks new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and shares knowledge with other engineers
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, CoreAI

The GenAI Infrastructure and Solutions team is building large-scale GenAI traini...
Location
Location
United States , Redmond
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field and 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python or equivalent experience.
  • 6+ years designing, developing, and shipping high quality software.
  • 3+ years of experience with distributed systems and cloud-based infrastructure.
  • 2+ years of experience with containerization tools (e.g., Docker, Kubernetes).
  • 2+ years of experience with DevOps practices (CI/CD, automated testing, deployment, etc.).
  • Passionate and self-motivated. Strong ability in self-learning, entering new domain, managing through uncertainty in an innovative team environment.
  • Familiarity with virtualization technology.
  • Familiarity with production ML systems and concepts like model serving, caching, batching, and monitoring.
Job Responsibility
Job Responsibility
  • Lead the collaboration with engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models.
  • Design, build and improve services with high scalability and reliability.
  • Design and implement the services to serve the prod traffic and fulfill the security and privacy requirements.
  • Lead the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments.
  • Contribute to the deployment and monitoring of services in production environments.
  • Fulltime
Read More
Arrow Right

Principal Product Manager

At Microsoft, we are building the world’s most trusted and developer‑centric AI ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in engineering, computer science, or a related technical field
  • Significant experience (typically 8–12+ years) in product management or software engineering with substantial product ownership, including experience working on platform or infrastructure products
  • Demonstrated ability to operate effectively in large, ambiguous, multi‑team environments with shared ownership and complex dependencies
  • Strong technical depth in cloud platforms, distributed systems, or AI/ML infrastructure, with the ability to engage credibly with senior engineers and architects
  • Proven track record of influencing strategy, driving alignment, and delivering outcomes through collaboration rather than direct authority
  • Strong analytical and systems‑thinking skills, with experience making high‑quality decisions in fast‑moving, evolving problem spaces
Job Responsibility
Job Responsibility
  • Act as a senior contributor to platform strategy for Azure AI Foundry and Azure ML, helping shape multi-year investments across model training, customization, deployment, and lifecycle management
  • Drive alignment and progress across federated, cross-organizational initiatives, working with peer Principal PMs and multiple engineering teams on shared platform outcomes
  • Contribute to the definition and evolution of high-leverage platform abstractions (APIs, SDKs, workflows) that enable scalable adoption of GenAI and custom code training workloads
  • Partner closely with senior engineering leaders to influence architectural direction, surface trade-offs, and ensure platform capabilities meet scale, reliability, and security expectations
  • Engage with strategic customers and internal stakeholders to gather insights, validate requirements, and translate learnings into durable, reusable platform capabilities
  • Use data, metrics, and experimentation to evaluate impact and inform product decisions across shared ownership areas
  • Serve as a thought leader and mentor within CoreAI, elevating product craft, platform thinking, and responsible AI practices across the organization
  • Fulltime
Read More
Arrow Right

Principal Product Manager - Microsoft Foundry (CoreAI Efficiency)

We are building the industry’s leading AI-first application stack with enhanced ...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
  • 10+ years of experience in product development
  • Experience delivering one or more AI, cloud services, enterprise grade solutions, and mobile apps
  • Proven success in launching and scaling multi-million dollar revenue products, ideally in AI, ML, or platform domains
  • Technical fluency in model performance evaluation, usability, and integration strategies
  • Product led growth focus with data-driven decision-making skills
  • Executive presence and stakeholder management capabilities
  • Experience leading cross-functional teams and managing complex dependencies
  • Ability to thrive in fast-paced environments with a bias for action
Job Responsibility
Job Responsibility
  • Lead strategy and execution for increasing experimentation velocity, reducing time-to-insight, and accelerating time-to-realize efficiency
  • Reduce friction in the end-to-end experimentation process from hypothesis generation and experiment design to deployment and analysis
  • Define and track efficiency metrics, manage dependencies, and lead experimentation to drive Microsoft Foundry product growth and demonstrate efficiency gains
  • Collaborate with engineering, data science, and partner teams to develop and enhance our experimentation platform and tools
  • Drive alignment across teams to support experimentation initiatives, and ensure that insights from experiments translate into tangible improvements in our generative AI platform
  • Foster an organization-wide culture of experimentation and evidence-based innovation
  • Promote agility and learning, empowering teams to make data-driven decisions and continuously improve our AI systems at a faster pace
  • Develop compelling product narratives and performance dashboards for executive-level communication and decision-making
  • Provide clarity in ambiguous environments, influence stakeholders, and foster a culture of innovation and accountability
  • Fulltime
Read More
Arrow Right

Principal Product Manager - Core AI

We are part of the CoreAI – Platform and Tools division at Microsoft. Our missio...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in product management or related fields OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • 5+ years of experience designing and shipping complex products for developers, ML professionals, or similar
  • 3+ years of experience with distributed platform ecosystem (multi-tenant / real-time processing, batch computing etc.)
  • Proven experience in product management/technical program management, preferably in AI infrastructure or cloud services
  • Experience with and a deep understanding of GPUs, VM, OS and cloud infrastructure fundamentals
  • Ability to navigate ambiguity and drive clarity across complex, cross-functional initiatives
  • Experience creating solutions using Azure, AWS, or Google Cloud
  • Experience writing Python, particularly for machine learning
Job Responsibility
Job Responsibility
  • Join the CoreAI Infrastructure team at Microsoft, where we accelerate the transition and scaling of Generative AI models
  • Deliver a world-class AI Infrastructure stack that will host AI Foundry Services
  • Accountable for the platform roadmap for platform to scale AI workloads from research to production
  • Own a product area and be responsible for understanding developer needs and behaviors, defining product requirements, managing end-to-end product development, launches and iterations
  • Find a path to get things done despite roadblocks to get your work into the hands of customers quickly and iteratively
  • Enjoy working in a fast-paced, customer-first, product development cycle
  • Translate business goals into strategy, user experience and technical requirements in close collaboration with UX, Data Science, Engineering, AI research, and Product Marketing teams
  • Define goals and performance indicators, set up and oversee experiments, measure success with data and research
  • Collaborate effectively and communicate clearly with cross-functional teams, including product managers, designers, and other engineers, to build exceptional consumer-grade applications
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right
New

Forklift driver with training

This is your chance to learn a brand new skill! As a forklift driver at Timberla...
Location
Location
Netherlands , Almelo
Salary
Salary:
14.71 - 18.24 EUR / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
March 23, 2027
Flip Icon
Requirements
Requirements
  • You have your own transport to get to Almelo
  • You are available at least 40 hours per week in a 2 shift
  • You are not afraid of heights
  • You speak Dutch or English for safety reasons within the factory
Job Responsibility
Job Responsibility
  • You’ll hit the warehouse with your forklift to give pallets of clothing the perfect spot
  • Bringing pallets down for your colleagues is all part of the job
What we offer
What we offer
  • A free training to become a forklift driver
  • A starting salary of €14.71 an hour
  • Earn €18.24 per hour including shift allowances
  • Mega discounts on Timberland shoes and clothing
  • Year-end bonus of 8.33%
  • Full-time in a 2 shift
  • Fulltime
Read More
Arrow Right
New

Retail Assistant

Join the DECJUBA DREAMTEAM as a PPT Retail Assistant in our Lambton Quay store! ...
Location
Location
New Zealand , Harbour City Centre
Salary
Salary:
Not provided
decjuba.com.au Logo
Decjuba
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Passionate about all things fashion
  • Passionate about delivering AMAZING customer experiences
  • An enthusiastic team player
  • Looking for a dynamic, busy and fun work environment where no two days are the same
  • Has a minimum of 1 years' experience in a fashion retail environment
  • Has flexible availability to work (weekends and late-night trade when required)
Job Responsibility
Job Responsibility
  • Provide AMAZING customer experiences
  • Help your team drives sales
What we offer
What we offer
  • Up to 50% Team Member discount on clothing & accessories
  • Monthly clothing allowance
  • Committed to providing an AMAZING working environment
  • Continuous growth and development opportunities
  • Opportunity to learn from the best in the business
  • Parttime
Read More
Arrow Right
New

Pharmacy Technician

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Natick
Salary
Salary:
17.00 - 27.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
June 06, 2026
Flip Icon
Requirements
Requirements
  • Must comply with any state board of pharmacy requirements or laws governing the practice of pharmacy, which includes but is not limited to, age, education, and licensure/certification
  • If the state board of pharmacy does not address or mandate a minimum age requirement, must be at least 16 years of age
  • If the state board of pharmacy does not address or mandate a minimum educational requirement, must have a high school diploma or equivalent, or be actively enrolled in high school or high school equivalency program
  • State-level licensure and national certification requirements vary by state
Job Responsibility
Job Responsibility
  • Living our purpose by following all company SOPs at each workstation to help our Pharmacists manage and improve patient health
  • Following pharmacy workflow procedures at each pharmacy workstation (i.e., production, pick-up, drive-thru, and drop-off) for safe and accurate prescription fulfillment
  • Contributing to positive patient experiences by showing empathy and genuine care: creating heartfelt and personalized moments while serving patients at pick-up, drive-thru, and over the phone
  • keeping patients healthy by offering immunizations and other services at the register and over the phone
  • and demonstrating compassionate care by solving or escalating patient problems
  • Completing basic inventory activities, as permitted by law, and as directed by the pharmacy leadership team, such as accurately putting away medication deliveries and completing cycle counts, returns-to-stocks, waiting bin inventories, etc.
  • Contributing to a high-performing team, embracing a growth mindset, and being receptive to feedback
  • actively seeking opportunities to expand clinical and technical knowledge needed to better assist patients
  • Remaining flexible for both scheduling and business needs, while contributing to a safe, inclusive, and engaging team dynamic
  • voluntarily traveling to stores in the market to work shifts as needed by the business
What we offer
What we offer
  • medical, dental, and vision coverage
  • paid time off
  • retirement savings options
  • wellness programs
  • Fulltime
Read More
Arrow Right