CrawlJobs Logo

Senior and Principal Applied Scientists

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

119800.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

You're joining Core AI, the team at the forefront of redefining how software is built and experienced. We create the foundational platforms, services, and developer experiences that power next-generation applications using Generative AI, enabling developers and enterprises to unlock the full potential of AI to build intelligent, adaptive, and transformative software. You will be a technical contributor driving the applied science foundation for observability in AI agents and multi-agent systems running at scale. This role focuses on understanding how intelligent agents behave in production—their quality, safety, reliability, cost, and evolution over time. You will develop and apply scientific methods, evaluation frameworks, and measurement systems that help teams understand, benchmark, diagnose, and safely improve agent-based systems with confidence. AI agents introduce fundamentally new observability challenges: non-deterministic execution, tool- and model-driven decision paths, emergent multi-agent behaviors, and quality signals that go far beyond traditional uptime metrics. We are hiring multiple Senior and Principal Applied Scientists who will operate at the intersection of agent architecture, telemetry, evaluation science, and responsible AI, shaping how Microsoft measures and improves observable AI systems.

Job Responsibility:

  • Develop evaluation and measurement frameworks for single-agent and multi-agent systems, spanning quality, safety, reliability, cost, and behavioral consistency
  • Design methodologies that connect offline evals, online signals, and production telemetry to explain how prompt, tool, model, or orchestration changes affect real-world agent performance
  • Define scientifically grounded quality signals and benchmarks for agent systems, including task success, tool-use effectiveness, plan quality, failure modes, coordination quality, and user-perceived outcomes
  • Build models and analysis techniques that help detect regressions, identify root causes, and characterize agent behavior across diverse workflows and environments
  • Advance observability for AI systems through new approaches to trace analysis, agent health modeling, behavioral clustering, anomaly detection, and multi-agent coordination analysis
  • Partner with engineering teams to operationalize evaluation and observability methods in production systems, enabling safe iteration through staged rollouts, experimentation, A/B testing, and automated regression detection
  • Contribute to instrumentation and semantic standards for agent observability, helping make agent execution more explainable, diagnosable, and comparable across systems
  • Collaborate deeply with product and platform teams across Foundry, Azure Monitor, and agent runtimes to shape end-to-end experiences for evaluation, benchmarking, monitoring, and investigation
  • Act as a technical leader by setting scientific direction, driving research-informed product decisions, mentoring others, and raising the technical bar across the organization

Requirements:

  • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)
  • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have:

  • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 9+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience
  • Experience designing evaluation methodologies, experiments, or measurement systems for complex intelligent or distributed systems
  • Experience analyzing large-scale production or experimental data to derive actionable insights and drive product or system improvements
  • Strong coding and prototyping skills in Python or similar languages, with the ability to work closely with engineering teams on production-facing systems
  • Demonstrated ability to lead cross-team technical direction through scientific depth, influence, and strong problem framing
  • Advanced degree in Computer Science, Machine Learning, Statistics, Applied Mathematics, or related field
  • Experience building or evaluating LLM- or agent-based systems in production
  • Familiarity with agent frameworks such as LangChain, LangGraph, OpenAI SDK, or equivalent orchestration frameworks
  • Experience with evaluation frameworks for AI systems, including benchmarking, regression analysis, and human-in-the-loop assessment
  • Experience with observability systems, telemetry analysis, or distributed tracing data in large-scale environments
  • Background in AI safety, guardrails, and responsible AI measurement
  • Experience with experimentation platforms, causal inference, or statistical methods for product and model evaluation
  • Experience working with cloud-scale monitoring platforms such as Azure Monitor / Application Insights or equivalent

Additional Information:

Job Posted:
May 16, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Microsoft Corporation - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior and Principal Applied Scientists

Senior Principal Data Scientist

You will be part of a world-class Data Science team that leverages data to drive...
Location
Location
United States
Salary
Salary:
193500.00 - 303150.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven track record of driving projects or programs that have had a significant impact on business strategy and performance
  • Excels at advising, presenting to and serving as a thought partner to senior executives
  • 10+ years of experience in Data Science or related fields
  • Expertise in SQL and another data manipulation programming language (e.g., Python, R)
  • Proficiency in at least one visualization tool (e.g., Tableau, R-Shiny, Looker)
  • Expertise in applying a broad variety of statistical concepts (e.g. regressions, A/B tests, clustering, probability) to business problems and a strong sense of when to adapt/combine approaches to suit the problem at hand
  • Experience leading and mentoring teams, with a focus on achieving strategic objectives
Job Responsibility
Job Responsibility
  • Identify key business challenges and develop strategic initiatives for your cross-functional business partners, be a trusted strategic partner, and build credibility
  • Influence Atlassian Intelligence product strategy and roadmaps, and drive impactful change through the structure and clarity of your analysis and recommendations
  • Lead and prioritize multiple workstreams and/or large complex data science programs. In collaboration with your data science team and your business partners, you will be making informed decisions about priorities, timing, and resourcing
  • Drive best practice techniques for communicating complex, unfamiliar, challenging, and/or difficult information, including the development and use of frameworks and conceptual models
  • Lead the evolution of data assets in your team. Coordinate with and influence other data science and engineering teams working on Atlassian Intelligence to ensure alignment of metrics, measurement, and analysis methodologies
  • Leverage broader industry knowledge to establish frameworks to measure customer engagement with and quality of Atlassian intelligence features
  • Actively share your work and knowledge to benefit work done across data science
  • Proactively enable your data science team to address business needs and navigate change and ambiguity
  • Use your experience and expertise to identify, solve, and bridge gaps/problems across data science and drive programs of work impacting organizational processes that scale Atlassian
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • benefits
  • bonuses
  • commissions
  • equity
  • Fulltime
Read More
Arrow Right

Senior / Principal Machine Learning Scientist

Our mission is to restore cell health and resilience through cell rejuvenation t...
Location
Location
United Kingdom , Cambridge
Salary
Salary:
136000.00 - 261050.00 GBP / Year
altoslabs.com Logo
Altos Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ph.D. in Machine Learning, Computer Science, Artificial Intelligence, Statistics, or a related quantitative field
  • 6+ years of relevant post-PhD work experience in either an academic or industry setting
  • Proven experience developing and applying complex machine learning models
  • A strong track record of leading and publishing innovative, peer-reviewed research in top-tier ML conferences or high-impact scientific journals
  • Excellent scientific communication skills
  • Expertise in several of the following: deep learning, reinforcement learning, generative models, language models, computer vision, Bayesian inference, causal reasoning & inference, transfer & multi-task learning, graph neural networks, active learning, hybrid mechanistic/ML models
  • Proven experience applying sophisticated ML techniques to molecular and cell biological data sets
Job Responsibility
Job Responsibility
  • Pioneer novel machine learning methodologies and statistical frameworks
  • Contribute to setting the long-term technical vision and research strategy for a core domain within the Institute of Computation
  • Translate your deep understanding of the mathematical and theoretical underpinnings of cutting-edge AI research into high-impact applications
  • Design, implement, and optimize large-scale machine learning systems using modern frameworks and agile practices
  • Develop and manage efficient distributed training strategies across multiple GPUs and compute clusters
  • Develop robust approaches for multi-modal data integration and cross-domain mapping to extract actionable biological insights
  • Apply computational thinking to solve problems in drug target identification, compound assessment, and prediction of cellular perturbation responses
  • Lead the full ML development lifecycle from theoretical conception and data strategy through model development, training, and evaluation
  • Act as a key technical mentor to Machine Learning Scientists and Engineers
  • Fulltime
Read More
Arrow Right

Senior / Principal Machine Learning Scientist

Our mission is to restore cell health and resilience through cell rejuvenation t...
Location
Location
United States , Redwood City; San Diego
Salary
Salary:
260950.00 - 509450.00 USD / Year
altoslabs.com Logo
Altos Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ph.D. in Machine Learning, Computer Science, Artificial Intelligence, Statistics, or a related quantitative field
  • 6+ years of relevant post-PhD work experience in either an academic or industry setting
  • Proven experience developing and applying complex machine learning models
  • A strong track record of leading and publishing innovative, peer-reviewed research in top-tier ML conferences or high-impact scientific journals
  • Excellent scientific communication skills
  • Expertise in several of the following: deep learning, reinforcement learning, generative models, language models, computer vision, Bayesian inference, causal reasoning & inference, transfer & multi-task learning, graph neural networks, active learning, hybrid mechanistic/ML models
  • Proven experience applying sophisticated ML techniques to molecular and cell biological data sets
Job Responsibility
Job Responsibility
  • Pioneer novel machine learning methodologies and statistical frameworks
  • Contribute to setting the long-term technical vision and research strategy for a core domain
  • Translate your deep understanding of the mathematical and theoretical underpinnings of cutting-edge AI research into high-impact applications
  • Design, implement, and optimize large-scale machine learning systems
  • Develop and manage efficient distributed training strategies across multiple GPUs and compute clusters
  • Develop robust approaches for multi-modal data integration and cross-domain mapping
  • Apply computational thinking to solve problems in drug target identification, compound assessment, and prediction of cellular perturbation responses
  • Lead the full ML development lifecycle
  • Act as a key technical mentor to Machine Learning Scientists and Engineers
Read More
Arrow Right

Senior Principal Machine Learning Engineer

You’ll form a new team of passionate engineers dedicated to building and scaling...
Location
Location
United States
Salary
Salary:
222300.00 - 348975.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s, Master’s, or PhD in Computer Science, Statistics, Mathematics, or a related field, or equivalent practical experience
  • 12+ years of industry experience in machine learning, data science, or AI, with a proven track record of delivering production-grade ML systems
  • Deep expertise in Python, Go, or Java, with the ability to write performant, production-quality code
  • familiarity with SQL, Spark, and cloud data environments (e.g., AWS, GCP, Databricks)
  • Experience building and scaling ML models for business-critical applications, ideally in security, privacy, anti-abuse, or compliance domains
  • Strong communication skills, able to explain complex ML concepts to diverse audiences and influence stakeholders
  • Demonstrated ability to solve ambiguous, complex problems and drive projects from ideation to production
  • Agile development mindset, with a focus on iterative improvement and business impact
Job Responsibility
Job Responsibility
  • Lead AI/ML Strategy for Trust: Drive the development and implementation of advanced machine learning algorithms and AI systems for Trust, Security, Product Abuse, and Compliance use cases (e.g., threat detection, vulnerability management, privacy automation, AI safety)
  • Architect and Scale ML Platforms: Design and build scalable, secure, and reliable ML infrastructure and pipelines, ensuring compliance with privacy and regulatory requirements
  • AI Safety and Responsible AI: Develop and champion AI safety practices, including output moderation, explainability, and alignment with evolving regulatory frameworks
  • Cross-Functional Collaboration: Partner with product, engineering, security, privacy, and analytics teams to deliver transformative AI/ML solutions that enhance Atlassian’s trust posture
  • Mentorship and Leadership: Mentor and guide ML engineers and data scientists, fostering a culture of technical excellence, innovation, and continuous improvement
  • Innovation and Research: Stay at the forefront of AI/ML research, evaluating and applying the latest techniques (e.g., LLMs, anomaly detection, privacy-preserving ML) to real-world Trust challenges
  • Platform Enablement: Build reusable ML services and APIs that empower other teams to integrate AI/ML into their products and workflows
  • Operational Excellence: Ensure high availability, reliability, and security of all ML-powered Trust platforms and services
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
  • benefits, bonuses, commissions, and equity
  • Fulltime
Read More
Arrow Right

Senior Principal Product Manager, Confluence AI

As a Senior Principal Product Manager on the AI team for our Confluence product,...
Location
Location
United States , San Francisco
Salary
Salary:
183200.00 - 294400.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in product management, with a focus on AI, machine learning, or related technologies
  • Proven track record of successfully leading cross-functional teams to deliver complex software projects and successfully iterating on functionality through experimentation
  • Strong understanding of AI and machine learning concepts, with experience in applying these technologies to real-world products and solutions
  • Excellent communication and interpersonal skills, with the ability to convey complex ideas to both technical and non-technical stakeholders
  • Demonstrated ability to thrive in fast-paced environments with high levels of ambiguity, where priorities may shift rapidly and flexibility is essential for success
Job Responsibility
Job Responsibility
  • Own the vision and roadmap for AI within Confluence
  • Act as an AI leader across Atlassian, shaping the overall product strategy and thinking of AI from your vantage point within Confluence
  • Lead a direct cross-functional team of ~60 engineers, designers, data scientists, and other discipline leads to deliver high-quality AI functionality and features to end users
  • Collaborate closely with internal Confluence teams to support the integration of AI capabilities into their feature development process, ensuring alignment with AI program goals and coherence of experiences
  • Work closely with partner teams, including central platform teams, to align on vision, strategy, and execution plans for AI initiatives across Atlassian products
  • Define key results (KRs) and metrics to measure the success and impact of AI features, and use data-driven insights to iterate and improve
  • Meet regularly with customers to gather feedback and requirements, and to obtain a deep understanding of customer pain points
  • Stay informed about industry trends, emerging technologies, and competitive landscape related to AI and machine learning, and leverage this knowledge to drive innovation within Confluence
  • Act as a subject matter expert on AI technologies and methodologies, providing guidance and mentorship to team members and stakeholders
  • Communicate effectively with stakeholders at all levels of the organization, including executive leadership
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

You will be part of a world-class Data Science team that leverages data to drive...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ Years of Experience in Data Science or related fields
  • Proficiency in SQL AND another data manipulation programming language (e.g Python, R)
  • Expertise at telling stories with data and familiarity with at least one visualization tool (e.g. Tableau, R-Shiny, Microstrategy, SAP Business Objects, Looker, etc.)
  • Expertise in applying a broad variety of statistical concepts (e.g. regressions, A/B tests, clustering, probability) to business problems and a strong sense of when to adapt/combine approaches to suit the problem at hand
  • Experience driving projects or programs which have had proven impact on business strategy and performance through your analytics skills
  • A proven track record for crafting analysis into well-written content
  • Experience advising, presenting to and serving as a thought partner to senior executives
Job Responsibility
Job Responsibility
  • Collaborate on a variety of product and business problems with a diverse set of cross-functional partners and become a trusted strategic partner through the structure and clarity of your work
  • Apply technical expertise with quantitative analysis, experimentation, and the presentation of data to develop strategies for our business and help solve the business's biggest challenges
  • Focus on developing hypotheses through analytical approaches, different methodologies, frameworks, and technical approaches to test them
  • Define, understand, and test opportunities to improve the products and business and influence roadmaps through insights and recommendations
  • Partner with cross-functional teams to inform, influence, and execute strategy decisions
  • Identify and measure the success of product efforts through forecasting and monitoring of key product metrics to understand trends
  • You will use data to shape product development, quantify new opportunities, identify upcoming challenges, and ensure the products we build bring value to people, businesses, and Atlassian
  • You will use storytelling techniques to communicate insights broadly, including to company leadership teams
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

You will be part of a world-class Data Science team that leverages data to drive...
Location
Location
United States , San Francisco
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ Years of Experience in Data Science or related fields
  • Proficiency in SQL AND another data manipulation programming language (e.g Python, R)
  • Expertise at telling stories with data and familiarity with at least one visualization tool (e.g. Tableau, R-Shiny, Microstrategy, SAP Business Objects, Looker, etc.)
  • Expertise in applying a broad variety of statistical concepts (e.g. regressions, A/B tests, clustering, probability) to business problems and a strong sense of when to adapt/combine approaches to suit the problem at hand
  • Experience driving projects or programs which have had proven impact on business strategy and performance through your analytics skills
  • A proven track record for crafting analysis into well-written content
  • Experience advising, presenting to and serving as a thought partner to senior executives
Job Responsibility
Job Responsibility
  • Collaborate on a variety of product and business problems with a diverse set of cross-functional partners and become a trusted strategic partner through the structure and clarity of your work
  • Apply technical expertise with quantitative analysis, experimentation, and the presentation of data to develop strategies for our business and help solve the business's biggest challenges
  • Focus on developing hypotheses through analytical approaches, different methodologies, frameworks, and technical approaches to test them
  • Define, understand, and test opportunities to improve the products and business and influence roadmaps through insights and recommendations
  • Partner with cross-functional teams to inform, influence, and execute strategy decisions
  • Identify and measure the success of product efforts through forecasting and monitoring of key product metrics to understand trends
  • Use data to shape product development, quantify new opportunities, identify upcoming challenges, and ensure the products we build bring value to people, businesses, and Atlassian
  • Use storytelling techniques to communicate insights broadly, including to company leadership teams
What we offer
What we offer
  • Health and wellbeing resources
  • Paid volunteer days
  • Equity
  • Bonuses
  • Commissions
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

At Atlassian, we're motivated by a common goal: to unleash the potential of ever...
Location
Location
United States , San Francisco
Salary
Salary:
201300.00 - 268400.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ Years of Experience in Data Science or related fields
  • Proficiency in SQL AND another data manipulation programming language (e.g Python, R)
  • Expertise at telling stories with data and familiarity with at least one visualization tool (e.g. Tableau, R-Shiny, Microstrategy, SAP Business Objects, Looker, etc.)
  • Expertise in applying a broad variety of statistical concepts (e.g. regressions, A/B tests, clustering, probability) to business problems and a strong sense of when to adapt/combine approaches to suit the problem at hand
  • Experience driving projects or programs that have had a proven impact on business strategy and performance through your analytics skills
  • A proven track record for crafting analysis into well-written and persuasive content
  • Experience advising, presenting to and serving as a thought partner to senior executives
Job Responsibility
Job Responsibility
  • Collaborate on a variety of product and business problems with a diverse set of cross-functional partners, become a trusted strategic partner, and build credibility through the structure and clarity of your work
  • Apply technical expertise with quantitative analysis, experimentation, and the presentation of data to develop strategies for our business and help solve the business's biggest challenges
  • Focus on developing hypotheses through analytical approaches, different methodologies, frameworks, and technical approaches to test them
  • Define, understand, and test opportunities to improve the products and business and influence roadmaps through insights and recommendations
  • Partner with cross-functional teams to inform, influence, and execute strategy decisions
  • Identify and measure the success of product efforts through forecasting and monitoring of key product metrics to understand trends
  • You will use data to shape product development, quantify new opportunities, identify upcoming challenges, and ensure the products we build bring value to people, businesses, and Atlassian
  • You will use storytelling techniques to communicate insights broadly, including to company leadership teams
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
  • Bonuses
  • Commissions
  • Equity
  • Fulltime
Read More
Arrow Right