CrawlJobs Logo

Principal Applied Scientist

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

163000.00 - 296400.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

You’re joining Core AI, the team at the forefront of redefining how software is built and experienced. We create the foundational platforms, services, and developer experiences that power next-generation applications using Generative AI, enabling developers and enterprises to unlock the full potential of AI to build intelligent, adaptive, and transformative software. You will be a technical contributor driving the applied science foundation for observability in AI agents and multi-agent systems running at scale. This role focuses on understanding how intelligent agents behave in production—their quality, safety, reliability, cost, and evolution over time. You will develop and apply scientific methods, evaluation frameworks, and measurement systems that help teams understand, benchmark, diagnose, and safely improve agent-based systems with confidence.

Job Responsibility:

  • Develop evaluation and measurement frameworks for single-agent and multi-agent systems, spanning quality, safety, reliability, cost, and behavioral consistency.
  • Design methodologies that connect offline evals, online signals, and production telemetry to explain how prompt, tool, model, or orchestration changes affect real-world agent performance.
  • Define scientifically grounded quality signals and benchmarks for agent systems, including task success, tool-use effectiveness, plan quality, failure modes, coordination quality, and user-perceived outcomes.
  • Build models and analysis techniques that help detect regressions, identify root causes, and characterize agent behavior across diverse workflows and environments.
  • Advance observability for AI systems through new approaches to trace analysis, agent health modeling, behavioral clustering, anomaly detection, and multi-agent coordination analysis.
  • Partner with engineering teams to operationalize evaluation and observability methods in production systems, enabling safe iteration through staged rollouts, experimentation, A/B testing, and automated regression detection.
  • Contribute to instrumentation and semantic standards for agent observability, helping make agent execution more explainable, diagnosable, and comparable across systems.
  • Collaborate deeply with product and platform teams across Foundry, Azure Monitor, and agent runtimes to shape end-to-end experiences for evaluation, benchmarking, monitoring, and investigation.
  • Act as a technical leader by setting scientific direction, driving research-informed product decisions, mentoring others, and raising the technical bar across the organization.

Requirements:

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice to have:

  • 6+ years of experience in applied science, machine learning, evaluation systems, or related technical fields
  • Strong experience designing evaluation methodologies, experiments, or measurement systems for complex intelligent or distributed systems
  • Experience analyzing large-scale production or experimental data to derive actionable insights and drive product or system improvements
  • Strong coding and prototyping skills in Python or similar languages, with the ability to work closely with engineering teams on production-facing systems
  • Demonstrated ability to lead cross-team technical direction through scientific depth, influence, and strong problem framing
  • Advanced degree in Computer Science, Machine Learning, Statistics, Applied Mathematics, or related field
  • Experience building or evaluating LLM- or agent-based systems in production
  • Familiarity with agent frameworks such as LangChain, LangGraph, OpenAI SDK, or equivalent orchestration frameworks
  • Experience with evaluation frameworks for AI systems, including benchmarking, regression analysis, and human-in-the-loop assessment
  • Experience with observability systems, telemetry analysis, or distributed tracing data in large-scale environments
  • Background in AI safety, guardrails, and responsible AI measurement
  • Experience with experimentation platforms, causal inference, or statistical methods for product and model evaluation
  • Experience working with cloud-scale monitoring platforms such as Azure Monitor / Application Insights or equivalent

Additional Information:

Job Posted:
March 19, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Microsoft Corporation - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Applied Scientist

Principal Applied Researcher AI/NLP

At PointClickCare our mission is simple: to help providers deliver exceptional c...
Location
Location
United States
Salary
Salary:
195800.00 - 217500.00 USD / Year
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD or comparable level of experience in Computer Science, Math, Physics, Engineering or a related field
  • 4-10+ year industry experience building solutions in commercial SaaS, including at least 4 years working in applications of NLP, Search or AI/ML technologies for healthcare
  • Strong interest in applying AI/ML/NLP to healthcare related problems and data
  • Expert-level practical, hands-on experience developing and applying a wide range of techniques in Natural Language Processing, including fine tuning of LLMs and other Transformer models, plus one or more additional AI/ML or Search related areas of expertise to solve real-world problems at scale
  • Demonstrated ability to lead and perform research and experimentation to select appropriate approaches, algorithms, evaluation methods, and frameworks, as well as tasks such as feature selection, language modeling, evaluation and fine tuning or training models, applying standard approaches or developing new tools or workflows as needed to meet project requirements
  • Significant experience building and deploying AI/machine learning and NLP models for large-scale SaaS products, including familiarity with industry standard software development concepts such as scaling issues, version control, CI/CD pipelines, and security
  • Solid understanding and experience with transformer models and multiple kinds of NLP and ML models and approaches including logistic regression, random forest, ensemble methods, SVM, KNN, reinforcement learning, and other ML techniques
  • Proficiency in Python and Java required. Proficiency in JavaScript or TypeScript and modern UI frameworks for building prototype or tool front ends desired
  • Proficiency doing data engineering for ML and NLP applications, including exposure to database systems and proficiency with SQL
  • Proficiency building models from big data using modern packages, models and data analysis stacks such as NumPy, SciPy, Pandas, Scikit-learn, PyTorch, Keras, LightGBM, fastText, NLTK, and spaCy. Proficiency fine tuning Hugging Face Transformers required
Job Responsibility
Job Responsibility
  • You will be applying NLP including GenAI and other AI/ML techniques to develop model systems and solutions, collaborating across functions to scale and integrate advanced solutions into successful end user experiences in large-scale cloud based SaaS production environments for healthcare
  • You will be working with product leaders, clinical informaticists, data scientists, UI/UX researchers and designers, other AI and machine learning and domain experts, engineering teams and others, including work with customers and users who are healthcare professionals
  • Design, build and evaluate solutions that may involve structured or unstructured data including speech or natural language for healthcare use cases, delivering capabilities such as summarization, predictive models, recommenders, semantic search, extraction, classification or other NLP, AI or machine learning based techniques
  • You will be performing research and experimentation to select appropriate approaches, algorithms, evaluation methods and frameworks and doing the R&D to deliver model systems
  • You will perform, oversee and assist in data collection, data cleaning, data analysis, algorithm selection or design, prompt tuning, parameter fine tuning, training, development and evaluation of systems that deliver responsible AI solutions at scale, using existing or developing new tools or workflows as needed
  • As a principal applied researcher, you will bring deep technical expertise and also provide mentorship on advanced AI, NLP, data science, statistical and machine learning methods and technologies, helping the organization develop new capabilities for innovative solutions
  • You will have substantial independence and responsibility from day one
What we offer
What we offer
  • Benefits starting from Day 1
  • Retirement Plan Matching
  • Flexible Paid Time Off
  • Wellness Support Programs and Resources
  • Parental & Caregiver Leaves
  • Fertility & Adoption Support
  • Continuous Development Support Program
  • Employee Assistance Program
  • Allyship and Inclusion Communities
  • Employee Recognition … and more
  • Fulltime
Read More
Arrow Right

Principal Data Scientist - Machine Learning Engineering

Atlassian is looking for a Principal Data Scientist to uncover valuable insights...
Location
Location
United States , San Francisco
Salary
Salary:
175100.00 - 233400.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience applying your Data Science skills to identify and lead projects which have had impact on business strategy and performance
  • 8+ years of experience in Data Science or related fields. (Preferred - 10+ years experience with a post-graduate degree in a quantitative discipline like Statistics, Mathematics, Econometrics, Computer science)
  • Expertise in applying a broad variety of ML methods including NLP and LLM to solve business problems and a strong sense of when to apply them to the problem at hand
  • Experience in managing ML projects end-to-end including deployment and monitoring
  • Expertise in SQL and a high level of proficiency in another data science programming language (e.g Python, R) with expertise in libraries like Pandas, Numpy, Scikit-learn etc.
  • A very high bar for output quality, while balancing 'having something now' vs. 'perfection in the future'
  • Comfort explaining complex concepts to diverse audiences and creating compelling stories for non-data experts
  • Proficiency in visualization tools (e.g. Streamlit, Tableau)
Job Responsibility
Job Responsibility
  • Influence strategy & important decisions around customer friction by surfacing data driven insights
  • Define, set and report on department level metrics or KRs to the CSS Executive team
  • Build and implement measurement frameworks, machine learning models and NLP/LLM tooling to accelerate Atlassian’s growth and improve product quality
  • Foster a world-class Data Science culture by leading training on technical concepts, driving continuous learning and mentoring Data Scientists on the team
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Principal Data Scientist - Machine Learning Engineering

We are looking for a Principal Machine Learning Data Scientist to develop and im...
Location
Location
United States , Remote
Salary
Salary:
145300.00 - 233400.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Data Science or related fields
  • Expertise in applying a broad variety of ML methods including NLP and LLM to solve business problems using large amounts of data
  • Proven track record of delivering ML projects end-to-end, including designing, development, deployment and monitoring
  • Ability to communicate and explain data science concepts to diverse audiences, craft a compelling story
  • Expertise in programming languages such as Python or Java with and the ability to write performant code, familiarity with SQL, knowledge of Spark and cloud data environments (e.g. AWS, Databricks)
  • Agile development mindset, appreciating the benefit of constant iteration and improvement
Job Responsibility
Job Responsibility
  • Develop and implement our machine learning algorithms
  • Train sophisticated models
  • Collaborate with our technical and non-technical partner teams
  • Expand our AI/ML functionality in partnership with our CSS and/or Sales organization
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • bonuses
  • commissions
  • equity
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

At Atlassian, we're motivated by a common goal: to unleash the potential of ever...
Location
Location
United States , San Francisco
Salary
Salary:
201300.00 - 268400.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ Years of Experience in Data Science or related fields
  • Proficiency in SQL AND another data manipulation programming language (e.g Python, R)
  • Expertise at telling stories with data and familiarity with at least one visualization tool (e.g. Tableau, R-Shiny, Microstrategy, SAP Business Objects, Looker, etc.)
  • Expertise in applying a broad variety of statistical concepts (e.g. regressions, A/B tests, clustering, probability) to business problems and a strong sense of when to adapt/combine approaches to suit the problem at hand
  • Experience driving projects or programs that have had a proven impact on business strategy and performance through your analytics skills
  • A proven track record for crafting analysis into well-written and persuasive content
  • Experience advising, presenting to and serving as a thought partner to senior executives
Job Responsibility
Job Responsibility
  • Collaborate on a variety of product and business problems with a diverse set of cross-functional partners, become a trusted strategic partner, and build credibility through the structure and clarity of your work
  • Apply technical expertise with quantitative analysis, experimentation, and the presentation of data to develop strategies for our business and help solve the business's biggest challenges
  • Focus on developing hypotheses through analytical approaches, different methodologies, frameworks, and technical approaches to test them
  • Define, understand, and test opportunities to improve the products and business and influence roadmaps through insights and recommendations
  • Partner with cross-functional teams to inform, influence, and execute strategy decisions
  • Identify and measure the success of product efforts through forecasting and monitoring of key product metrics to understand trends
  • You will use data to shape product development, quantify new opportunities, identify upcoming challenges, and ensure the products we build bring value to people, businesses, and Atlassian
  • You will use storytelling techniques to communicate insights broadly, including to company leadership teams
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
  • Bonuses
  • Commissions
  • Equity
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

You will be part of a world-class Data Science team that leverages data to drive...
Location
Location
United States , San Francisco
Salary
Salary:
167100.00 - 268400.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in analytics or related fields
  • 2+ years of experience managing teams of 4+
  • Advanced proficiency in SQL and knowledge of another data science programming language (e.g Python, R)
  • Proficiency in at least one analytics & visualization tool such as Tableau, Mode, Looker
  • Expertise in applying a broad variety of statistical concepts (e.g. regressions, A/B tests, clustering) to business problems and a strong sense of when to adapt/combine approaches to suit the problem at hand
  • Proven experience influencing business strategy and driving change across organizational boundaries through clear and compelling communication of data-driven insights and analyses
Job Responsibility
Job Responsibility
  • Collaborate on a variety of product and business problems with a diverse set of cross-functional partners and become a trusted strategic partner through the structure and clarity of your work
  • Apply technical expertise with quantitative analysis, experimentation, and the presentation of data to develop strategies for our business and help solve the business's biggest challenges
  • Focus on developing hypotheses through analytical approaches, different methodologies, frameworks, and technical approaches to test them
  • Define, understand, and test opportunities to improve the products and business and influence roadmaps through insights and recommendations
  • Partner with cross-functional teams to inform, influence, and execute strategy decisions
  • Identify and measure the success of product efforts through forecasting and monitoring of key product metrics to understand trends
  • Use data to shape product development, quantify new opportunities, identify upcoming challenges, and ensure the products we build bring value to people, businesses, and Atlassian
  • Use storytelling techniques to communicate insights broadly, including to company leadership teams
  • Help structure, build, and grow teams of Data Scientists to deliver strategic impact across product and business areas you support
  • Work with your team to help them grow through coaching in technical, analytical, and soft skills
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

The Principal Data Scientist – Media Attribution will lead the development of cu...
Location
Location
United States , Bellevue
Salary
Salary:
127400.00 - 229800.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in marketing and media analytics, with a focus on attribution modeling, causal inference, and media mix optimization
  • Strong background in machine learning, econometrics, and statistical modeling with applications in marketing measurement
  • Expertise in Python, R, SQL, and cloud platforms (AWS, GCP, or Azure) for scalable modeling and data processing
  • Experience with experimental design and incrementality testing in digital and traditional media channels
  • Ability to communicate complex data science concepts to both technical and non-technical stakeholders, influencing business decisions
  • Ph.D. or Master’s degree in a quantitative field (e.g., Statistics, Economics, Computer Science, Applied Mathematics)
Job Responsibility
Job Responsibility
  • Lead the development and refinement of attribution models (MTA, MMM) to quantify the impact of media investments across channels (digital, social, TV, search, etc.)
  • Advance causal inference techniques to improve media measurement, including uplift modeling, propensity scoring, and Bayesian methods
  • Develop forecasting models to predict marketing performance, budget allocation impacts, and long-term customer acquisition trends
  • Enhance ad testing methodologies, including A/B testing, synthetic control experiments, and incrementality testing, to measure media effectiveness accurately
  • Collaborate with marketing, finance, and analytics teams to translate model insights into business strategies that drive ROI improvements
  • Optimize media spend through AI-driven decisioning, leveraging reinforcement learning, Bayesian optimization, and econometric modeling
  • Stay at the forefront of AI & ML innovations in marketing measurement, driving technical advancements and thought leadership within the team
  • Work closely with data engineers to scale and automate model deployment, integrating ML solutions into production environments
What we offer
What we offer
  • medical, dental and vision insurance
  • flexible spending account
  • 401(k)
  • employee stock grants
  • employee stock purchase plan
  • paid time off
  • up to 12 paid holidays
  • paid parental and family leave
  • family building benefits
  • back-up care
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

T-Mobile’s Strategy and Corporate Development (S&CD) team is looking for a Princ...
Location
Location
United States , Bellevue; Overland Park
Salary
Salary:
127400.00 - 229800.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Quantitative Discipline (math, statistics, economics, computer science, physics, engineering)
  • Master's/Advanced Degree Quantitative Discipline (math, statistics, economics, computer science, physics, engineering)
  • 7-10 years of industry experience in predictive modeling, data science, and analysis in an ML engineer or data scientist role building and deploying ML models or hands on experience developing deep learning models
  • 7-10 years of Experience articulating and translating business questions and using statistical techniques to arrive at an answer using available data
  • 7-10 years of Experience with data scripting languages (e.g., SQL, Python, R) and Extended experience working with relational database using SQL
  • 4-7 years of Experience writing and speaking about technical concepts to business, technical, and lay audiences and giving data-driven presentations
  • 4-7 years of Experience with statistical methods and advanced modeling techniques. For example- SVM, Random Forest, graph models, Bayesian inference, NLP, Computer Vision, neural networks
  • 4-7 years of Experience with big data architecture and pipeline, Hadoop, Hive, Spark, Kafka, etc
  • 4-7 years of Experience in data visualization
  • 2-4 years Management consulting, investment banking, or corporate strategy
Job Responsibility
Job Responsibility
  • Extract, prepare, and model large, complex data sets using a combination of skills, including machine learning theory, mathematics, statistics, and programming
  • Identify critical and emerging technologies that will support and extend our consumer data, data integration, and quantitative analytic capabilities
  • Lead the implementation, assessment and standardization of advanced analytics and modeling toolkits for our data science team
  • Partner with data engineering teams to shape data management strategies, architecture, governance, pipelines, and infrastructure enabling effective modeling environments for data science teams
  • Provide senior level guidance to the data science and measurement science teams on approach and methodologies
  • Communicate important information and insights to business leaders using verbal, written, and data visualization skills
What we offer
What we offer
  • competitive base salary and compensation package
  • annual stock grant
  • employee stock purchase plan
  • 401(k)
  • access to free, year-round money coaches
  • medical, dental and vision insurance
  • flexible spending account
  • employee stock grants
  • paid time off
  • up to 12 paid holidays
  • Fulltime
Read More
Arrow Right

Principal Data Scientist

Working at Atlassian. Atlassians can choose where they work – whether in an offi...
Location
Location
United States , Seattle; San Francisco
Salary
Salary:
167100.00 - 268400.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ Years of Experience in Data Science or related fields
  • Proficiency in SQL AND another data manipulation programming language (e.g Python, R)
  • Expertise at telling stories with data and familiarity with at least one visualization tool (e.g. Tableau, R-Shiny, Microstrategy, SAP Business Objects, Looker, etc.)
  • Expertise in applying a broad variety of statistical concepts (e.g. regressions, A/B tests, clustering, probability) to business problems and a strong sense of when to adapt/combine approaches to suit the problem at hand
  • Experience driving projects or programs that have had a proven impact on business strategy and performance through your analytics skills
  • A proven track record for crafting analysis into well-written and persuasive content
  • Experience advising, presenting to and serving as a thought partner to senior executives
Job Responsibility
Job Responsibility
  • Collaborate on a variety of product and business problems with a diverse set of cross-functional partners, become a trusted strategic partner, and build credibility through the structure and clarity of your work
  • Apply technical expertise with statistical analysis, experimentation, and the presentation of data to develop strategies for our business and help solve the business's biggest challenges
  • Focus on developing hypotheses through analytical approaches, different methodologies, frameworks, and technical approaches to test them
  • Define, understand, and test opportunities to improve the products and business and influence roadmaps through insights and recommendations
  • Partner with cross-functional teams to inform, influence, and execute strategy decisions
  • Identify and measure the success of product efforts through forecasting and monitoring of key product metrics to understand trends
  • Use data to shape product development, quantify new opportunities, identify upcoming challenges, and ensure the products we build bring value to people, businesses, and Atlassian
  • Use storytelling techniques to communicate insights broadly, including to company leadership teams
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy