Senior Applied Scientist - M365 Copilot Job at Microsoft Corporation (Beijing)

Senior Applied Scientist - M365 Copilot

Microsoft Corporation

Location:
China , Beijing

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

As a Senior Applied Scientist specializing in Prompt Efficiency, you will be responsible for analyzing telemetry via M365 Copilot and Azure Open AI, as well as defining and validating metrics to assess prompt efficiency. You will deliver prompt efficiency metrics in both offline (shadow) and online evaluations. This position demands strong technical ownership, effective cross-team collaboration, and the aptitude to establish and apply measurement frameworks that ensure prompts in each feature are optimized for efficiency.

Job Responsibility:

Design, develop, and validate performance metrics to assess prompt efficiency
Lead the identification of dependencies and prepare documentation for evaluation methodologies and prompt efficiency metrics
Ensure the accuracy and integrity of the Prompt Efficiency Scorecard
Proactively identify new opportunities to enhance prompt efficiency
Collaborate with feature teams, platform engineers, and leadership to establish objectives, monitor progress, and promote adoption of cost-saving initiatives
Provide mentorship to junior engineers while fostering a culture dedicated to experimentation, data-driven measurement, and ongoing improvement

Requirements:

Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)
OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research) OR equivalent experience
Proficient in metrics evaluation pertaining to Al products
Strong coding skills in Python, C#, or similar languages
Demonstrated expertise in large language models (LLMs), prompt engineering, or deployment of Al models
Outstanding skills in communication, teamwork, and leadership
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have:

Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
OR equivalent experience
3+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers)
Experience presenting at conferences or other events in the outside research/industry community as an invited speaker
3+ years experience conducting research as part of a research program (in academic or industry settings)
1+ year(s) experience developing and deploying live production systems, as part of a product team
1+ year(s) experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping
Familiarity with Azure OpenAI, metrics platforms, and experimentation frameworks
Experience integrating metrics into product scorecards and flight review processes

Additional Information:

Job Posted:
March 21, 2026

Employment Type:

Fulltime

Work Type:

On-site work

Microsoft Corporation - All Job Offers

Job Link Share: