Senior Software Engineer Job at Microsoft Corporation (Vancouver)

Senior Software Engineer

Microsoft Corporation

Location:
Canada , Vancouver

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

114400.00 - 203900.00 CAD / Year

Save Job

Apply Position

Job Description:

We are looking for a Senior Software Engineer to join our team to drive all aspects of AI feature fundamentals for one of the biggest modern collaboration platforms in the world - Microsoft Teams. We help feature teams ship quality AI experiences out of the gate, track key performance and reliability metrics for critical high-volume scenarios, aid feature teams in improving the debuggability of AI scenarios, help create offline and online evals for all AI features by incorporating into release pipelines and drive culture of performance by promoting best practices and consulting.

Job Responsibility:

Build and evolve the Real-Time Intelligence evaluations platform: implement offline and online eval pipelines, including golden datasets, human review workflows, and LLM-as-judge / auto-raters for agents, anomaly detectors, and decisioning systems
Instrument agentic solutions for observability by wiring up telemetry, tracing, structured logging, and dashboards so quality, safety, latency, and cost are easy to monitor and debug
Integrate evals into the development lifecycle by connecting pipelines to CI/CD, canary and A/B experiments, and phased rollouts, making it simple for partner teams to run and interpret evaluations
Collaborate and mentor across product, research, and engineering teams, sharing best practices on eval design, LLM-as-judge usage, and Responsible AI, and providing code reviews and guidance that raise the bar for the AI features

Requirements:

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
Understanding of building engineering tools on the server side for scale
2+ years of experience on engineering tooling or eval development
Prior experience in working on services at scale
Prior experience in driving fundamentals for AI features within web apps
Prior experience in working closely with AI feature teams and improving fundamentals like performance and reliability is a major plus
Experience solving challenging problems and cross team/organization collaboration skills

Nice to have:

Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
Proficiency with React is a plus

Additional Information:

Job Posted:
March 01, 2026

Employment Type:

Fulltime

Work Type:

Hybrid work

Microsoft Corporation - All Job Offers

Job Link Share: