This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
In the era of artificial intelligence (AI), efficiency across every layer of the compute stack—from software to hardware to physical infrastructure—is essential. As AI workloads grow rapidly, Microsoft continues to invest in systems that remain reliable, cost‑effective, and sustainable. This role is an opportunity for individuals who are motivated by complex systems challenges and interested in shaping the future of AI and cloud computing. As a Principal Architect in the One Fleet Efficiency (OFE) organization, you will partner across engineering teams and organizational boundaries to deliver architectural improvements that strengthen the efficiency of AI and cloud software, hardware, and infrastructure. Your work will span optimizing inference and training workloads, influencing the design of next‑generation datacenters, and contributing to advancements in cloud platforms. This role provides the opportunity to lead high‑impact technical initiatives, develop insight across the entire AI stack—from model to silicon to datacenter—and influence Microsoft's long‑term infrastructure strategy.
Job Responsibility:
Partner with engineering and infrastructure teams to define and execute strategies that improve efficiency across the AI stack
Lead architectural reviews and pathfinding efforts for high-impact systems, including inference platforms, training clusters, and datacenter designs
Write proof-of-concept code and conduct deep technical investigations to validate architectural decisions
Make impactful decisions that influence product deployment, cost, and sustainability outcomes
Ensure robust telemetry and incident response processes for critical AI services and infrastructure
Serve as a mentor and role model in technical leadership for earlier in career engineers
Requirements:
Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements
Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Nice to have:
Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
5+ years of experience collaborating across teams and organizations
5+ years of experience with cloud platforms or distributed systems
Exposure or familiarity with datacenter infrastructure or server hardware