This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Help build the end-to-end Generative AI stack for Responsible AI at Microsoft. Lead the development of global, enterprise-scale systems for LLM hosting, inference orchestration, and agentic workflows to ensure AI systems are safe, reliable, and grounded. We are looking for experts in distributed systems and high-performance backend engineering to solve complex challenges in AI alignment, task adherence, and autonomous tool-use at scale. The CoreAI organization builds the fundamental AI backbone for Microsoft’s flagship products, including GitHub, Office, Teams, and Windows. Within this group, the Responsible AI team is at the forefront of Azure AI innovation, building the global infrastructure required to run the world's largest AI workloads safely. Our mission is to identify, measure, and mitigate risks across all content modalities. As a Principal Software Engineer, you will join a talented multidisciplinary team of engineers, scientists, and product managers to build industry-leading AI services. You will architect the infrastructure required for agent workflow management and real-time safety guardrails. This role is central to hosting and orchestrating models at scale, integrating deeply with platforms such as Microsoft Foundry, Azure AI Content Safety, and Azure OpenAI Service
Job Responsibility:
Own and lead the architecture for complex, high-availability AI services, ensuring scalability, resiliency, and low-latency performance
Improve AI tools and practices across the SDLC, incorporating Responsible AI controls into the system backbone
Lead the integration of new AI services with existing platforms such as Microsoft Foundry, Azure AI Content Safety, and Azure OpenAI Service
Mentor teams in producing extensible, secure, and maintainable code. Identify effective practices in GenAI coding patterns and drive high-quality validation strategies
Identify and manage upstream/downstream dependencies, collaborating with partner teams to ensure seamless end-to-end testing and live site coverage
Act as a lead for security-by-design, ensuring AI safety features are implemented and regulatory audit trails are maintained
Requirements:
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Proven experience in building high-scale distributed systems and high-availability services
Deep understanding of the AI lifecycle, specifically regarding model inference and system-level optimization
Ability to meet Microsoft, customer, and/or government security screening requirements, including: Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Nice to have:
Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience