This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
The GenAI Infrastructure and Solutions team is building large-scale GenAI training infrastructure, LLM-based solutions and tools. We provide the infrastructure for teams in CoreAI and other Microsoft Groups to fine-tune LLMs and serve agentic workload for their own scenarios. As a Software Engineer II, you will work on the infrastructure and tools to support large scale model fine-tuning, evaluation, and inference.
Job Responsibility:
Collaborate with senior engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models
Design, build and improve the services with high scalability and reliability
Contribute to the deployment and monitoring of services in production environments
Participate in the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments
Requirements:
Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Nice to have:
2+ years of software development experience in C#, C++, Python, or similar languages
1+ year of experience with containerization tools (e.g., Docker, Kubernetes)
Familiarity with production ML systems and concepts like model serving, caching, batching, and monitoring
2+ years designing, developing, and shipping high quality software
1+ years of experience with distributed systems and cloud-based infrastructure
1+ year of experience with DevOps practices (CI/CD, automated testing, deployment, etc.)