CrawlJobs Logo

Software Engineer II - AI Frameworks

United States, Redmond 100600.00 - 199000.00 USD / Year · Job Posted March 25, 2026
Apply Position
Job Link Share

Job Description

The AI Frameworks team at Microsoft develops AI software that enables running AI models on specialized AI Infrastructure. The team collaborate with hardware teams and hardware partners to build the software stacks for novel AI accelerators. We work closely with ML researchers and developers to optimize and scale out model training and inference. The team operates at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software. We are a cross-discipline team of highly capable and motivated people with a collaborative and inclusive culture. We collaborate with and contribute to the open-source community. As a Software Engineer II - AI Frameworks on this team, you will have the opportunity to build infrastructure as a service, work on the fundamental abstractions, programming model, runtimes, libraries, and APIs to enable large scale training and inferencing of models on novel AI hardware. This is a technical role: it requires hands on software design and development skills. We’re looking for Software Engineer II who has a demonstrated history of solving hard technical problems and is motivated to tackle the hardest problems in building a full end-to-end AI infrastrucure stack. An entrepreneurial approach and ability to take initiative and move fast are essential.

Job Responsibility

  • Apply strong engineering principles for defining robust and maintainable architectures and designs
  • Collaborate broadly across multiple disciplines, from hardware designers to ML developers
  • Help establish and drive the adoption of good coding standards and patterns
  • Perform software development in C/C++ and other languages
  • Identify requirements, scope solutions, estimate work, schedule deliverables

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++ OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Nice to have

  • Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C or C++ OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C or C++ OR equivalent experience
  • Understanding of Object-Oriented Programming (OOP)
  • CS fundamentals
  • Technical background and solid foundation in software engineering principles and architecture design
  • Understanding of networking stack / protocols
  • Experience & Know-how to developing strong processes and work-flow to debugging deployments in cloud
  • Deep intellectual curiosity and passion about learning new technologies
  • Cross-team collaboration skills and the desire to collaborate in a team of researchers and developers
  • Great cross-team collaboration skills and the desire to collaborate in a team of researchers and developers
  • 1+ years experience working with firmware or driver development in windows/linux

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer II - AI Frameworks

8 matching positions

Software Engineer II and Sr. Software Engineer - AI Frameworks

The AI Frameworks team at Microsoft develops software that pushes the cutting ed...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, or related technical discipline AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, implement, and test a function or component for our AI/ML frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Interacting and collaborating with our partners both internal and external
  • Interacting with and providing tech support for our customers/users
  • Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

Software Engineer II and Senior Software Engineer - Performance

The Artificial Intelligence Performance team at Microsoft develops AI software t...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs
  • Measure, benchmark performance on Nvidia/AMD GPUs and first party Microsoft silicon
  • Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level to improve customer experience and reduce the footprint of the computing fleet
  • Enable fast time to market of LLMs/models and their deployments at scale by building SW tools that afford velocity in porting models on new Nvidia and AMD GPUs
  • Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Communicate and collaborate with our partners both internal and external
  • Embody Microsoft's Culture and Values
  • Fulltime
Read More
Arrow Right

Software Engineer II - AI

Dynamics 365 is Microsoft’s suite of enterprise software that powers many of the...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • 1+ years of professional experience working with generative artificial intelligence, large language models, or agent-based systems
  • AI & Domain Experience: Deep expertise in one or more AI domains, with a proven track record of deploying and scaling AI models in cloud environments
  • MLOps & LLMOps: experience with MLOps workflows (CI/CD, monitoring, retraining pipelines) and familiarity with modern LLMOps frameworks
  • Cloud & Infrastructure: Skilled in building and operating infrastructure using Azure, AWS, or Google Cloud, and deploying containerized models with Docker, Kubernetes, or similar tools
Job Responsibility
Job Responsibility
  • Design and develop highly usable, scalable application capabilities, integrating AI models and enhancing existing features to meet evolving customer needs
  • Build and debug production-grade code in distributed systems
  • Translate business requirements into AI solutions, collaborating with data scientists, product managers, and engineering teams to ensure alignment and impact
  • Optimize AI model performance and reliability in production environments, including retraining, evaluation, and continuous monitoring
  • Own deployment, quality and operation of AI systems, including automated testing, CI/CD pipelines, deployment, and monitoring with MLOps and DevOps practices
  • Troubleshoot live site issues as part of both product development and live site support rotations, ensuring rapid resolution and learning
  • Ensure high reliability and performance of applications and services through intelligent monitoring, alerting, and proactive failover strategies
  • Fulltime
Read More
Arrow Right

Software Engineer II, AI

The Customer Experience AI (CxAI) group within Dynamics 365 is pioneering next-g...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 3+ years of experience designing, building, and maintaining production services and web applications
  • 2+ years of hands‑on experience developing features using conversational AI technologies, including natural language processing (NLP) and speech systems
  • 2+ years of experience working with large language models (LLMs) and retrieval‑augmented generation (RAG) architectures, including applying Responsible AI principles within established frameworks
  • Experience building and shipping AIpowered features endtoend in production environments
  • Familiarity with cloudbased AI systems, including deploying and operating services on Azure
  • Experience with model integration patterns such as prompt engineering, tool/function calling, and evaluation of LLMbased systems
  • Working knowledge of search, retrieval, or vector databases used in RAGbased solutions
  • Experience applying Responsible AI practices, including model evaluation, mitigations, and safe deployment considerations
  • Ability to collaborate effectively with crossfunctional partners (e.g., product, applied science, design) to deliver customerfacing AI features
Job Responsibility
Job Responsibility
  • Design, develop, and deploy AI/ML models for customer interaction scenarios including chatbots, voice agents, and sentiment analysis
  • Integrate LLMs, Retrieval-Augmented Generation (RAG), and advanced analytics into customer service workflows
  • Collaborate with data scientists, AI researchers, and engineering teams to deliver innovative solutions
  • Ensure high reliability, scalability, and adherence to responsible AI practices
  • Monitor and improve model performance and customer outcomes
  • Troubleshoot live site issues and optimize AI-driven workflows
  • Work closely with Program Managers and cross-functional teams to deliver customer-centric features
  • Fulltime
Read More
Arrow Right

Senior Software Engineer II - Backend - AI Search

AI is one of the fastest growing product areas in Seismic. We believe that AI, p...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
seismic.com Logo
Seismic
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in software engineering and a proven track record of building and scaling microservices and working with data retrieval systems
  • 5+ Experience with C# and .NET, unit testing, object-oriented programming, and web services
  • 3+ Experience with Python, with the ability to work concurrently on Python and .NET repositories
  • 3+ Experience with Redis, including expertise in managing large-scale Redis clusters
  • 2+ Experience with PostgreSQL, including maintaining and performing tuning
  • Proficient in Test Driven Development (TDD) with hands-on experience using xUnit and Postman to develop automation test scripts
  • Experience with Infrastructure as Code (Terraform, Pulumi, etc.)
  • Experience with Event driven architectures with tools like Kafka
  • Experienced in container technologies such as Docker and proficient in microservice frameworks like Kubernetes (K8s)
  • Experienced in Continuous Integration and Continuous Deployment (CI/CD) with expertise in developing Jenkins pipelines using Scala
Job Responsibility
Job Responsibility
  • Design, develop, and maintain backend systems and services for search functionality, ensuring high performance, scalability, and reliability
  • Implement and optimize search and AI-driven semantic algorithms, indexing, and information retrieval techniques to enhance search accuracy and efficiency
  • Collaborate with data scientists, AI engineers, and product teams to integrate AI-driven search capabilities across the Seismic platform
  • Monitor and optimize search performance, addressing bottlenecks and ensuring low-latency query responses
  • Provide technical guidance and mentorship to junior engineers, promoting best practices in search backend development
  • Work closely with cross-functional and geographically distributed teams, including product managers, frontend engineers, and UX designers, to deliver seamless and intuitive search experiences
  • Stay updated with the latest trends and advancements in search technologies, conducting research and experimentation to drive innovation
  • Fulltime
Read More
Arrow Right

Software Engineer II - Responsible AI

Come build the core of Microsoft Copilot for enterprise with the Microsoft Turin...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Design and build end‑to‑end (E2E) experiences that support the identification, measurement, and mitigation of Responsible AI (RAI) risks across M365 Copilot features, including (but not limited to) mainline chat, agents, chat history, and model iterations.
  • Develop and operate RAI evaluation infrastructure, including dashboards and tooling for monitoring safety telemetry, system performance, and error patterns. Create alerts and participate in live‑site support for safety‑critical systems.
  • Drive scalability and consistency of RAI evaluation techniques by extending methods and frameworks across diverse systems, features, and use cases.
  • Collaborate closely with partner teams and across disciplines to build, refine, and debug E2E experiences, proactively identifying, triaging, and root‑causing failures and safety regressions.
  • Continuously invest in technical growth, staying current with industry and internal practices to improve availability, reliability, safety, efficiency, observability, and performance.
  • Embody our culture and values.
  • Fulltime
Read More
Arrow Right

Software Engineer II - Office AI Platform

Come join Microsoft Office AI team to work on state-of-the-art services, AI solu...
Location
Location
Serbia , Belgrade
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science OR related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, Typescript, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Distributed systems and cloud scale, proven ability to design, implement and operate scalable, fault-tolerant microservices and distributed storage on cloud platforms such as Azure
  • experience building APIs and services, designing data pipelines and feedback loops, and implementing secure, compliant solutions
  • AI and machine learning mastery, hands-on experience with state-of-the-art generative AI and ML frameworks and deep understanding of large language models, embeddings, prompt engineering and model fine-tuning
  • Technical leadership, demonstrated experience leading complex initiatives from concept to production, mentoring engineers, and driving technical decision-making while working with cross-functional teams
  • Security and compliance, ability to meet Microsoft’s and customers’ security and background requirements and to ensure that solutions adhere to responsible AI and data privacy standards
  • Demonstrated passion for mentoring, fostering an inclusive team culture, and collaborating closely with product, research and design partners to drive strategy and deliver user value
Job Responsibility
Job Responsibility
  • Design and implement scalable, reliable, and secure AI services on Azure, optimizing performance, cost and compliance
  • Apply knowledge of generative AI, large language models, and modern frameworks to develop intelligent features and automation within the service
  • Participate actively in code reviews, bug/issue triage with the feature teams, and support well informed decisions towards business and engineering goals
  • Contribute to fixing, enhancing, and supporting our services in production, including periodic on-call duties where necessary
  • Have sense of ownership and drive on well-defined but ambiguous problems
  • Proactively seeks new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products
  • Work with international teams within Microsoft
  • Fulltime
Read More
Arrow Right

Software Engineer II - Full Stack

Hurix is hiring a Software Engineer II – Full Stack for a confidential client. T...
Location
Location
Canada
Salary
Salary:
Not provided
hurix.com Logo
HurixDigital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in product or enterprise software development
  • Hands-on experience across the full software stack, including frontend, backend/API, databases, cloud infrastructure, and deployment workflows
  • Experience building full stack features using Angular or React, backend APIs using Python, Golang, or Node.js, and cloud infrastructure using AWS or Azure
  • Experience implementing accessible features in web applications
  • Strong technical abilities in software development, testing, monitoring, performance tuning, and deployment pipelines
  • Understanding of application security principles, data privacy considerations, and secure coding practices
  • Strong technical communication, collaboration, and problem-solving skills
  • Passion for technology and commitment to staying current with modern engineering practices and emerging capabilities
Job Responsibility
Job Responsibility
  • Design, develop, and maintain full stack web applications and platform features that are reliable, maintainable, and scalable
  • Build frontend features using modern frameworks such as Angular or React
  • Develop backend services and APIs using technologies such as Python, Node.js, or Golang
  • Work with relational databases such as MySQL and PostgreSQL, and NoSQL databases such as DynamoDB or similar platforms
  • Develop and maintain software solutions that align with accessibility standards, including WCAG 2.2 AA
  • Integrate accessibility best practices into code, testing, and design processes
  • Collaborate closely with product managers, data scientists, and engineering teams to deliver high-quality solutions
  • Explore opportunities to integrate AI capabilities into applications where they add clear value to the user experience
  • Implement application security best practices and support compliance with relevant data privacy and protection requirements
  • Contribute to CI/CD processes to enable smoother and more reliable releases
Read More
Arrow Right