CrawlJobs Logo

Software Engineer II - AI Frameworks

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

100600.00 - 199000.00 USD / Year

Job Description:

The AI Frameworks team at Microsoft develops AI software that enables running AI models on specialized AI Infrastructure. The team collaborate with hardware teams and hardware partners to build the software stacks for novel AI accelerators. We work closely with ML researchers and developers to optimize and scale out model training and inference. The team operates at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software. We are a cross-discipline team of highly capable and motivated people with a collaborative and inclusive culture. We collaborate with and contribute to the open-source community. As a Software Engineer II - AI Frameworks on this team, you will have the opportunity to build infrastructure as a service, work on the fundamental abstractions, programming model, runtimes, libraries, and APIs to enable large scale training and inferencing of models on novel AI hardware. This is a technical role: it requires hands on software design and development skills. We’re looking for Software Engineer II who has a demonstrated history of solving hard technical problems and is motivated to tackle the hardest problems in building a full end-to-end AI infrastrucure stack. An entrepreneurial approach and ability to take initiative and move fast are essential.

Job Responsibility:

  • Apply strong engineering principles for defining robust and maintainable architectures and designs
  • Collaborate broadly across multiple disciplines, from hardware designers to ML developers
  • Help establish and drive the adoption of good coding standards and patterns
  • Perform software development in C/C++ and other languages
  • Identify requirements, scope solutions, estimate work, schedule deliverables

Requirements:

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++ OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Nice to have:

  • Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C or C++ OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C or C++ OR equivalent experience
  • Understanding of Object-Oriented Programming (OOP)
  • CS fundamentals
  • Technical background and solid foundation in software engineering principles and architecture design
  • Understanding of networking stack / protocols
  • Experience & Know-how to developing strong processes and work-flow to debugging deployments in cloud
  • Deep intellectual curiosity and passion about learning new technologies
  • Cross-team collaboration skills and the desire to collaborate in a team of researchers and developers
  • Great cross-team collaboration skills and the desire to collaborate in a team of researchers and developers
  • 1+ years experience working with firmware or driver development in windows/linux

Additional Information:

Job Posted:
March 25, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer II - AI Frameworks

Software Engineer II

The Skills & Rep Agents team builds Highspot’s personalized, AI-enhanced coachin...
Location
Location
Canada , Vancouver
Salary
Salary:
118000.00 - 158000.00 CAD / Year
highspot.com Logo
Highspot
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or equivalent practical experience
  • 2+ years of experience in back-end software development building and maintaining large-scale web applications
  • At least 1 year of experience working with object-oriented programming languages
  • Ruby and Python preferred
  • Strong understanding of API design, data modeling, and backend scalability
  • Experience integrating or working with AI/LLM platforms such as OpenAI, Anthropic (Claude), or Azure OpenAI
  • Familiarity with AI-powered development tools (e.g., Cursor, GitHub Copilot, Cody, etc.) and a demonstrated ability to incorporate them effectively into day-to-day workflows
  • Excellent communication skills and a demonstrated ability to influence key technical decisions
Job Responsibility
Job Responsibility
  • Design, develop, and maintain high-quality, scalable, and user-centric backend systems using modern technologies
  • Build and maintain integrations with multiple large language models (LLMs) including ChatGPT, Claude, and other OpenAI and Microsoft models
  • Collaborate closely with AI/ML engineers to productionize agentic workflows and autonomous reasoning systems
  • Partner effectively with Product Management and UX Design to translate ideas and research into production-ready, AI-enhanced features
  • Leverage AI-assisted development tools such as Cursor, GitHub Copilot, and other code generation frameworks to accelerate development and improve code quality
  • Collaborate cross-functionally to deliver differentiated customer value through AI and data-driven solutions
  • Troubleshoot and resolve critical production issues while contributing to internal documentation and best practices
What we offer
What we offer
  • Comprehensive medical, dental, vision, disability, and life benefits
  • Group Retirement Savings Plan (RRSP) and matching employer contributions (DPSP) with immediate vesting
  • Flexible PTO
  • Generous Holiday Schedule + 5 Days for Annual Holiday Week
  • Quarterly Recharge Fridays (paid days off for mental health recharge)
  • Flexible work schedules
  • Access to Coaches and Therapists through Modern Health
  • 2 Volunteer days per year
  • Monthly transportation allowance for employees that work in our Vancouver Hub location
  • Stock options
  • Fulltime
Read More
Arrow Right

Software Development Engineer II

A leader in vision AI solutions for the world’s leading retailers. Transforming ...
Location
Location
Serbia , Belgrade
Salary
Salary:
Not provided
everseen.ai Logo
Everseen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2-3 years of work experience in a relevant role
  • Bachelors degree or equivalent focusing on the computer science field is preferred
  • In-depth knowledge of Python
  • Comfortable working with UNIX like environments
  • In-depth knowledge of advanced concepts like microservices and distributed systems
  • Hands-on experience with cloud platforms such as Microsoft Azure, Amazon Web Services (AWS), or other equivalent cloud environments
  • Understanding of basic monitoring services (e.g., CloudWatch, Azure Monitor, Prometheus, Grafana)
  • Proven ability to deploy, package, manage, and monitor applications in a cloud environment (e.g., Docker, CI/CD pipelines)
  • Strong interest in machine learning, data science, or related fields
  • Broad understanding of the software engineering and architecture space, including knowledge of various programming languages, frameworks, techniques, and industry trends in AI
Job Responsibility
Job Responsibility
  • Design and develop new features and functionalities
  • Design and implement reusable, testable, efficient, and elegant code based on requirements
  • Create, maintain, and run unit tests for both new and existing applications and services
  • Analyze and collect data from various sources such as log files, application stack traces, and thread dumps
  • Create and maintain CI/CD integration using various tools
  • Evaluate and integrate third-party software solutions to optimize system performance
  • Update and track third-party solutions' compatibility with Everseen stack according to internal development guidelines
  • Monitor production logs to identify and troubleshoot issues promptly
  • Responsible for creating, maintaining, and updating technical documentation
  • Fulltime
Read More
Arrow Right

Engineering Manager II, Java Backend - Marketing Org

Groupon is on a radical journey to transform our business with relentless pursui...
Location
Location
India
Salary
Salary:
Not provided
groupon.com Logo
Groupon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BE/BTech or ME/MTech degree in Computer Science, Software Engineering from a recognised institute
  • 10+ years of overall industry experience with 4 years of leadership (hands-on engineering management) role in developing and supporting web applications, micro services in a distributed environment
  • Experience with managing platform services, delivering projects in a dynamic environment
  • Experience with managing high-performance individuals in different time zones
  • Good communication and collaboration skills, and the ability to deal with ambiguity
  • Strong experience in programming languages - Java and competent in designing and building enterprise-scale applications, common frameworks, etc.
  • Experience building and scaling large-scale distributed systems and development experience with service-oriented architectures/microservices
  • Prior AWS/GCP/Azure/Pivotal Cloud Foundry experience is a must
  • Proven success managing and scaling platform services in fast-moving environments
  • Experience leading cross-regional teams and driving platform-level strategies
Job Responsibility
Job Responsibility
  • Customer Communication Excellence: Drive reliability, performance, and personalization across our Dispatch and Subscription systems
  • Achieve a 99.99% delivery success rate and under 1s latency for real-time communications
  • Subscription Platform Growth: Lead engineering teams focused on the evolution and scalability of our subscription systems
  • Enable 2x growth in subscriber engagement and conversion over the next 12 months
  • Platform Scalability & Operational Efficiency: Reduce technical debt and optimize resource usage across core services by modernizing legacy infrastructure and adopting cloud-native patterns
  • Achieve a 30% reduction in platform operational costs while improving performance benchmarks
  • Engineering Team Performance & Growth: Build high-performing, autonomous, and globally distributed teams that execute with agility and ownership
  • Maintain 90%+ team engagement and less than 10% regrettable attrition, with measurable velocity improvements
  • AI-First Transformation Enablement: Champion the integration of AI/ML where it enhances business outcomes, from system automation to intelligent routing and customer experience
  • Deliver at least 2 AI-driven features or systems into production per year
Read More
Arrow Right

Senior Staff Engineer, Applied AI

GEICO is seeking a Senior Staff Engineer, Applied AI to provide technical archit...
Location
Location
United States , Chevy Chase, MD; Palo Alto, CA
Salary
Salary:
130000.00 - 260000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8 or more years of professional software engineering or applied machine learning experience
  • 2 or more years working with Generative AI or LLM-based systems in production
  • Proven track record of architecting and delivering complex AI/ML capabilities that span multiple teams and have measurable business impact
  • Deep hands-on expertise with Python and modern AI frameworks including LangChain, LangGraph, LangSmith, LlamaIndex, Hugging Face, OpenAI/Anthropic APIs, and emerging agentic frameworks
  • Demonstrated experience building and deploying production RAG (Retrieval-Augmented Generation) systems including document ingestion, chunking strategies, vector search, and context retrieval
  • Demonstrated experience designing and operating production AI systems including multi-agent architectures, intelligent automation, and workflow orchestration
  • Strong understanding of agent architectures, workflow orchestration, retrieval-augmented generation (RAG), vector databases, knowledge graphs, and semantic reasoning
  • Familiarity with Agent-to-Agent (A2A) communication protocols and Model Context Protocol (MCP) for building interoperable AI systems
  • Experience ensuring platform scalability, cross-domain coherence, and alignment with AI platform capabilities and strategy
  • Strong expertise in distributed systems, microservices architecture, service design, performance optimization, and reliability engineering
Job Responsibility
Job Responsibility
  • Specify architectures and system decompositions for AI/ML capabilities that involve significant integrations and cross-team collaboration across multiple product areas
  • Provide technical architecture and leadership for medium to large, complex, cross-functional AI initiatives with visibility at the tech VP level
  • Architect and lead implementation of advanced Generative AI solutions including agent-based systems, intelligent automation, document intelligence, and decision support systems that span multiple business domains
  • Design and implement sophisticated agentic workflows that orchestrate multiple AI agents, tools, APIs, reasoning steps, and business logic to automate complex enterprise processes at scale
  • Question status quo with an eye for simpler designs and more secure approaches, influencing tech VPs to set direction for multiple teams
  • Build systems and platforms that meet the highest standards for scalability, resilience, performance, availability, security, and compliance
  • Identify and scope opportunities for automating business processes using AI across multiple product areas and business domains
  • Advance the state-of-the-art in applied AI by integrating knowledge graphs, vector reasoning, retrieval architectures, and multi-agent systems to solve complex business problems
  • Drive innovation by exploring new models, frameworks, reasoning techniques, and AI architectures and applying them strategically to high-impact business challenges
  • Run rigorous experimentation programs including hypothesis definition, A/B testing, measurement frameworks, and iterative improvement across production AI systems
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right
New

Software Engineer II and Sr. Software Engineer - AI Frameworks

The AI Frameworks team at Microsoft develops software that pushes the cutting ed...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, or related technical discipline AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, implement, and test a function or component for our AI/ML frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Interacting and collaborating with our partners both internal and external
  • Interacting with and providing tech support for our customers/users
  • Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

AI Engineer II

In the 1980s, Microsoft Office revolutionized global industries and empowered th...
Location
Location
United States
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 2+ years technical engineering experience including some production experience building applications with LLMs and/or deploying ML/LLM/agent systems
  • coding in languages including, but not limited to, Python, Typescript/Javascript, C, C++, or C#
Job Responsibility
Job Responsibility
  • Prototype and iterate on AI agent experiences that reimagine Office workflows, rapidly, validating feasibility, UX, and technical approaches, while pushing the frontier of the agent-driven productivity
  • Ship features by operating at the true intersection of AS and SWE, where a single AI engineer can unlock disproportionate impact by translating model capability and product intent into intelligent, production-ready systems
  • Design and develop tools and evaluation frameworks to observe and monitor real-time agent health, investigate customer feedback, and build continuous learning systems for end-to-end AI workflows
  • Invent and lead industry-defining multimodal AI experiences across Microsoft 365 by exploring new interaction paradigms and system architectures that unlock and define natural user interface between human and AI
  • Continuous learning and stay current with advances in generative AI and software engineering. Invest time in learning new tools and frameworks, propose improvements to build processes, and share knowledge with colleagues
  • Embody Microsoft culture and values
  • Fulltime
Read More
Arrow Right

Applied Scientist II

The Data and Artificial Intelligence team in Microsoft’s Developer Division, par...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Undergraduate degree in Computer Science, Engineering, Mathematics, Statistics
  • 5+ years experience with strong proficiency in Python, machine learning frameworks, and experience developing and deploying generative AI or machine learning models into production
  • Masters or PhD degree in Computer Science, Statistics, or related fields (undergraduates with significant appropriate experience will be considered)
  • Strong professional experience in statistics, machine learning, including deep learning, NLP, econometrics
  • Experience in building cloud-scale systems and experience working with open-source stacks for data processing and data science is desirable
  • Experience with LLMs in natural language, AI for code or related fields
  • Excellent communication skills, ability to present and write reports, strong teamwork and collaboration skills
  • Experience in productizing AI and collaborating with multidisciplinary teams
Job Responsibility
Job Responsibility
  • Research and productization of state-of-the-art in AI for Software Engineering
  • Build and manage large-scale AI experiments and models
  • Drive experimentation through A/B testing and offline validation to evaluate model performance
  • Collaborate across disciplines and geographies with product teams in Microsoft and Github, integrate AI across software development stack for Copilot
  • Stay up to date with the research literature and product advances in AI for software engineering
  • Fulltime
Read More
Arrow Right

Software Engineer II

We are seeking a skilled software engineer to join our team and help implement a...
Location
Location
Czech Republic , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
Job Responsibility
Job Responsibility
  • AI-Native Development: Improves artificial intelligence (AI) tools and practices across the software development lifecycle (SDLC)
  • Proactively takes responsibility for the content of their AI-generated requirements, design documents, code, and other assets, assisting other members of the team to do the same
  • Incorporates Responsible AI practices into the SDLC to ensure appropriate controls over AI-generated assets
  • Applies SDLC and engineering health measures (e.g., Accelerate, SPACE framework, Engineering System Success Playbook [ESSP]) to guide improvements to processes and practices, especially those involving AI
  • Experiments with AI tools and practices to improve their own capabilities, and provides recommendations on how to adopt them to other members of the team.
  • Coding: Leads by example across teams and mentors others to produce extensible, maintainable, well-tested, secure, and performant code used across products that adheres to design specifications
  • Leads efforts to continuously improve code performance, testability, maintainability, effectiveness, and cost, while learning about and accounting for relevant trade-offs
  • Identifies best practices and coding patterns (e.g., leveraging state-of-the-art generative artificial intelligence [GenAI], approaches to source code organization, naming conventions) and provides deep expertise in the coding and validation strategy
  • Creates and applies metrics to drive code quality and stability, appropriate coding patterns, and best practices
  • Identifies and anticipates blockers or unknowns during the development process, escalates them, communicates how they will impact timelines, and then leads efforts to identify and implement strategies and/or opportunities to address them.
  • Fulltime
Read More
Arrow Right