CrawlJobs Logo

Senior Software Engineer - AI Frameworks

United States, Redmond 119800.00 - 234700.00 USD / Year · Job Posted April 11, 2026
Apply Position
Job Link Share

Job Description

The AI Frameworks team at Microsoft develpos AI Software that enables running AI models everywhere, from world's fastest AI supercomputers, to servers, desktops, mobile phones, IoT devices, and internet browswers. We collaborate with our hardware teams and hardware partners to build the software stacks for novel AI accelerators. We work closely with ML researchers and developers to optimize and scale out model training and inference. The team operates at the intersection of AI Algorithmic innovations, purpose-built AI hardware, systems, and software. We are a cross-discipline team of highly capabale and motivated people with a collaborative and inclusive culture. We collaborate with an contritbute to the open-source community. As a Senior Software Engineer - AI Frameworks on this team, you will have the opportunity to work on the fundamental abstractions, programming model, runtimes, libraries, and AIPs to enable large scale training and infrerencing of models on novel AI hardware. This is a technical role: it requires hands on software design and development skills. We're looking for someone who has a demonstrated history of solving hard technical problems and is motivated to tackle the hardest problems in building a full end-to-end AI stack. An entrepreneurial approach and ability to take initiative and move fast are essential.

Job Responsibility

  • Apply engineering principles for defining robust and maintainable architectures and designs
  • Collaborate broadly across multiple disciplines, from hardware designers to ML Developers
  • Help establish and drive the adoption of good coding standards and patterns
  • Perform software development in C/C++ and other languages
  • Identify requirements, scope solutions, estimate work, schedule deliverables

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++ OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:  Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Nice to have

  • Technical background and solid foundation in software engineering principles and architecture design
  • Experience using or developing hardware simulations
  • Curiosity and passion about learning new technologies
  • Exposure to Deep Neural Network training and inference and experience in one or more deep learning frameworks (PyTorch, Tensorflow, ONNX, etc.)
  • Cross-team collaboration skills and the desire to collaborate in a team of researchers and developers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer - AI Frameworks

8 matching positions

Senior Software Engineer - AI Frameworks

The AI Frameworks team at Microsoft accelerates and optimizes large language mod...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
  • Experience with PyTorch internals, custom operators, hardware backend, or torch.compile/Dynamo-based optimization flows.
  • Experience with AI inference stacks such as vLLM, SGLang, or similar large-scale model serving systems.
  • Experience with NPU or GPU kernel development and optimization (e.g., CUDA, Triton, or accelerator-specific toolchains).
  • Familiarity with common LLM concepts such as attention mechanisms, KV caching, quantization (PTQ/QAT), and distributed parallelism strategies (TP, PP, DP).
Job Responsibility
Job Responsibility
  • Architect and implement efficient tensor computation primitives and software abstractions for custom AI accelerators
  • Develop and extend PyTorch features for model onboarding, optimization, and execution on custom AI accelerators
  • Contribute to and improve AI inference stacks such as vLLM and SGLang, including scheduling, KV cache management, and serving pipelines
  • Design, develop, profile, and optimize high-performance kernels for NPUs (MAIA) and GPUs to accelerate LLM inference and training workloads
  • Collaborate across disciplines to define requirements and deliver practical solutions to new technical challenges
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Managed AI - AI Platform

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'...
Location
Location
United States , San Francisco, CA; Sunnyvale, CA
Salary
Salary:
172425.00 - 209000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree in Computer Science/Engineering
  • 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
  • Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly
  • Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines)
  • Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD
Job Responsibility
Job Responsibility
  • Lead the design and implementation of core AI services, including: Resilient fault-tolerant queues for efficient task distribution
  • Model catalogs for managing and versioning AI models
  • Scheduling mechanisms optimized for cost and performance
  • Architect and scale infrastructure to handle millions of API requests per second
  • Implement robust monitoring and alerting to ensure system health and 24/7 availability
  • Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap
  • Influence the long-term vision and architectural decisions of the platform
  • Contribute to open-source AI frameworks and actively participate in the AI community
  • Prototype and rapidly iterate on emerging technologies and new features
What we offer
What we offer
  • Restricted Stock Units
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Software Engineer II and Senior Software Engineer - Performance

The Artificial Intelligence Performance team at Microsoft develops AI software t...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs
  • Measure, benchmark performance on Nvidia/AMD GPUs and first party Microsoft silicon
  • Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level to improve customer experience and reduce the footprint of the computing fleet
  • Enable fast time to market of LLMs/models and their deployments at scale by building SW tools that afford velocity in porting models on new Nvidia and AMD GPUs
  • Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Communicate and collaborate with our partners both internal and external
  • Embody Microsoft's Culture and Values
  • Fulltime
Read More
Arrow Right

Senior AI Software Engineer

We are seeking an experienced software engineer contractor to help design, build...
Location
Location
United States , Celebration
Salary
Salary:
Not provided
softwareresources.com Logo
Software Resources
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong software engineering experience building and supporting production applications
  • Proficiency in one or more modern programming languages such as Java, TypeScript, JavaScript, or Dart
  • Experience building and consuming REST APIs and integrating with enterprise systems
  • Experience with cloud platforms and modern application architecture patterns
  • Hands-on experience with AI/ML or generative AI application development
  • Experience working with large language model APIs, prompt design, and structured output patterns
  • Strong understanding of software design, testing, debugging, version control, and deployment practices
  • Experience with data processing, transformation, and working with structured and unstructured data
  • Ability to work independently in a fast-paced environment and deliver high-quality outcomes with limited oversight
  • Strong written and verbal communication skills
Job Responsibility
Job Responsibility
  • Design, develop, test, and deploy scalable software solutions that support business and operational priorities
  • Build AI-enabled applications and services using large language models, orchestration frameworks, APIs, and enterprise data sources
  • Develop backend services, system integrations, and workflow automations across internal platforms
  • Translate business needs into technical designs and working software
  • Rapidly prototype new capabilities, then harden successful concepts for production use
  • Build tools that support use cases such as summarization, intelligent search, content generation, workflow assistance, classification, and recommendations
  • Integrate AI capabilities responsibly with appropriate controls for quality, security, privacy, and observability
  • Partner with product managers, analysts, architects, and business stakeholders to define requirements and solution approaches
  • Create clean, maintainable, well-documented code and participate in code reviews and technical design discussions
  • Troubleshoot issues across development, test, and production environments
What we offer
What we offer
  • Medical, dental, and vision coverage
  • 401(k) with company match
  • Short-term disability
  • Life insurance with AD&D
  • Fulltime
Read More
Arrow Right

Senior Software Engineer AI

We’re looking for a Senior AI/ML Engineer to design, build, and optimize data pi...
Location
Location
United States , Pleasanton
Salary
Salary:
145000.00 - 182000.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience with programming skills in languages such as Python, Java, or Scala
  • Expertise in ML frameworks (TensorFlow, PyTorch, scikit-learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow)
  • Proven experience operating production pipelines for ML and LLM-based systems across cloud ecosystems (GCP, AWS, Azure)
  • Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management
  • Strong competencies in CI/CD, IaC, and DevSecOps pipelines integrating testing, compliance, and deployment automation
  • Hands-on with observability stacks (Prometheus, Grafana, Newrelic) for model and agent performance tracking
  • Understanding of governance frameworks for Responsible AI, auditability, and cost metering across training and inference workloads
  • Proficiency in containerization technologies (e.g., Docker, Kubernetes)
Job Responsibility
Job Responsibility
  • Lead data pipeline development: Build and maintain PySpark ETL pipelines with high data quality and performance
  • Manage integrations: Establish robust connections to client data sources via APIs and tools like FiveTran, Plaid, and BlackLine’s own internal connector ecosystem
  • Ensure reliability: Monitor pipeline performance, automate testing, and validate data accuracy
  • Optimize for scale: Implement performance improvements (e.g., CDC mechanisms, indexing strategies) for large-scale datasets
  • Collaborate & innovate: Work with business stakeholders to refine data requirements and integrate cutting-edge AI and big data technologies
  • Partner with data science, security, and product teams to set evaluation and governance standards (Guardrails, Bias, Drift, Latency SLAs)
  • Mentor senior engineers and drive design reviews for ML pipelines, model registries, and agentic runtime environments
  • Lead incident response and reliability strategies for ML/AI systems
  • Collaborate with development teams to integrate AI solutions into existing workflows and applications
  • Ensure seamless integration with different platforms and technologies
What we offer
What we offer
  • Short-term and long-term incentive programs
  • Robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right

Senior Software Engineer AI

We’re looking for a Senior AI/ML Engineer to design, build, and optimize data pi...
Location
Location
United States , Pleasanton
Salary
Salary:
145000.00 - 182000.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience with programming skills in languages such as Python, Java, or Scala
  • Expertise in ML frameworks (TensorFlow, PyTorch, scikit-learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow)
  • Proven experience operating production pipelines for ML and LLM-based systems across cloud ecosystems (GCP, AWS, Azure)
  • Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management
  • Strong competencies in CI/CD, IaC, and DevSecOps pipelines integrating testing, compliance, and deployment automation
  • Hands-on with observability stacks (Prometheus, Grafana, Newrelic) for model and agent performance tracking
  • Understanding of governance frameworks for Responsible AI, auditability, and cost metering across training and inference workloads
  • Proficiency in containerization technologies (e.g., Docker, Kubernetes)
Job Responsibility
Job Responsibility
  • Lead data pipeline development: Build and maintain PySpark ETL pipelines with high data quality and performance
  • Manage integrations: Establish robust connections to client data sources via APIs and tools like FiveTran, Plaid, and BlackLine’s own internal connector ecosystem
  • Ensure reliability: Monitor pipeline performance, automate testing, and validate data accuracy
  • Optimize for scale: Implement performance improvements (e.g., CDC mechanisms, indexing strategies) for large-scale datasets
  • Collaborate & innovate: Work with business stakeholders to refine data requirements and integrate cutting-edge AI and big data technologies
What we offer
What we offer
  • short-term and long-term incentive programs
  • robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right

Agentic AI - Senior Software Engineer

Mastercard Foundry R&D is seeking a Senior Software Engineer to join the Agentic...
Location
Location
Ireland , Dublin 18
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building applications or systems using Generative AI, LLMs, or agentic patterns
  • Experience with one or more modern AI frameworks and SDKs for agent orchestration, AI application development, or coding-agent workflows (for example LangGraph, OpenAI Agents SDK, Vercel AI SDK, or Codex SDK)
  • Strong understanding of orchestration, tool-calling, context management, and AI system design trade-offs
  • Strong software engineering experience building scalable, maintainable production systems
  • Experience with React and/or Next.js
  • Strong backend engineering skills in Java and/or Python
  • Experience with developer tooling, automation, CLI-based workflows, and CI/CD
  • Familiarity with containers, cloud-native development, and service integration patterns
  • Experience building products, prototypes, and/or internal platforms with a focus on usability and adoption
Job Responsibility
Job Responsibility
  • Build software, tooling, and platform capabilities that support Mastercard’s Agentic AI strategy
  • Design and implement AI-enabled applications, workflows, and developer-facing capabilities
  • Develop reusable services, patterns, and integrations for AI and agentic systems
  • Evaluate models, frameworks, and tools across quality, cost, latency, reliability, and maintainability
  • Contribute to new product and prototype development from concept through validation
  • Improve developer experience through automation, AI-assisted workflows, and platform thinking
  • Partner with product, engineering, and business stakeholders to turn ideas into working solutions
  • Advocate learnings, prototypes, and best practices across the organization
  • Fulltime
Read More
Arrow Right

Principal AI Software Engineer, Senior Vice President

Are you looking for a career move that will put you at the heart of a global fin...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Exceptional Python Expertise: Demonstrated mastery of core Python, including advanced features, performance optimization, and a deep understanding of the FastAPI framework
  • Prior hands-on experience with Generative AI, Large Language Model (LLM) frameworks (e.g. LangChain, LlamaIndex), and their application in enterprise environments is a must. This must be underpinned by a profound understanding of core machine learning principles, algorithms, and data science methodologies
  • Full Lifecycle Ownership: Extensive hands-on experience and technical authority throughout the entire software development lifecycle, from conceptualization and design to implementation, deployment, and operational ownership of enterprise software solutions, involving significant cross-functional collaboration
  • Strategic System Design: Significant hands-on experience in architecting and designing (architecture, design patterns, reliability, scaling) highly complex new and current systems with broad technical impact
  • Hands-on expertise with containerized deployment technologies (e.g. Kubernetes, OpenShift, Docker) and orchestration strategies
  • Hands-on experience and in-depth understanding of C++ is a significant bonus, particularly for complex code analysis, parsing, and integration into knowledge graph structures
Job Responsibility
Job Responsibility
  • Architect and implement cutting-edge software systems, defining the technical design for our AI solutions to ensure scalability, performance, and reliability
  • Drive the hands-on design, implementation, and deployment of sophisticated systems that automate the analysis of data, code, and documentation
  • Apply deep expertise to structure extracted knowledge within a Credit Risk Domain-aware knowledge graph, including advanced strategies for effectively modelling complex codebases, particularly C++, within this graph
  • Act as a critical technical partner with data scientists, business analysts, and other engineering teams to translate challenging business requirements into robust technical solutions and ensure successful, high-quality project delivery
  • Tackle the most complex technical challenges within our AI initiatives, providing solutions that set the standard for engineering excellence
What we offer
What we offer
  • Generous holiday allowance starting at 27 days plus bank holidays
  • increasing with tenure
  • A discretional annual performance related bonus
  • Private medical insurance packages to suit your personal circumstances
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right