CrawlJobs Logo

Software Engineer, Fleet Infrastructure

United States, San Francisco 230000.00 - 490000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running the world’s largest, most reliable, and frictionless GPU fleet to support OpenAI’s general purpose model training and deployment. Work on this team ranges from: Maximizing GPUs doing useful work by building user-friendly scheduling and quota systems; Running a reliable and low maintenance platform by building push-button automation for kubernetes cluster provisioning and upgrades; Supporting research workflows with service frameworks and deployment systems; Ensuring fast model startup times though high performance snapshot delivery across blob storage down to hardware caching; Much more! As an engineer within Fleet infrastructure, you will design, write, deploy, and operate infrastructure systems for model deployment and training on one of the world’s largest GPU fleet. The scale is immense, the timelines are tight, and the organization is moving fast; this is an opportunity to shape a critical system in support of OpenAI's mission to advance AI capabilities responsibly.

Job Responsibility

  • Design, implement and operate components of our compute fleet including job scheduling, cluster management, snapshot delivery, and CI/CD systems
  • Interface with researchers and product teams to understand workload requirements
  • Collaborate with hardware, infrastructure, and business teams to provide a high utilization and high reliability service

Requirements

  • Experience with hyperscale compute systems
  • Strong programming skills
  • Experience working in public clouds (especially Azure)
  • Experience working in Kubernetes
  • Execution focused mentality paired with a rigorous focus on user requirements

Nice to have

Understanding of AI/ML workloads

What we offer

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided
  • Offers Equity
  • Performance-related bonus(es) for eligible employees

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer, Fleet Infrastructure

8 matching positions

Software Engineer, Fleet Hardware Health

As a software engineer on the Fleet Hardware team, you will be responsible for t...
Location
Location
United States , San Francisco
Salary
Salary:
230000.00 - 490000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience managing large-scale server environments
  • A balance of strengths in building and operationalizing
  • Proficiency in Python, Go, or similar languages
  • Strong Linux, networking, and server hardware knowledge
  • Comfort digging into noisy data with SQL, PromQL, and Pandas or any other tool
Job Responsibility
Job Responsibility
  • Build and maintain automation systems for provisioning and managing server fleets
  • Develop tools to monitor server health, performance, and lifecycle events
  • Collaborate with clusters, networking, and infrastructure teams
  • Partner with external operators to ensure a high level of quality
  • Identify and fix performance bottlenecks and inefficiencies
  • Continuously improve automation to reduce manual work
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Software Engineer, Fleet Management

The Fleet team at OpenAI supports the computing environment that powers our cutt...
Location
Location
United States , San Francisco
Salary
Salary:
230000.00 - 490000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong software engineering skills with experience in large-scale infrastructure environments
  • Broad knowledge of cluster-level systems (e.g., Kubernetes, CI/CD pipelines, Terraform, cloud providers)
  • Deep expertise in server-level systems (e.g., systems, containerization, Chef, Linux kernels, firmware management, host routing)
  • Passionate about optimizing the performance and reliability of large compute fleets
  • Thrive in dynamic environments and are eager to solve complex infrastructure challenges
  • Value automation, efficiency, and continuous improvement in everything you build
Job Responsibility
Job Responsibility
  • Design and build systems to manage both cloud and bare-metal fleets at scale
  • Develop tools that integrate low-level hardware metrics with high-level job scheduling and cluster management algorithms
  • Leverage LLMs to coordinate vendor operations and optimize infrastructure workflows
  • Automate infrastructure processes, reducing repetitive toil and improving system reliability
  • Collaborate with hardware, infrastructure, and research teams to ensure seamless integration across the stack
  • Continuously improve tools, automation, processes, and documentation to enhance operational efficiency
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Software Engineer, Data Infrastructure - Research

The Workload team is responsible for designing and running OpenAI’s LLM training...
Location
Location
United States , San Francisco
Salary
Salary:
250000.00 - 380000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong engineering fundamentals with experience in distributed systems, data pipelines, or infrastructure
  • Experience building APIs, modular code, and scalable abstractions
  • Comfortable debugging bottlenecks across large fleets of machines
  • Pride in building infrastructure that 'just works'
  • Collaborative, humble, and excited to own a foundational part of the ML stack
Job Responsibility
Job Responsibility
  • Design and implement the dataset infrastructure that powers OpenAI’s next-generation training stack
  • Design and maintain standardized dataset APIs, including for multimodal (MM) data that cannot fit in memory
  • Build proactive testing and scale validation pipelines for dataset loading at GPU scale
  • Collaborate with teammates to integrate datasets seamlessly into training and inference pipelines
  • Document and maintain dataset interfaces so they are discoverable, consistent, and easy for other teams to adopt
  • Establish safeguards and validation systems to ensure datasets remain reproducible and unchanged once standardized
  • Debug and resolve performance bottlenecks in distributed dataset loading
  • Provide visualization and inspection tools to surface errors, bugs, or bottlenecks in datasets
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Software Engineer, GPU Infrastructure - HPC

As a software engineer on the Fleet High Performance Computing (HPC) team, you w...
Location
Location
United States , San Francisco
Salary
Salary:
230000.00 - 490000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience managing large-scale server environments
  • A balance of strengths in building and operationalizing
  • Proficiency in Python, Go, or similar languages
  • Strong Linux, networking, and server hardware knowledge
  • Comfort digging into noisy data with SQL, PromQL, and Pandas or any other tool
Job Responsibility
Job Responsibility
  • Build and maintain automation systems for provisioning and managing server fleets
  • Develop tools to monitor server health, performance, and lifecycle events
  • Collaborate with clusters, networking, and infrastructure teams
  • Partner with external operators to ensure a high level of quality
  • Identify and fix performance bottlenecks and inefficiencies
  • Continuously improve automation to reduce manual work
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Software Engineer, Big Data Infrastructure

Benchling's mission is to unlock the power of biotechnology. The world's most in...
Location
Location
United States , San Francisco
Salary
Salary:
141104.00 - 190906.00 USD / Year
benchling.com Logo
Benchling
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Have 2+ years of experience or a proven track record in software engineering
  • Strong experience in backend engineering and distributed systems
  • Strong experience with scripting language (such as Python)
  • Experience with deployment and configuration management frameworks such as Terraform, Ansible, or Chef and container management systems such as Kubernetes or Amazon ECS
  • Driven by creating positive impact for our customers and Benchling's business, and ultimately accelerating the pace of research in the Life Sciences
  • Comfortable with complexity in the short term but can build towards simplicity in the long term
  • Strong communicator with both words and data - you understand what it takes to go from raw data to something a human understands
  • Willing to work onsite in our SF office 3 days a week
Job Responsibility
Job Responsibility
  • Build next generation Data Platform with scalable data ingress/egress for internal and external customers
  • Define and design data transformations and pipelines for cross-functional datasets, while ensuring that data integrity and data privacy are first-class concerns regarded proactively, instead of reactively
  • Define the right Service Level Objectives for the batch & streaming pipelines, and optimize their performance
  • Designing and creating CI/CD pipelines for platform provisioning, full lifecycle management. Building the platform control panel to operate the fleet of systems efficiently
  • Work closely with the team across Application and Platform to establish best practices around usage of our data platform
What we offer
What we offer
  • Competitive total rewards package
  • Broad range of medical, dental, and vision plans for employees and their dependents
  • Fertility healthcare and family-forming benefits
  • Four months of fully paid parental leave
  • 401(k) + Employer Match
  • Commuter benefits for in-office employees and a generous home office set up stipend for remote employees
  • Mental health benefits, including therapy and coaching, for employees and their dependents
  • Monthly Wellness stipend
  • Learning and development stipend
  • Generous and flexible vacation
  • Fulltime
Read More
Arrow Right

Software Engineer, HW/SW Co-Design Engineer

As a key member of the team you'll work closely with internal software and platf...
Location
Location
United States , Menlo Park
Salary
Salary:
217000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
  • Experience with programming and scripting languages such as C, C++, Java, PHP, Python
  • 5+ years of experience with hardware architecture, compute technologies and/or storage systems
Job Responsibility
Job Responsibility
  • Utilize extensive understanding of CPUs (x86/ARM) to identify key platform resource bottlenecks. Collaborate closely with software product teams to re-architect services, improve performance through algorithm redesign, reduce resource consumption
  • Develop representative benchmarks (in C++, Python, and/or Hack) to capture fleet requirements and drive early evaluation of upcoming platforms. Drive fleet-wide detailed workload analysis and keep ahead of evolving business needs and its impact to compute fleet
  • Identify novel hardware/software co-design opportunities based on industry trends and new paradigms. Conduct pathfinding activities to quantify the value proposition for Meta and drive roadmap definition
  • Influence vendor hardware roadmap and broader ecosystem to align with Meta's requirements
  • Partner with Product Engineering and Infrastructure Engineering teams to find the optimal way to deliver the hardware roadmap into production and drive adoption
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

Software Engineer

At Uber, we don’t just move people; we move the world. But before a car arrives ...
Location
Location
Denmark , Aarhus
Salary
Salary:
Not provided
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Drive & Passion for Engineering
  • Distributed Systems Experience
  • Language Agnosticism (primary languages: Go and Java)
  • A "Scale" Mindset
  • Collaborative Spirit
  • Approximately 2+ years of relevant industry experience after completing education
Job Responsibility
Job Responsibility
  • Build the future of Infrastructure/Platform and Catalog
  • Build the "foundations of the house" ensuring Uber's global fleet of services is reliable, scalable, and lightning-fast
  • Manage millions of items across thousands of cities for Uber Eats and beyond
  • Solve problems related to data consistency, searchability, and real-time updates at a massive scale
What we offer
What we offer
  • Monthly Uber Credits (Rides and Uber Eats)
  • Equity Compensation (stock options/RSUs)
  • Culture & Socials (frequent local social events and office clubs)
  • Tech Community (regular local tech meetups)
  • Well-being & Fertility (global support programs for mental health, wellness, and family planning/fertility)
  • Parental Leave (generous, gender-neutral)
  • Modern Aarhus Hub (catered lunches and top-tier collaboration spaces)
  • Fulltime
Read More
Arrow Right

Staff Software Engineer

We are looking for a Staff Engineer to join the Core Services team under Aurora ...
Location
Location
United States , Mountain View
Salary
Salary:
189000.00 - 303000.00 USD / Year
aurora.tech Logo
Aurora Innovation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7 or more years of experience in building backend services
  • Bachelor’s or Master’s Degree in Computer Science or a related field
  • Experience with web communication protocols, including REST, gRPC and GraphQL
  • Experience with building large scale, high concurrent, high throughput and safety critical backend services
  • Phenomenal communication skills
  • A preference for action
  • The drive to make teams stronger
  • Motivation to own the product lifecycle end to end
Job Responsibility
Job Responsibility
  • Design complex systems from the ground up, partnering closely with Software, Hardware and infrastructure engineering teams
  • Partner with Product Managers, Designers and Operation Stakeholders to deliver the benefit of Self Driving Vehicles quickly, safely and broadly
  • Design, implement and maintain a micro-backend architecture running in the Aurora’s AWS cloud used to monitor and manage the entire Aurora Commercial Fleet
  • Design, implement the fleet management solution and the vehicle communication system
  • Establish technology and infrastructure to scale our products with high availability and reliability
  • Contribute and evolve our team culture around mentorship, feedback, collaboration, and engineering excellence
What we offer
What we offer
  • Annual bonus
  • Equity compensation
  • Benefits
  • Fulltime
Read More
Arrow Right