CrawlJobs Logo

Software Engineer, Frontier Systems

United States, San Francisco 250000.00 - 445000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

The Frontier Systems team at OpenAI builds, launches, and supports the largest supercomputers in the world that OpenAI uses for its most cutting edge model training. We take data center designs, turn them into real, working systems and build any software needed for running large-scale frontier model trainings. Our mission is to bring up, stabilize and keep these hyperscale supercomputers reliable and efficient during the training of the frontier models.

Job Responsibility

  • Own and improve the system health checks that keep our hyperscale supercomputers stable during model training
  • Lead deep dives into hardware failures and system-level bugs to understand how things break at scale
  • Build automation that monitors and fixes issues across thousands of machines - so researchers can keep moving without interruption

Requirements

  • 7+ years of industry experience in software engineering
  • Proficiency with Python and shell scripting
  • A high degree of comfort digging into noisy data with SQL, PromQL, and Pandas or any other tool necessary
  • Experience developing reproducible analyses
  • A balance of strengths in building and operationalizing

Nice to have

  • Experience with low level details of hardware components, protocols, and associated Linux tooling (e.g., PCIe, Infiniband, networking, power management, kernel perf tuning)
  • Experience with visualization of large data centers and networks
  • Expertise with network operations and tooling
  • Expertise with power management and stabilization

What we offer

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided
  • Offers Equity
  • Performance-related bonus(es) for eligible employees

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer, Frontier Systems

8 matching positions

Software Engineer, Frontier Systems - Power Management

As a Software Engineer on the Frontier Systems team focused on power management,...
Location
Location
United States , San Francisco
Salary
Salary:
295000.00 - 445000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of software engineering experience with a focus on solving large-scale, system-level challenges
  • Strong proficiency in Python and familiarity with automation and scripting tools (e.g., shell scripting)
  • Experience with distributed systems to efficiently aggregate and analyze streaming data
  • Knowledge of electrical engineering concepts including digital signal processing, power systems, Fast Fourier Transforms, or related areas
  • Experience in system-level investigations and development of automated solutions to address power management, fault detection, and remediation
  • Strong analytical skills and the ability to dig into noisy data (experience with SQL, PromQL, Pandas, etc.)
  • Comfort working with both hardware and software teams to solve multidisciplinary problems
Job Responsibility
Job Responsibility
  • Develop and implement system-level and software-level solutions to optimize power usage in large-scale supercomputers, ensuring efficient and reliable operations
  • Build automation to monitor power consumption patterns during training workloads and design algorithms to stabilize these fluctuations, preventing issues with grid reliability
  • Work with researchers and engineers to design tools for real-time monitoring, detection, and remediation of power-related hardware and system faults
  • Collaborate cross-functionally to translate complex electrical system requirements into code, while driving continuous improvements in power management solutions
  • Drive the development of power throttling mechanisms at the IT system level to dynamically adjust power usage based on workload demands and infrastructure limitations
  • Collaborate with hardware design teams to integrate system-level power control requirements into IT hardware design, ensuring seamless coordination between software-driven power management and hardware capabilities
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Software Engineer, Frontier Clusters Infrastructure

This role blends distributed systems engineering with hands-on infrastructure wo...
Location
Location
United States , San Francisco
Salary
Salary:
230000.00 - 490000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience as an infrastructure, systems, or distributed systems engineer in large-scale or high-availability environments
  • Strong knowledge of Kubernetes internals, cluster scaling patterns, and containerized workloads
  • Proficiency in cloud infrastructure concepts (compute, networking, storage, security) and in automating cluster or data center operations
Job Responsibility
Job Responsibility
  • Spin up and scale large Kubernetes clusters, including automation for provisioning, bootstrapping, and cluster lifecycle management
  • Build software abstractions that unify multiple clusters and present a seamless interface to training workloads
  • Own node bring-up from bare metal through firmware upgrades, ensuring fast, repeatable deployment at massive scale
  • Improve operational metrics such as reducing cluster restart times (e.g., from hours to minutes) and accelerating firmware or OS upgrade cycles
  • Integrate networking and hardware health systems to deliver end-to-end reliability across servers, switches, and data center infrastructure
  • Develop monitoring and observability systems to detect issues early and keep clusters stable under extreme load
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Software Engineer, Platform Systems

The Platform Systems team at OpenAI operates at the intersection of cutting-edge...
Location
Location
United States , San Francisco
Salary
Salary:
310000.00 - 460000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Care deeply about performance, stability, and observability in distributed systems
  • Enjoy finding and fixing issues in large-scale systems and automating operational workflows
  • Have experience writing low-level software where system details matter
  • Understand hardware, operating systems, networking, concurrency, and distributed systems
  • Have a background in high-performance computing or low-level systems engineering
  • Are excited to work on critical infrastructure that powers frontier AI research
Job Responsibility
Job Responsibility
  • Design and build distributed failure detection, tracing, and profiling systems for large-scale AI training jobs
  • Develop tooling to identify slow, faulty, or misbehaving nodes and provide actionable visibility into system behavior
  • Improve observability, reliability, and performance across OpenAI’s training platform
  • Debug and resolve issues in complex, high-throughput distributed systems
  • Collaborate with systems, infrastructure, and research teams to evolve platform capabilities
  • Extend and adapt failure detection systems or tracing systems to support new training paradigms and workloads
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Software Engineer, Platform Systems

The Platform Systems team at OpenAI operates at the intersection of cutting-edge...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Care deeply about performance, stability, and observability in distributed systems
  • Enjoy finding and fixing issues in large-scale systems and automating operational workflows
  • Have experience writing low-level software where system details matter
  • Understand hardware, operating systems, networking, concurrency, and distributed systems
  • Have a background in high-performance computing or low-level systems engineering
  • Are excited to work on critical infrastructure that powers frontier AI research
Job Responsibility
Job Responsibility
  • Design and build distributed failure detection, tracing, and profiling systems for large-scale AI training jobs
  • Develop tooling to identify slow, faulty, or misbehaving nodes and provide actionable visibility into system behavior
  • Improve observability, reliability, and performance across OpenAI’s training platform
  • Debug and resolve issues in complex, high-throughput distributed systems
  • Collaborate with systems, infrastructure, and research teams to evolve platform capabilities
  • Extend and adapt failure detection systems or tracing systems to support new training paradigms and workloads
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Backend — Frontier Data

The Frontier Data team builds the data and systems that power Scale’s most advan...
Location
Location
United States , San Francisco; New York
Salary
Salary:
216200.00 - 270250.00 USD / Year
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of full-time software engineering experience (post-graduation)
  • Strong backend engineering fundamentals: distributed systems, API design, data modeling, and production reliability
  • Strong experience with Docker and containerized development/production environments (building images, debugging, and operating container-based services)
  • Demonstrated ability to ship quickly in ambiguous, fast-changing environments (high-growth startup experience is a plus)
  • Experience building systems that scale: queues, async processing, workflow engines, data pipelines, or similar
  • Comfort working close to AI/ML systems (production experience welcome
  • curiosity and strong fundamentals also valued)
  • Proficiency with SQL and modern database-backed application development
Job Responsibility
Job Responsibility
  • Own major backend systems for frontier agentic data products, driving projects from early exploration through production deployment
  • Build scalable services and pipelines that support agent workflows (e.g., coding, tool-use orchestration, GUI/computer-use tasks), with strong reliability and observability
  • Architect modular, reusable backend systems that adapt to evolving product needs while maintaining scalability, reliability, and clean interfaces
  • Operate in high-ambiguity environments: break down open-ended problems, propose approaches, and execute with speed and clarity
  • Partner cross-functionally with product, research/ML, and infrastructure teams to define requirements and ship impactful systems
  • Improve system performance and cost efficiency through thoughtful architecture, profiling, and iterative optimization
  • Raise the engineering bar through design reviews, code reviews, and pragmatic best practices
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO
  • equity grant
  • commuter stipend
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Red Team

The Cloud & AI organization accelerates Microsoft’s mission and bold ambitions t...
Location
Location
United States , Multiple Locations
Salary
Salary:
142800.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Expertise in red teaming, adversarial testing, and offensive security—including threat emulation, vulnerability discovery, and ethical hacking
  • Experience with Large Language Models (LLMs) and agentic AI systems
  • Strong background in system design and cloud platforms (Azure, AWS, GCP)
  • 8 years of professional software development experience in an OOL such as C# or Java and Bachelor’s degree in computer science or related fields, or equivalent experience
Job Responsibility
Job Responsibility
  • Design, implement, and support AI-driven red team services using generative as well as traditional AI techniques
  • Research, experiment with, and productionize frontier AI capabilities and design patterns
  • Research the latest attack techniques used by internal red teams and external threat actors
  • Contribute to red team tools for use by both human operators and AI red teaming services
  • Support partner development teams in contributing to our services and tools
  • Partner with internal defensive security teams to improve their detection, investigation, and response capabilities
  • Build strong relationships with your peers through design, code reviews, and mentoring
  • Fulltime
Read More
Arrow Right

Staff Software Engineer

The Consumer Incentives team is responsible for the profitability and growth tra...
Location
Location
United States , San Francisco, California; Sunnyvale, California
Salary
Salary:
232000.00 - 258000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience delivering, scaling, and owning highly successful and innovative software products
  • Proven record of engineering skills. Ability to write high-performance production-quality code. Experience in Go, Python, Java, or other equivalent languages
  • Experience building scalable distributed systems
  • Perseverance to get things done with a focus on shipping online features backed by experiments
  • Drive to always learn new things and go above and beyond the call of duty
  • Strong communication skills and a collaborative approach to problem-solving. Always working to improve yourself and constructively support the team around you
Job Responsibility
Job Responsibility
  • Providing technical leadership and identifying gaps/opportunities to enhance incentive efficiency
  • Identifying strategic technical investments to push the efficiency frontier and boost business growth
  • Leading teams to design and implement technical solutions to meet ambitious business goals
  • Managing end-to-end project execution, covering ideation, scoping, development, experimentation, productionization, and post-launch operation
  • Collaborating with cross-functional teams, including product, operations, and science partners
What we offer
What we offer
  • Eligibility to participate in Uber's bonus program
  • May be offered an equity award & other types of comp
  • Eligibility to participate in a 401(k) plan
  • Various benefits (details at provided link)
  • Fulltime
Read More
Arrow Right

Research Software Engineer - Multiple Levels- AI Frontiers

Microsoft Research AI Frontiers lab is seeking applications for the position of ...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, Software Engineering, System Engineering or related field AND 2+ years’ technical engineering experience with coding in languages including, but not limited to, Python, OR equivalent experience.
Job Responsibility
Job Responsibility
  • You will contribute to one of our core pillars working with researchers, engineers, and product groups to create research breakthroughs and realize your ideas in products and services used worldwide
  • You will create data, evaluation and training pipelines for training agentic models to reliably use computers, tools and complete tasks collaborating with other agents and humans
  • You’ll showcase your system design thinking, understanding of both user-facing technologies and GenAI technologies to drive efficient, high-quality execution and communication, while launching innovative AI features
  • You will work with our Technical Program Management (PM) team to understand customer needs and our research portfolio to create compelling proof of concepts so customers can take advantage of our innovations
  • Fulltime
Read More
Arrow Right