CrawlJobs Logo

Software Engineer, Infrastructure Reliability

United States, San Francisco 255000.00 - 385000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

You’ll be at the heart of scaling and hardening the infrastructure that powers some of the most widely used AI systems in the world. You’ll help ensure our systems are highly reliable, observable, performant, and secure—so researchers can iterate quickly, and products like ChatGPT and the OpenAI API can serve millions of users safely and effectively. This is a hands-on, high-leverage role for engineers who thrive on ownership, love solving deep technical problems across the stack, and want to work on systems that support cutting-edge research and deploy at global scale. You’ll play a key part in shaping technical direction, proactively improving system resilience, and collaborating closely with infra, product, and research teams to turn complex infrastructure into reliable platforms.

Job Responsibility

  • Design, build, and operate reliable and performant systems used across engineering
  • Identify and fix performance bottlenecks and inefficiencies, ensuring our infrastructure can scale to the next order of magnitude
  • Dig deep to resolve complex issues
  • Continuously improve automation to reduce manual work
  • Improve internal tooling and our developer experience
  • Contribute to incident response, postmortems, and the development of best practices around system reliability and scalability

Requirements

  • 4+ years of relevant industry experience
  • 2+ years leading large scale, complex projects or teams as an engineer or tech lead
  • A passion for distributed systems at scale with a focus on reliability, scalability, security, and continuous improvement
  • Proven experience as an reliability engineer, production engineer, or a similar role in a fast-paced, rapidly scaling company
  • Strong proficiency in cloud infrastructure (like AWS, GCP, Azure) and IaC tools such as Terraform
  • Proficiency in programming / scripting languages
  • Experience with containerization technologies and container orchestration platforms like Kubernetes
  • Experience with observability tools such as Datadog, Prometheus, Grafana, Splunk and ELK stack
  • Experience with microservices architecture and service mesh technologies
  • Knowledge of security best practices in cloud environments
  • Strong understanding of distributed systems, networking, and database technologies
  • Excellent problem-solving skills and ability to work in a fast-paced environment

Nice to have

  • Have a deep understanding of distributed systems principles and a proven track record in building and operating scalable and reliable systems
  • Have a keen eye for performance and optimization
  • Are comfortable working in Linux environments, and with tools like Kubernetes, Terraform, CI/CD pipelines, and modern observability stacks
  • Are experienced in collaborating with cross-functional teams
  • Have a humble attitude, an eagerness to help your colleagues, and a desire to do whatever it takes to make the team succeed
  • Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done
  • Are comfortable with ambiguity and rapid change

What we offer

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer, Infrastructure Reliability

8 matching positions

Senior Software Engineer - Infrastructure Reliability

We are seeking a Senior Software Engineer to join our Security Product team, foc...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
jfrog.com Logo
JFrog
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in software engineering, with at least 3+ years focused on debugging and solving infrastructure-level problems in distributed systems
  • Strong proficiency in Go
  • familiarity with Python and Helm is a plus
  • Deep hands-on experience with RabbitMQ or similar message brokers (Kafka, ActiveMQ) - including queue management, clustering, monitoring, and production troubleshooting
  • Solid working knowledge of Kubernetes (pod lifecycle, resource management, networking, debugging CrashLoopBackOff / OOMKilled scenarios) and Docker
  • Experience investigating production incidents and conducting post-incident reviews with clear root cause analysis and follow-through
  • Strong understanding of Linux systems, networking fundamentals, and cloud infrastructure (AWS, Azure, or GCP)
  • Ability to read and interpret logs, thread dumps, heap dumps, and system metrics to isolate root causes under time pressure
  • Excellent analytical and problem-solving skills with a methodical approach to debugging
  • Strong written and verbal communication skills - ability to produce clear incident reports, root cause analyses, and playbooks, and to communicate effectively across engineering, SRE, and customer-facing teams
Job Responsibility
Job Responsibility
  • Investigate system outages and production failures across customer environments (SaaS and self-hosted), spanning RabbitMQ, Kubernetes, Docker, Postgres, and cloud infrastructure (AWS, Azure, GCP)
  • Identify recurring failure patterns and systemic weaknesses from incident data, and drive them to resolution - whether by writing Go code yourself (resilience features, infrastructure fixes, observability) or by collaborating with service owners to prioritize and address reliability gaps
  • Lead and participate in post-incident reviews - document root causes, corrective actions, and follow through to ensure issues are properly resolved
  • Collaborate with production engineering and SRE teams to develop and maintain operational playbooks and runbooks that reduce time-to-resolution
  • Diagnose root causes across the full stack - message queue failures, container lifecycle issues, cloud networking, disk and memory pressure, and deployment topology mismatches
  • Design and implement data migrations and lifecycle management for infrastructure components such as queue management and vhost operations
  • Emit and monitor operational metrics to proactively detect infrastructure degradation and measure service reliability
Read More
Arrow Right

Software Engineer - Reliability GPU Infrastructure

Luma AI is a capital-intensive lab building the future of creative intelligence....
Location
Location
United States; United Kingdom , Palo Alto; London
Salary
Salary:
170000.00 - 360000.00 USD / Year
lumalabs.ai Logo
Luma AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • History of designing complex distributed systems
  • Deep expertise across various infrastructure providers
  • Ability to mentor the team and drive consensus on technical decisions
Job Responsibility
Job Responsibility
  • Define the technical strategy for compute substrate
  • Determine how to provision, manage, and scale multi-cloud and on-premise GPU footprint
  • Bridge the gap between hardware vendors and software stack
  • Architect a seamless infrastructure mesh that spans multiple cloud providers and bare-metal environments
  • Design the logic that allocates massive compute resources across competing priorities
  • Lead the effort to define entire stack as code
  • Build rigorous CI/CD and GitOps workflows
  • Fulltime
Read More
Arrow Right

Research Engineer / Software Engineer (platform/core infrastructure)

Build the future of offensive security with XBOW. Attackers are already using AI...
Location
Location
United States
Salary
Salary:
150000.00 - 350000.00 USD / Year
xbow.com Logo
Xbow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience building and operating scalable, distributed systems on cloud infrastructure such as AWS or similar
  • Comfortable working with infrastructure as code (e.g., Terraform, CDK)
  • A track record of performance tuning across cloud services, databases, and compute layers
  • Eager to learn new tools, languages, and technologies as needed
  • A thoughtful communicator who values clarity and simplicity and is comfortable working in a fast-paced startup and navigating ambiguity
  • Strong problem-solving skills and the ability to work with incomplete information
  • Curious, practical, and eager to work across layers of the stack when needed
  • You think proactively about failure modes and bring experience implementing disaster recovery and business continuity plans that keep critical systems running
Job Responsibility
Job Responsibility
  • Design and implement infrastructure systems that scale reliably and securely, and can be deployed across multiple cloud environments (AWS, Azure, OCI etc.) and contexts (SaaS, on prem)
  • Tune and optimize cloud services across compute, storage, networking, and observability to drive performance, reliability and maintainability of core services
  • Develop our core services, written in TypeScript, Kotlin and Go
  • Support large-scale systems with event driven architectures
  • Own problems end-to-end—from design through deployment to production support
  • Navigate ambiguity and help define how we build as much as what we build
  • Partner closely with other engineers, AI researchers and Security researchers to enable high-quality, high-velocity product development
  • Design for resilience by implementing disaster recovery and business continuity strategies that ensure uptime, even when things break
  • Improve how we build, deploy, and monitor services at scale
What we offer
What we offer
  • Competitive salary and a generous equity package
  • Career Growth: Shape your role, lead the function, and grow with the company
  • Meaningful Work: You will tackle technically complex challenges and play a pivotal role in the growth of our business
  • Fulltime
Read More
Arrow Right

Software Engineer II & Senior Software Engineer

Security represents the most critical priorities for our customers in a world aw...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, C, C++, C#, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Experience with Troubleshoot and optimize automation, reliability, and monitoring for Live Site running as part of an on-call rotation owned by engineering team
  • Experience with distributed systems, messaging systems like Kafka etc - Large scale system design
Job Responsibility
Job Responsibility
  • Lead the architecture, design and implementation of services for extremely high scale, throughput, durability, and low latency
  • Innovate and make service deployment and maintenance an efficient well-oiled machine that provides excellent reliability with minimal manual engineer intervention
  • Ability to conduct in-depth triage, troubleshooting, and forensics across all facets of the cloud stack while executing processes corrective action and continual service improvement
  • Drive Infrastructure security improvements for mission critical high scale workloads
  • Lead the definition of requirements, KPIs, priorities and planning of engineering deliverables
  • Mentor and grow the energetic, diverse, and driven team with a good mix of senior and mid-level
  • Fulltime
Read More
Arrow Right

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

The PowerPoint team is embarking on an exciting new chapter - evolving a product...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 8+ years of experience in backend service engineering, including work on high-scale infrastructures
  • Proficiency in one or more systems programming languages such as C#, C++
  • 1+ years of experience in software engineering, designing and developing systems (and APIs) that deploy and integrate with AI models
  • 2+ years of experience working with rich telemetry, making data driven decisions, and carrying out rapid experimentation
  • 2+ years of experience building software for scale, performance, and reliability
  • Academic or industry experience with building, finetuning, deploying or building eval-driven systems utilizing the models (any category)
Job Responsibility
Job Responsibility
  • Lead design and delivery of complex, scalable AI features ensuring resilience and exceptional user experience
  • Drive technical strategy and architecture decisions across multiple services, influencing partner teams and aligning with compliance and security requirements
  • Champion modern engineering practices, including AI-driven approaches, automation, and cloud-native patterns, across the full development lifecycle
  • Mentor and guide engineers, fostering technical excellence and continuous improvement in security, reliability, and performance
  • Collaborate cross-org to solve challenging technical problems, streamline processes, and reduce operational costs while improving live-site health
  • Design and implement scalable backend services optimized for machine learning workflows and large language model integration
  • Develop and maintain evaluation-driven systems that leverage text and multimodal inputs (e.g., images) to power visual-creation experiences
  • Build and optimize APIs and infrastructure to support high-performance model inference and experimentation at scale
  • Collaborate with product, ML, and design teams to integrate models into user-facing features, ensuring seamless functionality and performance
  • Conduct model evaluations and experiments, analyze results, and iterate on improvements to enhance accuracy and user experience
  • Fulltime
Read More
Arrow Right

Software Engineer, Reliability Platforms

The Reliability Platform role is a key pillar of DoorDash’s Production Lifecycle...
Location
Location
United States , San Francisco; Sunnyvale; New York
Salary
Salary:
159800.00 - 235000.00 USD / Year
doordash.com Logo
DoorDash
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in an infrastructure, platform, or backend engineering role
  • Fluent in Go (or a similar language)
  • Comfortable with AWS primitives, security best practices, containerization, and Infrastructure as Code tools like Terraform or Pulumi
  • Understands concepts like SLOs, error budgets, and incident response
  • Platform Engineering Mindset: You think in terms of APIs, abstractions, and workflows
  • Backend Development Skills
  • Cloud/Infra Expertise
  • SRE Experience
  • Flexibility
  • AI Alignment: You embrace the use of AI tools to be a more productive and capable engineer
Job Responsibility
Job Responsibility
  • Design, build, and operate services and infrastructure that deliver on the team’s broad mandate
  • Deliver innovative capabilities
  • Build great infrastructure
  • Balance practical and possible
  • Be custom obsessed
  • Automate everything
  • Shape the future of operations
What we offer
What we offer
  • 401(k) plan with employer matching
  • 16 weeks of paid parental leave
  • wellness benefits
  • commuter benefits match
  • paid time off
  • paid sick leave
  • medical, dental, and vision benefits
  • 11 paid holidays
  • disability and basic life insurance
  • family-forming assistance
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Infrastructure / Efficiency / Productivity

Roku is seeking a world class engineer to be a true force multiplier by owning t...
Location
Location
United Kingdom , Cambridge
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's in Computer Science or Computer Engineering, or equivalent experience
  • Prior experience at Staff, Principal, or Architect level
  • Ownership in platform/infrastructure, developer productivity, CI/CD, build systems, or workflow automation, including work spanning globally distributed teams and systems
  • Strong, hands-on knowledge of: Git (workflows, branching strategies, release management), Jenkins (CI/CD pipeline design, scaling, reliability), Docker containers (reproducible build/test execution), Build systems (BitBake/Yocto preferred), Jira (workflow design/automation, cross-team visibility), Test management systems (e.g., TestRail or equivalent)
  • Demonstrated experience delivering automation at scale, including building platforms/components used by multiple teams
  • Strong systems thinking across security, reliability, performance, and cost tradeoffs
  • Excellent written communication (architecture docs, decision records, operating procedures)
  • Experience building AI-assisted developer tooling (e.g., CI insights, test intelligence, code review automation, release risk scoring, incident copilots)
  • Experience implementing evaluation/monitoring for AI systems (quality metrics, drift, offline test sets, human feedback loops)
  • Extensive experience with software development on embedded Linux, multi-process architectures and IPC mechanisms
Job Responsibility
Job Responsibility
  • Define and lead an AI-first automation roadmap for Engineering Infrastructure and Enterprise Tooling
  • Architect and ship AI/LLM-enabled workflow automation across the SDLC
  • Establish policies and guardrails for AI usage in internal tools
  • Set technical direction and standards for globally used developer tools, including build systems
  • Architect and evolve CI/CD and build/test pipelines using Jenkins, Docker, and build systems
  • Own and scale test and quality workflows leveraging test management systems
  • Drive Jira workflow design and automation
  • Design and implement automation spanning Engineering, Product, Marketing, and Partners
  • Embed secure-by-default controls into pipelines and tooling
  • Improve build/test performance and reliability
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • Local benefits may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Time off in accordance with local leave policies
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Infrastructure and Efficiency

Roku is seeking a world class engineer to be a true force multiplier by owning t...
Location
Location
United Kingdom , Manchester
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's in Computer Science or Computer Engineering, or equivalent experience
  • Prior experience at Staff, Principal, or Architect level
  • Ownership in platform/infrastructure, developer productivity, CI/CD, build systems, or workflow automation, including work spanning globally distributed teams and systems
  • Strong, hands-on knowledge of: Git (workflows, branching strategies, release management)
  • Jenkins (CI/CD pipeline design, scaling, reliability)
  • Docker containers (reproducible build/test execution)
  • Build systems (BitBake/Yocto preferred)
  • Jira (workflow design/automation, cross-team visibility)
  • Test management systems (e.g., TestRail or equivalent)
  • Demonstrated experience delivering automation at scale, including building platforms/components used by multiple teams
Job Responsibility
Job Responsibility
  • Define and lead an AI-first automation roadmap for Engineering Infrastructure and Enterprise Tooling
  • Architect and ship AI/LLM-enabled workflow automation across the SDLC
  • Establish policies and guardrails for AI usage in internal tools
  • Set technical direction and standards for the globally used developer tools
  • Architect and evolve, CI/CD and build/test pipelines using Jenkins, Docker, and build systems
  • Own and scale test and quality workflows leveraging test management systems
  • Drive Jira workflow design and automation
  • Design and implement automation spanning Engineering, Product, Marketing, and Partners
  • Replace manual coordination with durable automation and integrations
  • Embed secure-by-default controls into pipelines and tooling
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • Statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Employees are supported in taking time off, in accordance with local leave policies and other personal needs
  • Fulltime
Read More
Arrow Right