CrawlJobs Logo

Software Engineer, Agent Infrastructure

United States, San Francisco 230000.00 - 385000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

The Agent Infrastructure team at OpenAI is responsible for building systems that enable training and deployment of highly useful AI agents, both internally and for the world. We work hand-in-hand with researchers to design and scale the environment in which agentic models are trained – providing a workspace for AI models to execute code, debug issues, and develop software just as human SWEs do. Our training environment for agentic models operates at an extremely high scale and has the flexibility to emulate any environment in which an agent might work. At the same time, our team builds and maintains OpenAI’s core platform for the deployment and execution of agents in production. Our systems power products such as Codex, Operator, tool use in ChatGPT, and future agentic products.

Job Responsibility

  • Push massive compute clusters to their limits as a core contributor to a novel container orchestration platform
  • Develop and maintain FastAPI and gRPC APIs that serve as the interface for agentic infrastructure used in training and production
  • Use Terraform to stand up and evolve complex infrastructure for both research and production
  • Collaborate with research teams to stand up and optimize systems for novel AI training runs and experimental applications
  • Build and scale systems to train highly capable agentic models
  • Build the platform and integrations to launch new agents to hundreds of millions of users worldwide

Requirements

  • Deep experience working on large-scale machine learning infrastructure
  • Ability to reason about training at scale, identifying bottlenecks and engineering solutions to optimize system performance
  • Experience building new things from 0-1 quickly and scaling them 1,000,000x
  • Keen eye for performance and optimization of complex, globally-distributed systems
  • Knowledge of cloud platforms and infrastructure-as-code tech like Terraform
  • Driven by solving complex, ambiguous problems at the intersection of infrastructure scalability, virtualization efficiency, and agentic capabilities
  • Deep technical expertise in virtualization and containerization technologies (e.g. Kata, Firecracker, gVisor, Sysbox)
  • Passion for optimizing runtime performance

What we offer

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Charitable donation matching and wellness stipends
  • Offers Equity
  • Performance-related bonus(es) for eligible employees

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer, Agent Infrastructure

8 matching positions

Software Engineer, Agent

We’re looking for a Software Engineer to join the Vercel Agent team. Our mission...
Location
Location
United States , New York City; San Francisco
Salary
Salary:
232000.00 - 348000.00 USD / Year
vercel.com Logo
Vercel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of full-time software engineering experience, with strong TypeScript proficiency
  • Deep Python experience who are excited to work in TypeScript are also a great fit
  • A track record of openness and adaptability
  • Strong product and UI sensibility
  • Full-stack capability with an understanding of infrastructure, CI/CD, observability, and how large-scale web applications operate
  • Experience building or contributing to frameworks, platforms, or reusable abstractions
  • Demonstrated ability to ship independently, influence architecture, and set direction on a small, high-impact team
  • Excellent communication skills, with an ability to translate technical detail into actionable insight for both engineering and partner teams
  • Experience building agentic systems, AI tooling, or automation frameworks, and especially agents in production
  • Familiar with LLM APIs, prompt engineering, or retrieval-augmented generation (RAG)
Job Responsibility
Job Responsibility
  • Design and build agentic systems that autonomously investigate, diagnose, and remediate production issues
  • Architect multi-step agent workflows that coordinate across tools, APIs, and sandboxed code execution environments
  • Build the skills and tool integrations that give the agent deep knowledge of the Vercel platform
  • Ship polished, user-facing experiences across multiple surfaces (Slack, dashboard, CLI) without waiting for a designer
  • Develop the infrastructure for dynamic skill injection, so the agent acquires new capabilities at runtime
  • Collaborate with other engineers on prompt engineering, model evaluation, and retrieval-augmented generation (RAG) pipelines
What we offer
What we offer
  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills
  • Flexible Time Off
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed
  • Fulltime
Read More
Arrow Right

Software Engineer, Agent

We’re looking for a Software Engineer to join the Vercel Agent team. Our mission...
Location
Location
United States , San Francisco
Salary
Salary:
232000.00 - 348000.00 USD / Year
vercel.com Logo
Vercel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of full-time software engineering experience, with strong TypeScript proficiency
  • Engineers with deep Python experience who are excited to work in TypeScript are also a great fit
  • A track record of openness and adaptability
  • Strong product and UI sensibility
  • Full-stack capability with an understanding of infrastructure, CI/CD, observability, and how large-scale web applications operate
  • Experience building or contributing to frameworks, platforms, or reusable abstractions, not just feature work
  • Demonstrated ability to ship independently, influence architecture, and set direction on a small, high-impact team
  • Excellent communication skills, with an ability to translate technical detail into actionable insight for both engineering and partner teams
Job Responsibility
Job Responsibility
  • Design and build agentic systems that autonomously investigate, diagnose, and remediate production issues
  • Architect multi-step agent workflows that coordinate across tools, APIs, and sandboxed code execution environments, with durable state that survives crashes and timeouts
  • Build the skills and tool integrations that give the agent deep knowledge of the Vercel platform, such as deployments, functions, logs, metrics, DNS, and the full lifecycle of a web application
  • Ship polished, user-facing experiences across multiple surfaces (Slack, dashboard, CLI) without waiting for a designer to hand you a mockup
  • Develop the infrastructure for dynamic skill injection, so the agent acquires new capabilities at runtime rather than through redeployment, routing the right logic to the right context at the right time
  • Collaborate with other engineers on prompt engineering, model evaluation, and retrieval-augmented generation (RAG) pipelines that ground the agent in accurate, up-to-date knowledge
What we offer
What we offer
  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills
  • Flexible Time Off
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed
  • Fulltime
Read More
Arrow Right

Software Engineer, Agent Platform

We are looking for senior and staff-level fullstack engineers eager to join the ...
Location
Location
United States , San Francisco; New York
Salary
Salary:
160000.00 - 270000.00 USD / Year
hex.tech Logo
Her
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 4+ years of software engineering experience
  • Proficiency with React and Typescript in addition to knowledge around architecture and systems design
  • Experience leading and executing on major product initiatives
  • Excitement for getting your hands dirty and diving deep into how the browser works to develop high-quality and performant user experiences
  • An aptitude for how web infrastructure works to develop high-quality internal developer and external user experiences
  • An instinct for strategic thinking and aligning with business and product goals while keeping a healthy balance of velocity and engineering excellence
  • Interest in the data space, and a love of shipping great products and building tools that empower end users to do more
  • Experience maintaining a high quality bar for design, correctness, and testing
  • An ability to lead product initiatives while collaborating and mentoring fellow engineers
  • Curiosity and an interest in diving into the bigger picture of building a company, including go-to-market, customer development, people, and marketing
Job Responsibility
Job Responsibility
  • Take the lead on building AI-powered features into Hex
  • Partner closely with our Research team on context and model prompting, and the rest of our product engineering teams on integrating into the platform
  • Own the scalable agent infrastructure powering today’s most powerful data agents, as well as the cutting-edge experimentation tooling that allows the rest of the team to rapidly deliver new AI features in the product
What we offer
What we offer
  • Market-benched salary & equity
  • Comprehensive health benefits
  • Flexible paid time off
  • Fulltime
Read More
Arrow Right

Software Engineer - Agent Infra

Perplexity is looking for a Software Engineer to build the core infrastructure t...
Location
Location
United States , San Francisco; Palo Alto; New York City
Salary
Salary:
210000.00 - 385000.00 USD / Year
perplexity.ai Logo
Perplexity
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of industry experience building large scale systems or platforms
  • Experience building agent applications with tool calling, context engineering, or open connector integrations
  • Strong coding skills in one or more of: Python, Java, Go
  • Comfortable with service design, APIs, and data models for high throughput systems
  • Working knowledge of containers, virtualization, and sandboxing
  • Familiar with metrics, tracing, on call, and incident practices
  • Bias to own problems across layers, collaborate in fast moving teams, and ship
Job Responsibility
Job Responsibility
  • Design and implement a highly reliable and scalable agent runtime: orchestration, shared state and memory, tool calling interfaces, and scheduling for cost, latency, and quality
  • Build secure sandboxed execution for agent actions and code
  • Optimize cold start, isolation, and observability
  • Ship unified interfaces for multiple model sizes and providers
  • Integrate with open tool ecosystems such as MCP style connectors for data and actions
  • Develop an evaluation platform for online and offline assessments, A/B tests, safety checks, and regression gates that improve agent reliability over time
  • Partner with Research, Inference, and Search to land new agent capabilities end to end, from prototype to production
What we offer
What we offer
  • Equity
  • Health
  • Dental
  • Vision
  • Retirement
  • Fitness
  • Commuter and dependent care accounts
  • Fulltime
Read More
Arrow Right

Software Engineer, Infrastructure

In this role, you’ll join our growing infrastructure team in building and fine-t...
Location
Location
United States , New York; San Francisco
Salary
Salary:
130000.00 - 300000.00 USD / Year
clay.com Logo
Clay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience
  • Experience with containerization and orchestration tools
  • Strong understanding of CI/CD concepts and tools
  • Knowledge of infrastructure automation tools
  • Experience working cross-team to improve developer efficiency
  • Proficiency in one or more programming languages
  • Familiarity with our stack or ability to learn unfamiliar technologies quickly: Aurora Postgres RDS, Elasticache Redis, Docker + ECS, Lambda, OpenSearch, Terraform and Atlantis, CircleCI, Netlify, Playwright, Cloudwatch, Datadog, Mezmo, Typescript, Python
Job Responsibility
Job Responsibility
  • Architect, design, implement, and manage robust, scalable, and secure infrastructure solutions
  • Develop, maintain, and enforce best practices for CI/CD, infrastructure as code, and automation
  • Oversee the management and optimization of cloud infrastructure, ensuring high availability, performance, and cost-efficiency
  • Implement monitoring, logging, and alerting solutions to maintain system health and quickly resolve issues
  • Enhance developer experience across teams, including the forward-looking strategy and incorporation of the latest AI tooling, coding agents, and advanced automation
  • Design, implement, and maintain internal tooling and automation
  • Work with teams across the company to ensure we achieve the right balance of developer velocity, reliability and performance, and cost efficiency
What we offer
What we offer
  • Offers Equity
  • All employees can work for free with world-class coaches who specialize in creativity, management, and more
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer, Infrastructure

At Docker, we make app development easier so developers can focus on what matter...
Location
Location
United States , Seattle
Salary
Salary:
251000.00 - 352000.00 USD / Year
docker.com Logo
Docker
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of software engineering experience with demonstrated expertise across multiple platform domains (identity, billing, data, infrastructure)
  • Proven track record architecting and delivering large-scale distributed systems serving millions of users and thousands of enterprise customers
  • Deep expertise in at least two of: identity/access management systems, billing/monetization platforms, data platforms, or cloud infrastructure
  • Broad working knowledge across all platform domains with ability to make sound architectural decisions spanning multiple areas
  • Expert-level understanding of API design, service architecture, and system integration patterns at scale
  • Experience with cloud platforms (AWS, GCP, or Azure) and modern infrastructure patterns (Kubernetes, service mesh, infrastructure-as-code)
  • Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
  • Track record of establishing strategic technical plans that directly enabled business outcomes (revenue growth, cost reduction, market expansion)
  • Experience translating business strategy into technical architecture and roadmaps
  • Demonstrated ability to identify and prioritize investments that provide maximum platform leverage
Job Responsibility
Job Responsibility
  • Define and own the multi-year technical vision for Docker's foundational platform, encompassing accounts, billing, data, enterprise governance, and infrastructure
  • Establish strategic plans and objectives for major platform initiatives, making architectural decisions that ensure effective achievement of Docker's business objectives
  • Contribute to and drive the strategic vision in collaboration with the VP of Engineering, translating organizational strategy into technical roadmaps that span multiple teams and years
  • Identify and prioritize platform investments that provide maximum leverage—capabilities built once that enable rapid iteration across all Docker products
  • Develop architectural principles and standards that guide technical decisions across the Bridge organization and influence product engineering teams
  • Anticipate future business needs and ensure platform architecture provides the flexibility to support Docker's evolving commercial models
  • Lead large cross-company programs that require coordination across Desktop, Hub, AI, Security, Cloud, and Platform teams
  • Architect the unified platform interfaces ("Control Planes") that enable product teams to answer canonical questions like "Can this user access this feature?" or "How much has this organization consumed?" without understanding underlying complexity
  • Drive convergence of fragmented systems across Docker—replacing product-specific implementations with shared platform capabilities for authentication, authorization, billing, and observability
  • Establish technical contracts between platform and product teams that enable independent velocity while ensuring consistency and reliability
What we offer
What we offer
  • Freedom & flexibility
  • fit your work around your life
  • Designated quarterly Whaleness Days plus end of year Whaleness break
  • Home office setup
  • we want you comfortable while you work
  • 16 weeks of paid Parental leave
  • Technology stipend equivalent to $100 net/month
  • PTO plan that encourages you to take time to do the things you enjoy
  • Training stipend for conferences, courses and classes
  • Equity
  • Fulltime
Read More
Arrow Right

Staff Infrastructure Software Engineer, Enterprise AI

Scale GP is building the next generation of enterprise-grade Generative AI produ...
Location
Location
United States , New York; San Francisco
Salary
Salary:
216200.00 - 270250.00 USD / Year
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in a senior role
  • 5+ years of full-time software engineering experience
  • Deep understanding of modern infrastructure practices, including CI/CD, IaC (e.g., Terraform, Helm Charts), container orchestration (e.g., Kubernetes) and observability platforms (e.g., Datadog, Prometheus, Grafana)
  • Extensive experience with at least one major cloud provider (AWS, Azure, or GCP)
  • Strong knowledge of security and compliance in enterprise environments, with a focus on access management, data isolation, and customer-specific VPC setups
  • Proficiency in Python or JavaScript/TypeScript, and SQL
Job Responsibility
Job Responsibility
  • Define the architectural patterns for our multi-cloud infrastructure to support secure, reliable, and scalable Agentic workflows for enterprise customers
  • Lead the infrastructure roadmap with a strong focus on compliance, privacy, and security standards, including designing change management and data isolation strategies
  • Own the development and maintenance of our best-in-class Agentic observability platform (logging, metrics, tracing, and analytics) to proactively ensure system health and enable rapid incident response
  • Drive developer efficiency by building automated tooling and championing Infrastructure-as-Code (IaC) paradigms throughout the engineering organization
  • Solve the toughest engineering problems related to multi-tenancy, data isolation, and high-performance inference at a massive scale, taking end-to-end ownership across the full product lifecycle
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO
  • equity based compensation
  • additional benefits such as a commuter stipend
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Infrastructure

Serval is building an AI platform to automate complex IT workflows for modern en...
Location
Location
United States , San Francisco
Salary
Salary:
200000.00 - 300000.00 USD / Year
serval.com Logo
Serval
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years building and operating large-scale distributed systems in production environments
  • Strong experience writing and maintaining Terraform for infrastructure provisioning and management
  • Deep knowledge of at least one major cloud provider (AWS, GCP, or Azure), including compute, networking, storage, and managed services
  • Experience building, packaging, and supporting self-hosted or on-premises software deployments for enterprise customers
  • Proficiency in Python, Go, or similar languages for building automation, tooling, and infrastructure services
  • Strong understanding of networking, databases, containerization (Docker, Kubernetes), and orchestration systems
  • Experience with monitoring, logging, alerting, and incident management tools (e.g., Datadog, Prometheus, Grafana, PagerDuty)
  • Ability to communicate technical concepts clearly to customers and provide infrastructure support and guidance
  • Ability to debug complex system issues, analyze performance bottlenecks, and implement effective solutions
Job Responsibility
Job Responsibility
  • Design, implement, and operate large-scale distributed systems that power Serval's AI agents, workflow orchestration, and data pipelines
  • Write and maintain Terraform modules to provision and manage cloud infrastructure across AWS, GCP, or Azure environments
  • Build and maintain deployment packages, installation scripts, and infrastructure templates that enable customers to self-host Serval in their own environments
  • Provide technical guidance and troubleshooting support to enterprise customers deploying and operating self-hosted instances of Serval
  • Ensure high availability, performance, and reliability of production systems through monitoring, alerting, incident response, and capacity planning
  • Build internal tools and platforms that enable product engineers to deploy, test, and operate services efficiently
  • Collaborate with engineering teams to design resilient, scalable architectures that support both cloud-hosted and self-hosted deployment models
  • Profile and optimize system performance, including compute, storage, networking, and database layers
  • Implement security best practices and ensure infrastructure meets enterprise compliance requirements for both managed and self-hosted deployments
What we offer
What we offer
  • Offers Equity
  • comprehensive health coverage
  • flexible PTO
  • daily lunches and snacks
  • onsite gym access
  • regular team events and offsites
  • Fulltime
Read More
Arrow Right