CrawlJobs Logo
OpenAI Logo OpenAI · IT - Software Development

Software Engineer, Data Infrastructure - Research

United States, San Francisco 250000.00 - 380000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

The Workload team is responsible for designing and running OpenAI’s LLM training and inference infrastructure that powers frontier models at massive scale. Our systems unify how researchers train and serve models, abstracting away the complexity of performance, parallelism, and execution across vast GPU/accelerator fleets. By providing this foundation, the Workload team ensures that researchers can focus on advancing model capabilities while we handle the scale, efficiency, and reliability required to bring those models to life.

Job Responsibility

  • Design and implement the dataset infrastructure that powers OpenAI’s next-generation training stack
  • Design and maintain standardized dataset APIs, including for multimodal (MM) data that cannot fit in memory
  • Build proactive testing and scale validation pipelines for dataset loading at GPU scale
  • Collaborate with teammates to integrate datasets seamlessly into training and inference pipelines
  • Document and maintain dataset interfaces so they are discoverable, consistent, and easy for other teams to adopt
  • Establish safeguards and validation systems to ensure datasets remain reproducible and unchanged once standardized
  • Debug and resolve performance bottlenecks in distributed dataset loading
  • Provide visualization and inspection tools to surface errors, bugs, or bottlenecks in datasets

Requirements

  • Strong engineering fundamentals with experience in distributed systems, data pipelines, or infrastructure
  • Experience building APIs, modular code, and scalable abstractions
  • Comfortable debugging bottlenecks across large fleets of machines
  • Pride in building infrastructure that 'just works'
  • Collaborative, humble, and excited to own a foundational part of the ML stack

Nice to have

  • Background knowledge in data math, probability, or distributed data theory
  • Worked with GPU-scale distributed systems or dataset scaling for real-time data

What we offer

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends
  • Offers Equity
  • Performance-related bonus(es) for eligible employees
OpenAI - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer, Data Infrastructure - Research

8 matching positions

Software Engineer, Data Infrastructure

Data Platform at OpenAI owns the foundational data stack powering critical produ...
Location
Location
United States , San Francisco
Salary
Salary:
185000.00 - 385000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years in data infrastructure engineering OR 4+ years in infrastructure engineering with a strong interest in data
  • Take pride in building and operating scalable, reliable, secure systems
  • Comfortable with ambiguity and rapid change
  • Intrinsic desire to learn and fill in missing skills
  • Strong talent for sharing learnings clearly and concisely with others
  • Supported Spark, Kafka, Flink, Airflow, Trino, or Iceberg as platforms
  • Well-versed in infrastructure tooling like Terraform
  • Experienced in debugging large-scale distributed systems
  • Excited about solving data infrastructure problems in the AI space
Job Responsibility
Job Responsibility
  • Design, build, and maintain data infrastructure systems such as distributed compute, data orchestration, distributed storage, streaming infrastructure, machine learning infrastructure while ensuring scalability, reliability, and security
  • Ensure our data platform can scale by orders of magnitude while remaining reliable and efficient
  • Accelerate company productivity by empowering your fellow engineers & teammates with excellent data tooling and systems
  • Collaborate with product, research and analytics teams to build the technical foundations capabilities that unlock new features and experiences
  • Own the reliability of the systems you build, including participation in an on-call rotation for critical incidents
  • Take full lifecycle ownership: architecture, implementation, production operations, and on-call participation
  • Scale and harden big data compute and storage platforms
  • Build and support high-throughput streaming systems
  • Build and operate low latency data ingestions
  • Enable secure and governed data access for ML and analytics
What we offer
What we offer
  • Offers Equity
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Infrastructure

LMArena is seeking a Software Engineer to join our team and build the data pipel...
Location
Location
United States , Bay Area
Salary
Salary:
Not provided
arena.ai Logo
Arena Intelligence, Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in software engineering, with a dedicated focus on data engineering and big data technologies
  • Proficiency in SQL and at least one programming language commonly used for data analysis (Python (preferred), Scala, R)
  • Hands-on experience with data processing and pipeline frameworks (Apache Spark, Ray Data, etc.) and at least one popular big data analytics platform (Databricks, Snowflake)
  • Demonstrated experience in designing, implementing, optimizing, and debugging production data pipelines
Job Responsibility
Job Responsibility
  • Design and build robust data pipelines to ingest, process, and transform user vote data to features essential for model performance evaluation
  • Collaborate with researchers and product leadership to understand product goals and necessary data
  • Design and implement solutions to generate result dashboards and reports, providing useful information for the public, model providers, and researchers
  • Ensure the integrity, data quality, and reliability of the pipelines
  • Scale our data infrastructure to accommodate increasing data volumes and evolving analytical needs
What we offer
What we offer
  • Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs
  • The opportunity to work on cutting-edge AI with a small, mission-driven team
  • A culture that values transparency, trust, and community impact
  • Fulltime
Read More
Arrow Right

Software Engineer - Data Infrastructure

As a Data Infrastructure Engineer at Luma, you will play a critical role in buil...
Location
Location
United States; United Kingdom , Palo Alto; London
Salary
Salary:
Not provided
lumalabs.ai Logo
Luma AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Python (or similar languages with willingness to learn Python) and experience with large-scale, high-throughput data infrastructure
  • Familiarity with distributed computing frameworks (e.g., Ray, Spark, Beam)
  • Ability to design and optimize data pipelines for ML research and internal teams
  • Strong problem-solving skills and understanding of data engineering at scale
  • Collaborative, product-focused mindset
  • comfortable in fast-paced environments
  • Experience sourcing, integrating, and optimizing data from diverse and large datasets
  • Comfortable working in a fast-paced, product-focused environment with a strong execution mindset
  • Open to candidates across seniority levels, from mid-level individual contributors to senior engineers and managers.
Job Responsibility
Job Responsibility
  • Build and maintain scalable data infrastructure for high-throughput machine learning workflows
  • Collaborate with ML researchers and product teams to ensure data systems meet evolving needs
  • Develop and optimize large-scale data pipelines and batch processing jobs
  • Contribute to the architecture and implementation of reliable, high-performance data platforms
  • Integrate open-source tools and continuously improve data infrastructure through monitoring and tuning
  • Participate in cross-functional projects to improve data reliability, scalability, and operational excellence
  • Support the evaluation and adoption of new programming languages and frameworks relevant to data infrastructure
  • Engage in continuous improvement of data infrastructure through monitoring, troubleshooting, and performance tuning
  • Collaborate with research & engineering teams to help define and refine best practices for data infrastructure development
  • Fulltime
Read More
Arrow Right

Data Infrastructure Software Engineer

The Boston Dynamics Central Software (CSW) team is seeking a creative and passio...
Location
Location
United States , Waltham
Salary
Salary:
Not provided
bostondynamics.com Logo
Boston Dynamics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience in delivering data infrastructure solutions to end-users
  • Proven ability to design, develop, and optimize efficient ETL/ELT pipelines for large-scale data ingestion and transformation (e.g., Apache Airflow)
  • In-depth knowledge and hands-on experience with big data technologies such as Apache Spark, Hadoop, Kafka, Flink, or similar distributed systems
  • Expertise in relational databases (e.g., PostgreSQL, MySQL)
  • Experience with major cloud providers like AWS, Google Cloud Platform (GCP), or Microsoft Azure, including services related to data storage, processing, and analytics
  • Proficiency in Python
  • Familiarity with Git version control and a comfortable working proficiency in a Linux development environment
  • Bachelor’s in Engineering, Computer Science, or other technical areas
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable and robust data pipelines using Apache Airflow and other big data technologies
  • Optimize existing data systems for performance, reliability, and cost-effectiveness
  • Collaborate with machine learning engineers and other software engineers to respond to data needs and solve problems with data
  • Troubleshoot and resolve issues related to data availability, performance, and accuracy
  • Monitor data quality and integrity, implementing processes for data validation and error handling
  • Participate in code reviews, contributing to a high standard of code quality and best practices
  • Research and evaluate new technologies and tools to improve our data platform
  • Contribute to the overall architecture and strategy for data infrastructure
  • Participate in our agile development process, coordinating work with others, identifying challenges, and communicating progress regularly
  • Mentor and upskill peers and other contributors across the organization
  • Fulltime
Read More
Arrow Right

Software Engineer, Research - Human Data

OpenAI’s mission is to ensure that artificial general intelligence (AGI) benefit...
Location
Location
United States; United Kingdom , San Francisco; London
Salary
Salary:
230000.00 - 385000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong software engineering fundamentals
  • Experience building production systems at scale
  • Enjoy full-stack development with end-to-end ownership
  • Motivated by high-impact collaboration with research teams and solving novel, ambiguous problems
  • Excited to shape how AI systems learn from human preferences and reflect a broad range of human values
  • Care deeply about inclusive tooling and building systems that enhance model safety, reliability, and usefulness
Job Responsibility
Job Responsibility
  • Build and maintain robust full-stack systems for feedback collection, data labeling, and evaluation pipelines, while maintaining high levels of security
  • Translate experimental alignment research into scalable production infrastructure, including inference and model training stacks
  • Design and iterate on user-facing tools and backend services to support high-quality data workflows
  • Partner with researchers, engineers, and program leads to shape feedback loops and model interaction paradigms
  • Drive infrastructure improvements that enable faster iteration and scaling across OpenAI’s frontier models, from internal research tooling all the way to production ChatGPT
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Software Engineer, Big Data Infrastructure

Benchling's mission is to unlock the power of biotechnology. The world's most in...
Location
Location
United States , San Francisco
Salary
Salary:
141104.00 - 190906.00 USD / Year
benchling.com Logo
Benchling
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Have 2+ years of experience or a proven track record in software engineering
  • Strong experience in backend engineering and distributed systems
  • Strong experience with scripting language (such as Python)
  • Experience with deployment and configuration management frameworks such as Terraform, Ansible, or Chef and container management systems such as Kubernetes or Amazon ECS
  • Driven by creating positive impact for our customers and Benchling's business, and ultimately accelerating the pace of research in the Life Sciences
  • Comfortable with complexity in the short term but can build towards simplicity in the long term
  • Strong communicator with both words and data - you understand what it takes to go from raw data to something a human understands
  • Willing to work onsite in our SF office 3 days a week
Job Responsibility
Job Responsibility
  • Build next generation Data Platform with scalable data ingress/egress for internal and external customers
  • Define and design data transformations and pipelines for cross-functional datasets, while ensuring that data integrity and data privacy are first-class concerns regarded proactively, instead of reactively
  • Define the right Service Level Objectives for the batch & streaming pipelines, and optimize their performance
  • Designing and creating CI/CD pipelines for platform provisioning, full lifecycle management. Building the platform control panel to operate the fleet of systems efficiently
  • Work closely with the team across Application and Platform to establish best practices around usage of our data platform
What we offer
What we offer
  • Competitive total rewards package
  • Broad range of medical, dental, and vision plans for employees and their dependents
  • Fertility healthcare and family-forming benefits
  • Four months of fully paid parental leave
  • 401(k) + Employer Match
  • Commuter benefits for in-office employees and a generous home office set up stipend for remote employees
  • Mental health benefits, including therapy and coaching, for employees and their dependents
  • Monthly Wellness stipend
  • Learning and development stipend
  • Generous and flexible vacation
  • Fulltime
Read More
Arrow Right

Software Engineer / Data Engineer

We are looking for a Software Engineer / Data Engineer to build and enhance inte...
Location
Location
United States , New York
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant experience in software engineering, data engineering, or a closely related technical role
  • Strong backend development expertise in Python, with practical experience building production-grade services and data-driven applications
  • Hands-on experience with PySpark, Databricks, and AWS for data processing, platform development, and cloud-based deployment
  • Ability to work across multiple layers of technology, including APIs, databases, application logic, frontend components, and infrastructure
  • Familiarity with JavaScript or TypeScript and exposure to modern frontend frameworks such as React or Next.js
  • Experience developing solutions that incorporate large language models
  • broader machine learning knowledge is an advantage
  • Proven ability to translate loosely defined business or research needs into well-structured technical solutions
Job Responsibility
Job Responsibility
  • Create and support internal applications, including dashboards, research platforms, and workflow solutions that improve day-to-day productivity across the firm
  • Develop and maintain AI-enabled internal systems such as application services, knowledge retrieval capabilities, agent-based tools, and monitoring frameworks for performance and quality
  • Collaborate with investment professionals and data science teams to convert research processes into stable, user-focused software products
  • Define technical direction for new systems, selecting appropriate architecture and establishing engineering standards that can scale with future development
  • Build backend services and data pipelines using Python, PySpark, and Databricks to support analytics, automation, and application functionality
  • Contribute to frontend experiences for internal users with modern web technologies such as Next.js, React, and interactive visualization tools
  • Design solutions that connect APIs, user interfaces, data storage, and cloud infrastructure into cohesive, maintainable platforms
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • company 401(k) plan
  • free online training
Read More
Arrow Right

Research Engineer, Text Data Research - MSL FAIR

Meta is seeking AI research engineers to help us build the data foundation for M...
Location
Location
United States , Menlo Park
Salary
Salary:
257000.00 USD / Year ▼
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 2+ years of industry research experience in LLM/NLP or related AI/ML models
  • Experience as a formal technical lead, leading major technical initiatives with cross-functional impact, and/or influencing strategy across multiple teams
  • Practical experience with pre-training or mid-training data curation for large foundational models and experience working with organic, synthetic, agentic, or reasoning data for LLMs
  • Demonstrated data infrastructure and software background, and experience building data tooling and services
  • Published research in leading peer-reviewed conferences (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP) and/or demonstrated significant industry influence in the field of AI
Job Responsibility
Job Responsibility
  • Collaborate with cross-functional teams to develop Meta’s next foundational models
  • Architect efficient and scalable data curation systems and pipelines
  • Fundamentally improve our data velocity across workflows and projects by contributing to the advancement of data tooling
  • Execute on high priority projects in pre-training, mid-training, or post-training data curation
  • Apply specialized expertise in agentic data, synthetic data, reasoning data, web parser, coding data, data scaling laws, or datamix optimization
  • Lead complex technical projects end-to-end
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right