Research Engineer, Frontier Evals & Environments Job at OpenAI (San Francisco)

Research Engineer, Frontier Evals & Environments - Finance

The Frontier Evals team builds north star model evaluations to drive progress to...

Location

United States , San Francisco

Salary:

205000.00 - 380000.00 USD / Year

OpenAI

Expiration Date

Until further notice

Requirements

Strong engineering and statistical analysis skills (with at least 2-3 years of full-time technical experience)
Passionate about evals for real world applications and knowledge work
Detail-oriented and thorough
Team player / willing to do a variety of tasks to move the team forward
Passionate and knowledgeable about AGI/ASI measurement
Able to operate effectively in a dynamic and extremely fast-paced research environment as well as scope and deliver projects end-to-end

Job Responsibility

Identify important model capabilities, skills, and behaviors that are crucial to financial workflows, and design methods to quantify performance in these areas
Own and pursue a research agenda to identify an important model capability (especially as it relates to financial reasoning) and build evals to measure it
Continuously refine evaluations of frontier AI models to assess the extent of frontier capabilities

What we offer

Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
401(k) retirement plan with employer match
Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
Mental health and wellness support
Employer-paid basic life and disability coverage
Annual learning and development stipend to fuel your professional growth
Daily meals in our offices, and meal delivery credits as eligible

Fulltime

AI Architect

We’re hiring an AI Architect to sit at the intersection of frontier AI research,...

Location

United States , San Francisco; New York

Salary:

201600.00 - 241920.00 USD / Year

Scale

Expiration Date

Until further notice

Requirements

Deep technical background in applied AI/ML: 5–10+ years in research, engineering, solutions engineering, or technical product roles working on LLMs or multimodal systems, ideally in high-stakes, customer-facing environments
Hands-on experience with model improvement workflows: demonstrated experience with post-training techniques, evaluation design, benchmarking, and model quality iteration
Ability to work on hard, ambiguous technical problems: proven track record of partnering directly with advanced customers or research teams to scope, reason through, and execute on deep technical challenges involving frontier models
Strong technical fluency: you can read papers, interrogate metrics, write or review complex Python/SQL for analysis, and reason about model-data trade-offs
Executive presence with world-class researchers and enterprise leaders
excellent writing and storytelling
Bias to action: you ship, learn, and iterate.

Job Responsibility

Translate research → product: work with client side researchers on post-training, evals, safety/alignment and build the primitives, data, and tooling they need
Partner deeply with core customers and frontier labs: work hands-on with leading AI teams and frontier research labs to tackle hard, open-ended technical problems related to frontier model improvement, performance, and deployment
Shape and propose model improvement work: translate customer and research objectives into clear, technically rigorous proposals—scoping post-training, evaluation, and safety work into well-defined statements of work and execution plans
Translate research into production impact: collaborate with customer-side researchers on post-training, evaluations, and alignment, and help design the data, primitives, and tooling required to improve frontier models in practice
Own the end-to-end lifecycle: lead discovery, write crisp PRDs and technical specs, prioritize trade-offs, run experiments, ship initial solutions, and scale successful pilots into durable, repeatable offerings
Lead complex, high-stakes engagements: independently run technical working sessions with senior customer stakeholders
define success metrics
surface risks early
and drive programs to measurable outcomes
Partner across Scale: collaborate closely with research (agents, browser/SWE agents), platform, operations, security, and finance to deliver reliable, production-grade results for demanding customers

What we offer

Comprehensive health, dental and vision coverage
retirement benefits
a learning and development stipend
generous PTO
commuter stipend
equity based compensation.

Fulltime

Researcher, Preparedness

The Preparedness team helps us prepare for the development of increasingly capab...

Location

United States , San Francisco

Salary:

295000.00 - 445000.00 USD / Year

OpenAI

Expiration Date

Until further notice

Requirements

Passionate and knowledgeable about short-term and long-term AI safety risks
Ability to think outside the box and have a robust 'red-teaming mindset'
Experience in ML research engineering, ML observability and monitoring, creating large language model-enabled applications, and/or another technical domain applicable to AI risk
Able to operate effectively in a dynamic and extremely fast-paced research environment as well as scope and deliver projects end-to-end

Job Responsibility

Own the scientific validity of frontier preparedness capability evaluations—designing new evals grounded in real threat models (including high-consequence domains like CBRN as well as cyber and other frontier-risk areas), and maintaining existing evals so they don't stale or silently regress
Define datasets, graders, rubrics, and threshold guidance, and produce auditable artifacts (evaluation cards, capability reports, system-card inputs) that leadership can trust during high-stakes launches
Work on identifying emerging AI safety risks and new methodologies for exploring the impact of these risks
Build (and then continuously refine) evaluations of frontier AI models that assess the extent of identified risks
Design and build scalable systems and processes that can support these kinds of evaluations
Contribute to the refinement of risk management and the overall development of 'best practice' guidelines for AI safety evaluations

What we offer

Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
401(k) retirement plan with employer match
Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
Mental health and wellness support
Employer-paid basic life and disability coverage
Annual learning and development stipend to fuel your professional growth
Daily meals in our offices, and meal delivery credits as eligible

Fulltime

Research Engineering Manager - Model Training

Perplexity is seeking a Research Engineering Manager to lead the team of all-sta...

Location

United States , San Francisco

Salary:

300000.00 - 470000.00 USD / Year

Perplexity

Expiration Date

Until further notice

Requirements

Proven experience with large-scale LLMs and Deep Learning systems
Strong Python and PyTorch skills
Experience leading or managing research or engineering teams working on large-scale AI model development, including driving complex projects from idea to production
Self‑starter with a willingness to take ownership of tasks and navigate ambiguity in a fast‑moving environment
Passion for tackling challenging problems in AI model quality, speed, safety, and reliability
10+ years of technical experience, with at least 2 of those years as a manager and at least 4 of those years working on large-scale AI model development

Job Responsibility

Lead a team of researchers and engineers focused on training SotA models for Perplexity-relevant use cases, leveraging the latest supervised and reinforcement learning techniques
Drive research and engineering efforts to develop production models through advanced model training and alignment techniques, including RL, SFT, and other approaches
Become deeply familiar with the team’s technical stack, leading from the front through hands-on technical contributions
Own the data, training, and eval pipelines required to train and continuously improve LLM models
Design and iterate on model training and finetuning algorithms (e.g., preference‑based methods, reinforcement learning from human or AI feedback) through an approach that balances scientific rigor and iteration velocity
Design evaluations and improve the production model training pipeline to reliably deliver models that lie on the Pareto frontier of speed and quality
Work closely with engineering teams to integrate in-house models into our product and rapidly iterate based on real‑world usage
Manage day‑to‑day execution, project planning, and prioritization for the model training team to hit ambitious quality and performance goals

What we offer

Equity
Health
Dental
Vision
Retirement
Fitness
Commuter and dependent care accounts

Fulltime

Product Manager, Central Products

Meta Product Managers work with cross-functional teams of engineers, designers, ...

Location

United States , Menlo Park

Salary:

205000.00 - 277000.00 USD / Year

Product Manager - Growth & Monetization

At Meta, we're shaping innovative experiences in service of giving people the po...

Location

Singapore

Salary:

Not provided

New

Bi & Bigdata Quality Specialist

At Vodafone, we’re not just shaping the future of connectivity for our customers...

Location

Egypt , Giza

Salary:

Not provided

Vodafone

Expiration Date

Until further notice

Requirements

Bachelor of computer Science or related domains
0 to 1 years in engineering, specifically in building quality gates for data pipelines, ensuring data accuracy, and administering distributed systems
Experience in bigdata systems and technologies such as Java, Python, NoSQL, Node.js, Angular, Kafka, Yarn, Hbase, Zookeeper
Understanding of distributed systems like Hadoop (HDFS)
Knowledge of data processing frameworks, such as Apache Hadoop (MapReduce), Apache Spark, Apache Kafka
Understanding of data warehousing concepts and technologies
Familiarity with ETL tools and processes for efficiently moving and transforming data

Job Responsibility

Delivering end to end development solutions for BI and Big Data quality tasks, including pipelines, data trends and dashboards
Managing the system optimization, monitoring workflow performance, administering DWH applications and Big Data clusters
Managing vendor communications and handling system upgrades
Design, develop, and implement solutions to monitor, validate, and improve data accuracy, consistency, and completeness
Build data quality gates to ensure and maintain scalable data pipelines for processing and validating large datasets efficiently
Develop and enhance ETL processes to ensure seamless data movement across systems while maintaining data quality dashboards
Ensure adherence to data governance policies, regulatory standards, and best practices for data management
Investigate data anomalies, identify root causes, and implement corrective measures proactively
Optimize query performance, database indexing, and system configurations to enhance efficiency
Work closely with data analysts, engineers, business teams, and vendors to ensure data quality objectives are met

Fulltime

New

Family Law Partner

Join the largest, fastest-growing specialist family law firm in the country. We ...

Location

United Kingdom , Cambridge

Salary:

90000.00 GBP / Year

Stowe Family Law

Expiration Date

Until further notice

Requirements

Commercially minded and able to spot opportunities to improve client service
Ambitious and want to reach potential
Able to convert new clients and lead a range of complex finance and children cases

Job Responsibility

Convert new clients
Lead a range of complex finance and children cases

What we offer

Bonus
Wellbeing culture including Mental Wellbeing days and access to counselling sessions
Volunteering leave
Diversity public holidays
26 days holiday
Enhanced adoption, maternity and paternity pay
Paid leave for fertility treatment
Emergency dependants leave
Bereavement leave
Medicash health insurance - 24/7 GP’s, dental, counselling, gym discounts

Fulltime

Select Country

Research Engineer, Frontier Evals & Environments

OpenAI

Location:
United States , San Francisco

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
February 21, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Research Engineer, Frontier Evals & Environments