This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
As a Data Scientist on Codex, you will measure and accelerate product-market fit for AI developer tools. You’ll define what “developer productivity” means for our product, run experiments on new coding models and UX, and pinpoint where the model helps or hurts across languages and tasks. Your insights will directly shape how an entire industry builds software.
Job Responsibility:
Embed with the Codex product team to discover opportunities that improve developer outcomes and growth
Design and interpret A/B tests and staged rollouts of new coding models and product features
Define and operationalize metrics such as suggestion acceptance, edit distance, compile/test pass rates, task completion, latency, and session productivity
Build dashboards and analyses that help the team self-serve answers to product questions (by language, framework, repo size, task type)
Diagnose failure modes and partner with Research on targeted improvements (model quality signals, user feedback, evals)
Requirements:
5+ years in a quantitative role at a developer-facing or high-growth product
Fluency in SQL and Python
comfort with experiment design and causal inference
Experience defining product metrics tied to user value
Ability to communicate clearly with PM, Eng, and Design—and to influence product direction
Nice to have:
Strong programming background
ability to prototype, run simulations, and reason about code quality
Familiarity with IDE/extension telemetry or developer tooling analytics
Prior experience with NLP/LLMs, code models, or evaluations for generative coding
What we offer:
Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
401(k) retirement plan with employer match
Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick and safe time (1 hour per 30 hours worked)
Mental health and wellness support
Employer-paid basic life and disability coverage
Annual learning and development stipend to fuel your professional growth
Daily meals in our offices, and meal delivery credits as eligible
Relocation support for eligible employees
Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided