Member of Technical Staff - Data Scientist

• Design evaluations of advanced model capabilities and use them to drive rapid, high-signal iteration loops
• Work with vendors to produce high quality evaluation and training data
• Build data pipelines to produce high quality evaluation and training data
• Build data flywheels to hill-climb on model weaknesses, using data from various surfaces where our models are deployed
• Ensure optimal quality, quantity and coverage of data across our post-training stages
• Run post-training experiments and ablations to produce models that climb our evals
• Embody our culture and values

• Hands‑on experience with large language models, including training or applying them in production (not just prompting)
• Designing and running post‑training experiments (evals, ablations, preference tuning / RLHF‑style methods)
• Building and owning scalable data pipelines for training and evaluation data
• Strong Python skills for ML experimentation, data processing, and analysis
• Solid statistical, experimental, and general engineering fundamentals

Demonstrated SOTA results in any area of large-scale training, inference, or evaluation