Member of Technical Staff, Pretraining evaluations

As a Member of Technical Staff in the pretraining evals team, you will play a key role in helping us make modelling decisions based on experimental outcomes for our large language models (LLMs). Your primary focus will be on developing better ways to measure base model progress. This can include implementing new/better evaluations for base model capabilities, finding ways to reduce noise in our current model evaluations, or developing evaluation benchmarks that measure model progress at all model scales, among other directions.