Researcher, Pretraining Safety

The Pretraining Safety team’s goal is to build safer, more capable base models and enable earlier, more reliable safety evaluation during training. We aim to: Develop upstream safety evaluations that to monitor how and when unsafe behaviors and goals emerge; Create safer priors through targeted pretraining and mid-training interventions that make downstream alignment more effective and efficient; Design safe-by-design architectures that allow for more controllability of model capabilities. In addition, we will conduct the foundational research necessary for understanding how behaviors emerge, generalize, and can be reliably measured throughout training.