Data Scientist, Evaluations - Meta Superintelligence Labs

Meta is seeking a Data Scientist to join the Evaluations team within Meta Superintelligence Labs (MSL). Evaluations are the core of AI progress at MSL, determining what capabilities get built, which features get prioritized, and how fast our models improve. As a Data Scientist on this team, you will be responsible for the scientific rigor behind our frontier AI benchmarks. You will work in tandem with world-class Research Scientists and Engineers to design, validate, and analyze novel evaluations that shape the future of AI capability measurement. This role is for a technical Data Science expert who can bridge the gap between abstract model capabilities and rigorous, unbiased measurement. You will lead the charge on sampling strategies for various AI tasks, critically examine benchmark quality and validity, and perform deep-dive analysis on current frontier models’ failures and limitations. You will have the opportunity to conduct novel research, think creatively about measurement in uncharted territories, and contribute to the global AI community.