CrawlJobs Logo

Research Engineer, Evaluations - Meta Superintelligence Labs

meta.com Logo

Meta

Location Icon

Location:
United States , Menlo Park

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

219000.00 - 301000.00 USD / Year

Job Description:

Meta is seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs. Evaluations are the core of AI progress at MSL, determining what capabilities get built, which features get prioritized, and how fast our models improve. As a Research Engineer on this team, you will curate and build the benchmarks for our most advanced AI models, across text, vision, audio, and beyond. You'll work alongside world-class researchers and engineers to collect, develop, and deploy novel benchmarks and reinforcement learning environments. This is a technical role requiring research engineering skills and the ability to work independently on a variety of open-ended machine learning challenges with high reliability. The evaluations you build will directly impact the research direction and major model lines within MSL, making engineering reliability, rigor, and scalability paramount. You will excel by maintaining high velocity while adapting to rapidly shifting priorities as we advance the technical research frontier. You'll need to be flexible and adaptive, tackling a wide variety of problems in the evaluations space, from implementing existing benchmarks to developing novel benchmarks and environments to implementing evaluation tooling at scale.

Job Responsibility:

  • Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development
  • Develop and implement evaluation environments, including environments for novel model capabilities and modalities
  • Collaborate with external data vendors to source and prepare high-quality evaluation datasets
  • Execute on the technical vision of research scientists designing new benchmarks and evaluations
  • Build robust, reusable evaluation pipelines that scale across multiple model lines and product areas
  • Contribute to evaluation tooling that measures the quality and reliability of evaluation suites

Requirements:

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 5+ years of experience in machine learning engineering, machine learning research, or a related technical role
  • Proficiency in Python and experience with ML frameworks such as PyTorch
  • Experience identifying, designing and completing medium to large technical features independently, without guidance
  • Software engineering practices including version control, testing, and code review practices
  • Demonstrated experience of working independently and adapting to rapidly changing priorities

Nice to have:

  • Publications at peer-reviewed venues (NeurIPS, ICML, ICLR, ACL, EMNLP, or similar) related to language model evaluation, benchmarking, or deep learning
  • Hands-on experience with language model post-training and deep learning systems, or building reinforcement learning environments
  • Experience implementing or developing evaluation benchmarks for large language models and multimodal models (e.g., vision-language, audio, video)
  • Experience working with large-scale distributed systems and data pipelines
  • Familiarity with language model evaluation frameworks and metrics
  • Track record of open-source contributions to ML evaluation tools or benchmarks
What we offer:
  • bonus
  • equity
  • benefits

Additional Information:

Job Posted:
February 17, 2026

Employment Type:
Fulltime
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Research Engineer, Evaluations - Meta Superintelligence Labs

Research Engineering Manager, Evaluations, Meta Superintelligence Labs

Meta is seeking a Research Engineering Manager to lead the Evaluations team with...
Location
Location
United States , Menlo Park
Salary
Salary:
219000.00 - 301000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Machine Learning, or a related technical field
  • 4+ years of experience in machine learning engineering, machine learning research, or a related technical role
  • 3+ years of experience managing or leading technical teams, including hiring, mentoring, and performance management
  • Proficiency in Python and experience with ML frameworks such as PyTorch
  • Proven track record of leading medium to large-scale technical projects from conception to deployment
  • Demonstrated experience balancing hands-on technical work with people management and strategic planning
  • Clear communication and experience influencing cross-functional stakeholders
Job Responsibility
Job Responsibility
  • Build, mentor, and grow a team of research engineers and scientists focused on evaluation infrastructure and benchmarking
  • Conduct performance reviews, career development conversations, and provide technical mentorship to team members
  • Foster a culture of engineering excellence, research rigor, and rapid iteration within the team
  • Partner with recruiting to hire world-class research engineering talent
  • Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development
  • Oversee the development and implementation of evaluation environments, including environments for novel model capabilities and modalities
  • Establish partnerships with external data vendors to source and prepare high-quality evaluation datasets
  • Influence the technical roadmap for evaluation infrastructure in collaboration with MSL Infra team
  • Translate the technical vision of research scientists into actionable engineering plans and execution strategies
  • Partner with research scientists, product teams, and other engineering teams to align evaluation priorities with organizational goals
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Research Engineer, Evaluations - Meta Superintelligence Labs

Meta is seeking Research Engineers to join the Evaluations team within Meta Supe...
Location
Location
United States , Menlo Park
Salary
Salary:
257000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 4+ years of experience in machine learning engineering, machine learning research, or a related technical role
  • Proficiency in Python and experience with ML frameworks such as PyTorch
  • Experience identifying, designing and completing medium to large technical features independently, without guidance
  • Demonstrated experience in software engineering practices including version control, testing, and code review practices
  • Ability to work independently and adapt to rapidly changing priorities
Job Responsibility
Job Responsibility
  • Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development
  • Develop and implement evaluation environments, including environments for novel model capabilities and modalities
  • Collaborate with external data vendors to source and prepare high-quality evaluation datasets
  • Execute on the technical vision of research scientists designing new benchmarks and evaluations
  • Build robust, reusable evaluation pipelines that scale across multiple model lines and product areas
  • Contribute to evaluation tooling that measures the quality and reliability of evaluation suites
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

Research Engineer, Preparedness - Meta Superintelligence Labs

Meta is seeking Research Engineers to join the Preparedness team within Meta Sup...
Location
Location
United States , Menlo Park
Salary
Salary:
154003.00 - 217000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 3+ years of experience in machine learning engineering, machine learning research, or a related technical role
  • Proficiency in Python and experience with ML frameworks
  • Experience identifying, designing and completing medium to large technical features independently, without guidance
  • Proven experience in software engineering practices including version control, testing, and code review practices
Job Responsibility
Job Responsibility
  • Build and continuously refine evaluations for multimodal and agentic frontier AI models, including in cybersecurity, chemical security, and biosecurity
  • Build robust, reusable evaluation pipelines that scale across multiple model lines and product areas
  • Produce auditable technical artifacts, including evaluation reports and model cards, at high reliability and speed
  • Scope and deliver end-to-end evaluations under ambiguous and rapidly shifting requirements, re-prioritizing as the threat landscape and Meta’s frontier models evolve
  • Work across research, engineering, policy, and legal teams to align evaluation priorities with launch timelines
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

AI Research Scientist, Evaluations - Meta Superintelligence Lab

Meta is seeking Research Scientists to join the Evaluations team within Meta Sup...
Location
Location
United States , Menlo Park
Salary
Salary:
184000.00 - 257000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • PhD degree in Computer Science, Machine Learning, or a related technical field
  • 3+ years of experience in machine learning engineering, machine learning research, or a related technical role
  • Proficiency in Python and experience with ML frameworks such as PyTorch
  • Experience identifying, designing and completing medium to large technical features independently, without guidance
  • Proven success in software engineering practices including version control, testing, and code review practices
  • Ability to work independently and adapt to rapidly changing priorities
Job Responsibility
Job Responsibility
  • Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development
  • Develop and implement evaluation environments, including environments for novel model capabilities and modalities
  • Collaborate with external data vendors to source and prepare high-quality evaluation datasets
  • Execute on the technical vision of research scientists designing new benchmarks and evaluations
  • Build robust, reusable evaluation pipelines that scale across multiple model lines and product areas
  • Contribute to evaluation tooling that measures the quality and reliability of evaluation suites
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Data Scientist, Evaluations - Meta Superintelligence Labs

Meta is seeking a Data Scientist to join the Evaluations team within Meta Superi...
Location
Location
United States , Menlo Park
Salary
Salary:
177000.00 - 247000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Bachelor's degree in Mathematics, Statistics, a relevant technical field, or equivalent practical experience
  • A minimum of 6 years of work experience in analytics (minimum of 4 years with a Ph.D.)
  • Experience with data querying languages (e.g. SQL), scripting languages (e.g. Python), and/or statistical/mathematical software (e.g. R)
Job Responsibility
Job Responsibility
  • Scientific Design & Validity: Lead the design of evaluation stimuli and benchmarks, ensuring they have minimal bias and high construct validity for frontier LLM capabilities
  • Experimental Methodology: Design and execute effective sampling strategies and experimental frameworks to measure model performance and errors accurately
  • Deep-Dive Analysis: Perform rigorous data and model error analyses to provide deep insights into model behavior, quality gaps, and failure modes
  • Collaborative Research: Partner closely with Research Scientists and Engineers to translate organizational priorities into measurable, scientifically sound benchmarks
  • External Impact: Drive the publication of novel evaluation research and the open-sourcing of benchmarks to influence the broader AI research community
  • Strategic Influence: Use data-driven insights to influence research directions and major model development lines within MSL
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

AI Research Scientist, Personalization, Meta SuperIntelligence Labs

Meta is seeking AI research scientists to help us build the solutions for Person...
Location
Location
United States , Menlo Park
Salary
Salary:
154000.00 - 217000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Phd in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Experience in Generative AI models and building LLM technologies particularly post training
  • Experience solving complex problems and comparing alternative solutions, tradeoffs, and different perspectives to determine a path forward. Proven experience of proactively identifying, scoping and implementing innovative research solutions
  • Programming experience in Python and hands-on experience with frameworks like Pytorch, Spark
  • Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
Job Responsibility
Job Responsibility
  • Collaborate with cross-functional teams to develop and improve personalization in Meta’s frontier foundation models
  • Directly contribute to experiments, including designing experimental details, authoring reusable code, running evaluations, and organizing results
  • Prioritize research that can be applied to Meta's product development
  • Lead complex research projects end-to-end
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

AI Research Scientist - Voice AI Team, Meta Superintelligence Labs

Meta is seeking AI Research Scientists to join the Realtime AI Voice team in Met...
Location
Location
United States , Menlo Park, CA +2 locations
Salary
Salary:
184000.00 - 257000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • PhD degree in Computer Science, Mathematics, or similar quantitative field
  • 2+ years of post-PhD experience in an academic, industry, or government laboratory setting, with primary responsibilities focused on AI research
  • Proven track record of publications at peer-reviewed AI & speech conferences (e.g. NeurIPS, ICML, ICLR, ICASSP)
  • Experience in training, fine-tuning, and/or experimenting with foundation models beyond black-box use
  • Familiarity with one or more deep learning frameworks (e.g., pytorch, tensorflow)
  • Experience communicating complex research to public audiences of peers
Job Responsibility
Job Responsibility
  • Lead, collaborate, and execute on research that pushes forward the state of the art in speech and large language model research
  • Directly contribute to experiments, including designing experimental details, develop reusable code, running evaluations, and organizing results
  • Help identify long-term research goals as well as intermediate milestones
  • Work cross-functionally to translate research breakthroughs into scalable, production-ready solutions for Meta's conversational AI / product experiences
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right
New

Long-term Primary Supply Teacher

Long-Term Primary Supply Teacher - Reigate (KS1) We are seeking a dedicated KS1...
Location
Location
United Kingdom , Reigate
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
May 22, 2026
Flip Icon
Requirements
Requirements
  • QTS/PGCE qualified Teacher with experience in KS1
  • Strong classroom management and the ability to deliver pre-planned lessons effectively
  • Passion for teaching and the ability to engage KS1 students in their learning
  • Driver preferred for ease of access to schools in the local area
  • Eligibility to work in the UK
Job Responsibility
Job Responsibility
  • Follow pre-planned lessons and ensure students experience consistent and engaging lessons in KS1
  • Create a positive and organised learning environment while maintaining excellent behaviour standards
  • Encourage active participation and foster a love of learning in young students
  • Adapt lessons and teaching methods to suit the diverse needs of students
  • Work alongside other staff members to ensure the smooth running of lessons and support student development
  • Arrive on time, follow school policies, and maintain professionalism throughout the placement
What we offer
What we offer
  • Long-Term Stability: Secure a consistent, long-term teaching role with the possibility of permanent placement
  • Weekly Pay: Receive your pay weekly at a competitive rate
  • DBS Support: We provide assistance to help you obtain a DBS if needed
  • Free Online Training: Safeguarding training available if not completed in the last six months
  • Referral Bonus: Earn rewards by referring other teachers to us
  • Career Progression: Opportunities for professional development and growth within the education sector
  • Supportive School Environment: Work in a school that values its teaching staff and offers a positive working atmosphere
  • Fulltime
Read More
Arrow Right