CrawlJobs Logo

AI Research Scientist, Evaluations - Meta Superintelligence Lab

meta.com Logo

Meta

Location Icon

Location:
United States , Menlo Park

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

184000.00 - 257000.00 USD / Year

Job Description:

Meta is seeking Research Scientists to join the Evaluations team within Meta Superintelligence Labs (MSL). Evaluations are the core of AI progress at MSL, determining what capabilities get built, which features get prioritized, and how fast our models improve. As a Research Scientist, you will provide the technical capabilities to measure and understand the capabilities of our frontier AI systems. You'll work in tandem with world-class researchers to envision, develop, and validate novel evaluations that shape the future of AI capability measurement. This is a technical research role requiring good scientific judgment, creativity, and the ability to drive ambitious research agendas with independence. The evaluations you develop will directly influence research direction and major model lines within MSL, making scientific validity, methodological rigor, and clear communication important. You will collaborate closely with technical leadership to ensure evaluations capture the most important capabilities, translating organizational priorities into measurable benchmarks, and translating evaluation insights back into research direction. We are looking for exceptional research talent – researchers who have shaped the field of machine learning, and are ready to do so again at the frontier of AI. If you are passionate about defining how we measure AI progress and want to shape the scientific foundations of frontier AI development, we encourage you to apply for this exciting opportunity at the core of MSL.

Job Responsibility:

  • Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development
  • Develop and implement evaluation environments, including environments for novel model capabilities and modalities
  • Collaborate with external data vendors to source and prepare high-quality evaluation datasets
  • Execute on the technical vision of research scientists designing new benchmarks and evaluations
  • Build robust, reusable evaluation pipelines that scale across multiple model lines and product areas
  • Contribute to evaluation tooling that measures the quality and reliability of evaluation suites

Requirements:

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • PhD degree in Computer Science, Machine Learning, or a related technical field
  • 3+ years of experience in machine learning engineering, machine learning research, or a related technical role
  • Proficiency in Python and experience with ML frameworks such as PyTorch
  • Experience identifying, designing and completing medium to large technical features independently, without guidance
  • Proven success in software engineering practices including version control, testing, and code review practices
  • Ability to work independently and adapt to rapidly changing priorities

Nice to have:

  • Publications at peer-reviewed venues (NeurIPS, ICML, ICLR, ACL, EMNLP, or similar) related to language model evaluation, benchmarking, or deep learning
  • Hands-on experience with language model post-training and deep learning systems, or building reinforcement learning environments
  • Experience implementing or developing evaluation benchmarks for large language models and multimodal models (e.g., vision-language, audio, video)
  • Experience working with large-scale distributed systems and data pipelines
  • Familiarity with language model evaluation frameworks and metrics
  • Track record of open-source contributions to ML evaluation tools or benchmarks
What we offer:
  • bonus
  • equity
  • benefits

Additional Information:

Job Posted:
February 20, 2026

Employment Type:
Fulltime
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for AI Research Scientist, Evaluations - Meta Superintelligence Lab

AI Research Scientist, Personalization, Meta SuperIntelligence Labs

Meta is seeking AI research scientists to help us build the solutions for Person...
Location
Location
United States , Menlo Park
Salary
Salary:
154000.00 - 217000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Phd in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Experience in Generative AI models and building LLM technologies particularly post training
  • Experience solving complex problems and comparing alternative solutions, tradeoffs, and different perspectives to determine a path forward. Proven experience of proactively identifying, scoping and implementing innovative research solutions
  • Programming experience in Python and hands-on experience with frameworks like Pytorch, Spark
  • Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
Job Responsibility
Job Responsibility
  • Collaborate with cross-functional teams to develop and improve personalization in Meta’s frontier foundation models
  • Directly contribute to experiments, including designing experimental details, authoring reusable code, running evaluations, and organizing results
  • Prioritize research that can be applied to Meta's product development
  • Lead complex research projects end-to-end
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

Research Engineering Manager, Evaluations, Meta Superintelligence Labs

Meta is seeking a Research Engineering Manager to lead the Evaluations team with...
Location
Location
United States , Menlo Park
Salary
Salary:
219000.00 - 301000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Machine Learning, or a related technical field
  • 4+ years of experience in machine learning engineering, machine learning research, or a related technical role
  • 3+ years of experience managing or leading technical teams, including hiring, mentoring, and performance management
  • Proficiency in Python and experience with ML frameworks such as PyTorch
  • Proven track record of leading medium to large-scale technical projects from conception to deployment
  • Demonstrated experience balancing hands-on technical work with people management and strategic planning
  • Clear communication and experience influencing cross-functional stakeholders
Job Responsibility
Job Responsibility
  • Build, mentor, and grow a team of research engineers and scientists focused on evaluation infrastructure and benchmarking
  • Conduct performance reviews, career development conversations, and provide technical mentorship to team members
  • Foster a culture of engineering excellence, research rigor, and rapid iteration within the team
  • Partner with recruiting to hire world-class research engineering talent
  • Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development
  • Oversee the development and implementation of evaluation environments, including environments for novel model capabilities and modalities
  • Establish partnerships with external data vendors to source and prepare high-quality evaluation datasets
  • Influence the technical roadmap for evaluation infrastructure in collaboration with MSL Infra team
  • Translate the technical vision of research scientists into actionable engineering plans and execution strategies
  • Partner with research scientists, product teams, and other engineering teams to align evaluation priorities with organizational goals
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right
New

Foreign Pharmacy Grad - International Pharmacy Intern

You’ve invested a lot of time and energy in your education. Now you want the cha...
Location
Location
United States , Lebanon
Salary
Salary:
30.00 - 42.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
May 09, 2026
Flip Icon
Requirements
Requirements
  • Foreign Graduate from a Non-US Accredited college or school of pharmacy prior to beginning US Non-Accredited Foreign Graduate Training Program at CVS
  • FPGEC certification
  • Pharmacist licensure in the state in which the position is based within 120 days of completion of US Intern hours
  • Must possess, or be in the process of obtaining, valid intern and/or technician licensure as required
  • Regular and predictable attendance, including nights and weekends
  • Ability to complete required training within designated timeframe
  • Ability to concentrate on a task over a period of time
  • Ability to pivot quickly from one task to another to meet patient and business needs
  • Ability to confirm prescription information and label accuracy, ensuring patient safety
  • Actively look for ways to help people, and do so in a friendly manner
Job Responsibility
Job Responsibility
  • Living our purpose by following all company SOPs at each workstation to help our Pharmacists and Technicians manage and improve patient health
  • Following pharmacy workflow procedures at each pharmacy workstation (i.e., production, pick-up, drive-thru, and drop-off) for safe and accurate prescription fulfillment
  • Contributing to positive patient experiences by showing empathy and genuine care: creating heartfelt and personalized moments while serving patients at pick-up, drive-thru, and over the phone
  • keeping patients healthy by offering immunizations and other services at the register and over the phone
  • and demonstrating compassionate care by solving or escalating patient problems
  • Offering to counsel, fielding medical questions, and soliciting information on a patient’s medical history to provide optimal care, when appropriate under the direct supervision of a licensed pharmacist
  • Taking telephonic prescriptions from the prescriber, and calling the prescriber to clarify prescriptions or facilitate medication changes, where allowed by state regulation
  • Maintaining the highest level of self-awareness and providing in-the-moment coaching, training, and mentoring to pharmacy team members while sharing best practices
  • Completing basic inventory activities, as permitted by law, and as directed by the pharmacy leadership team, such as accurately putting away medication deliveries and completing cycle counts, returns-to-stocks, waiting bin inventories, etc.
  • Contributing to a high-performing team, embracing a growth mindset, and being receptive to feedback
  • Fulltime
Read More
Arrow Right
New

Pharmacy Intern

You’ve invested a lot of time and energy in your education. Now you want the cha...
Location
Location
United States , Boston
Salary
Salary:
18.50 - 20.25 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
May 02, 2026
Flip Icon
Requirements
Requirements
  • Accepted into or actively enrolled in an ACPE accredited college or school of pharmacy
  • 0-3 years relevant work experience
  • Must possess or be in process of obtaining valid intern and/or technician licensure as required
  • Strong communication and presentation skills
  • Complete all required training within state guidelines and required timeframe
  • Ability to: Have regular and predictable attendance, including nights and weekends
  • Be mobile and remain upright for extended periods of time
  • Lift, scan, and bag items
  • Finger Dexterity: Picking, pinching, typing or otherwise working primarily with fingers rather than whole hand or arm
  • Reach overhead
Job Responsibility
Job Responsibility
  • Patient Safety
  • Pharmacy Professional Practice
  • Regulatory Requirements
  • Quality Assurance
  • Customer Service
  • Inventory Management
  • Workflow Management excluding final prescription verification
  • Lead with Heart – display empathy and compassion for your patients, customers, caregivers, and colleagues on your team
  • Seek new ways to grow, collaborate with others, and deliver better outcomes
  • Align others around our purpose to bring your heart to every moment of your health and gain support and commitment
Read More
Arrow Right
New

Medical Scientist/msl (oncology)

Location
Location
Japan , Tokyo
Salary
Salary:
9000000.00 - 14500000.00 JPY / Year
https://www.randstad.com Logo
Randstad
Expiration Date
February 01, 2027
Flip Icon
Requirements
Requirements
  • Advanced degree in life sciences (PhD, PharmD, MD) preferred
  • Minimum 3 years of experience in the pharmaceutical or biotech industry
  • Demonstrated experience in medical affairs or a related field within Oncology is strongly preferred
  • Strong communication and presentation skills in both Japanese and English
  • Experience working collaboratively within a cross-functional team environment
  • Project management experience and strong problem-solving abilities
Job Responsibility
Job Responsibility
  • MSLとして業務幅が広く、Medical戦略を実行に落とし込むための戦略立案に携わることができます
  • 臨床研究の窓口とり、Studyに携わることもできます
What we offer
What we offer
  • 健康保険
  • 厚生年金保険
  • 雇用保険
  • 土曜日
  • 日曜日
  • 祝日
  • Fulltime
Read More
Arrow Right
New

In-home traveler nurse practitioner or physician assistant

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States
Salary
Salary:
87035.00 - 187460.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
December 31, 2026
Flip Icon
Requirements
Requirements
  • Active, unrestricted license(s) in coverage area(s)
  • Board certification (required)
  • Able to obtain and maintain multi-state licenses in coverage area, as required
  • Able to cover all counties within state and flex to other areas of business need
Job Responsibility
Job Responsibility
  • Provide In-Home Health Evaluations
  • Engage with people in the comfort of their own homes
  • Help bridge gaps in care
  • Travel - up to 100% of the time - across a defined coverage area
  • Conduct virtual visits as needed
  • Provide all Signify Health services as indicated including Diagnostic & Preventive Services products (i.e., spirometry, DEE, bone density screening, etc.)
What we offer
What we offer
  • Health, dental and vision insurance
  • Paid time off
  • Annual CEU allowance
  • 401K
  • Supplies and other perks
  • Malpractice coverage
  • Affordable medical plan options
  • 401(k) plan (including matching company contributions)
  • Employee stock purchase plan
  • No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
  • Fulltime
Read More
Arrow Right
New

In-Home Nurse Practitioner or Physician Assistant

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Scranton
Salary
Salary:
41.85 - 90.13 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
December 31, 2026
Flip Icon
Requirements
Requirements
  • Active, unrestricted license(s) in coverage area(s)
  • Board certification (required)
  • Multi-state licenses (preferred)
Job Responsibility
Job Responsibility
  • Provide In-Home Health Evaluations
  • Engage with people in their homes to help bridge gaps in care
  • Build trusted relationships to make people healthier
  • Bring flexible, comprehensive and personalized health evaluations to people's front doors
  • Conduct visits lasting about 45 minutes including medication and medical history review and physical evaluation
  • Perform additional diagnostic tests if ordered (i.e., diabetic eye exams, spirometry, etc.)
  • Use an iPad and an intuitive clinical workflow for each evaluation
  • Travel locally and within licensed states as needed
  • Conduct virtual visits as needed
  • Provide all Signify Health services as indicated including Diagnostic & Preventive Services products
What we offer
What we offer
  • Select benefits
  • Malpractice insurance coverage (during Signify Health-related activities)
  • Supplies and other perks
  • Affordable medical plan options
  • 401(k) plan (including matching company contributions)
  • Employee stock purchase plan
  • No-cost programs including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
  • Paid time off
  • Flexible work schedules
  • Family leave
  • Parttime
Read More
Arrow Right
New

Lead Director, Sales & Account Management

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Olympia
Salary
Salary:
105000.00 - 231132.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
May 09, 2026
Flip Icon
Requirements
Requirements
  • 7- 10 years of sales and account management experience with demonstrated leadership in sales strategy development and execution, accountability, and innovative sales approaches
  • Direct and broker sales experience
  • Relevant industry experience with complex sales and/or client management
  • Ability/experience leading a team of account managers and sales staff
  • Ability to travel as needed in assigned territory
  • Health & Life license required
  • Bachelor’s Degree or equivalent work experience
Job Responsibility
Job Responsibility
  • Sets, communicates, and executes strategy and performance measures in line with company, segment, region, and market goals for both membership and profitability
  • Leads business development activities in pursuit of new growth channels and identifies potential new clients in a specified territory or geographic area
  • Partners with sales resources on strategic account development and strategy execution
  • Develops and executes account management strategy for a book of business to include discussions on service levels and expectations, process improvements, operation of benefit plans, identification of gaps in service levels, and determination of root causes and solution development
  • Oversees existing business strategy implementation across assigned segment
  • Analyzes competitive environment to support and improve pricing, underwriting and product development strategies as well as service approach and sales efforts
  • Cultivates and maintains strong relationships with all constituents (producers, plan sponsors, providers, customers, regulatory agencies)
  • Recruits, attracts, and retains a diverse workforce and engages and develops them through mentoring, coaching, and making available tools and resources
  • Partners with cross-functional team and represents sales to ensure internal and external constituent needs are met
  • removes organizational barriers that impact cross-functional work required to achieve results
What we offer
What we offer
  • Sales Incentive Commission on top of base salary
  • Affordable medical plan options
  • 401(k) plan (including matching company contributions)
  • Employee stock purchase plan
  • No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
  • Paid time off
  • Flexible work schedules
  • Family leave
  • Dependent care resources
  • Colleague assistance programs
  • Fulltime
Read More
Arrow Right