Research Scientist Intern, LLM Evaluation Job at Meta (Bellevue)

Research Scientist Intern, Multimodal AI (PhD)

The Meta Reality Labs Research Team brings together a world-class team of resear...

Location

United States , Redmond

Salary:

7650.00 - 12134.00 USD / Month

Meta

Expiration Date

Until further notice

Requirements

Currently has, or is in the process of obtaining, a PhD degree in the field of Computer Science, Artificial Intelligence, Generative AI, Transformer Models, Machine Learning, Signal Processing or Computer vision
3+ years experience with Python, Matlab, or similar
3+ years experience with machine learning software platforms such as PyTorch, TensorFlow, etc
Experience building novel audio computational models and LLM
Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment

Job Responsibility

Design, implement, and maintain comprehensive evaluation protocols for large language models, including both automated and human-in-the-loop assessments
Develop and curate high-quality datasets and benchmarks to measure model performance, safety, fairness, and robustness across a variety of tasks and modalities
Analyze model outputs to identify strengths, weaknesses, and failure modes, and provide actionable insights to research and engineering teams
Design and implementation of novel algorithms to solve audio research problems
Collaboration with teams building Meta’s language AI products
Collaborate with researchers, engineers, and cross-functional partners to define evaluation goals, communicate findings, and drive improvements in model quality
Develop tools and infrastructure to streamline and scale evaluation processes, including dashboards, annotation platforms, and reporting systems
Stay up-to-date with the latest research in audio LLM evaluation, benchmarking, and responsible AI, and incorporate best practices into Meta’s workflows
Disseminate evaluation results through internal reports, presentations, and, when appropriate, external publications

What we offer

benefits

Fulltime

Staff Machine Learning Research Scientist, LLM Evals

As a Staff Machine Learning Research Scientist on the LLM Evals team, you will l...

Location

United States , San Francisco; Seattle; New York

Salary:

280000.00 - 380000.00 USD / Year

Scale

Expiration Date

Until further notice

Requirements

5+ years of hands-on experience in large language model, NLP, and Transformer modeling, in the setting of both research and engineering development
Experience and track of recording in landing major research impacts in a fast-paced environment
Experience tech leading a team of research scientists and research engineers
Excellent written and verbal communication skills
Published research in areas of machine learning at major conferences (NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, etc.) and/or journals
Previous experience in a customer facing role.

Job Responsibility

Drive research on the effectiveness and limitations of existing LLM evaluation techniques
Design and develop novel evaluation benchmarks for large language models, covering areas such as instruction following, factuality, robustness, and fairness
Communicate, collaborate, and build relationships with clients and peer teams to facilitate cross-functional projects
Collaborate with internal teams and external partners to refine metrics and create standardized evaluation protocols
Implement scalable and reproducible evaluation pipelines using modern ML frameworks
Publish research findings in top-tier AI conferences and contribute to open-source benchmarking initiatives
Mentor and guide research scientists and engineers, providing technical leadership across cross-functional projects
Stay deeply engaged with the ML research community, tracking emerging work and contributing to the advancement of LLM evaluation science
Thrive in a high-energy, fast-paced startup environment and are ready to dedicate the time and effort needed to drive impactful results.

What we offer

Comprehensive health, dental and vision coverage
retirement benefits
a learning and development stipend
generous PTO
equity based compensation
commuter stipend (may be eligible).

Fulltime

Tech Lead Manager Machine Learning Research Scientist LLM Evals

As the Tech Lead Manager of the LLM Evals Research team, you will lead a talente...

Location

United States , San Francisco; Seattle; New York

Salary:

280000.00 - 380000.00 USD / Year

Scale

Expiration Date

Until further notice

Requirements

5+ years of hands-on experience in large language model, NLP, and Transformer modeling, in the setting of both research and engineering development
Experience and track of recording in landing major research impacts in a fast-paced environment
Experience supporting and leading a team of research scientists and research engineers
Excellent written and verbal communication skills
Published research in areas of machine learning at major conferences (NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, etc.) and/or journals
Previous experience in a customer facing role

Job Responsibility

Lead a team of highly effective research scientists and research engineers on LLM evals
Conduct research on the effectiveness and limitations of existing LLM evaluation techniques
Design and develop novel evaluation benchmarks for large language models, covering areas such as instruction following, factuality, robustness, and fairness
Communicate, collaborate, and build relationships with clients and peer teams to facilitate cross-functional projects
Collaborate with internal teams and external partners to refine metrics and create standardized evaluation protocols
Implement scalable and reproducible evaluation pipelines using modern ML frameworks
Publish research findings in top-tier AI conferences and contribute to open-source benchmarking initiatives
Remain up-to-date on ongoing research in the team, help work through technical challenges, and be involved in design decisions
Remain deeply involved in the research community, both understanding trends, and setting them
Thrive in a high-energy, fast-paced startup environment and are ready to dedicate the time and effort needed to drive impactful results

What we offer

Comprehensive health, dental and vision coverage
retirement benefits
a learning and development stipend
generous PTO

Fulltime

Research Scientist Intern, Multimodal AI

The Meta Reality Labs Research Team brings together a world-class team of resear...

Location

United States , Redmond

Salary:

7650.00 - 12134.00 USD / Month

Meta

Expiration Date

Until further notice

Requirements

Currently has, or is in the process of obtaining, a PhD degree in the field of Computer Science, Artificial Intelligence, Generative AI, Transformer Models, Machine Learning, Signal Processing or Computer vision
3+ years experience with Python, Matlab, or similar
3+ years experience with machine learning software platforms such as PyTorch, TensorFlow, etc
Experience building novel audio computational models and LLM
Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment

Job Responsibility

Design, implement, and maintain comprehensive evaluation protocols for large language models, including both automated and human-in-the-loop assessments
Develop and curate high-quality datasets and benchmarks to measure model performance, safety, fairness, and robustness across a variety of tasks and modalities
Analyze model outputs to identify strengths, weaknesses, and failure modes, and provide actionable insights to research and engineering teams
Design and implementation of novel algorithms to solve audio research problems
Collaboration with teams building Meta’s language AI products.. Collaborate with researchers, engineers, and cross-functional partners to define evaluation goals, communicate findings, and drive improvements in model quality
Develop tools and infrastructure to streamline and scale evaluation processes, including dashboards, annotation platforms, and reporting systems
Stay up-to-date with the latest research in audio LLM evaluation, benchmarking, and responsible AI, and incorporate best practices into Meta’s workflows
Disseminate evaluation results through internal reports, presentations, and, when appropriate, external publications

Research Scientist Intern, Computer Vision - Video Intelligence

The Video Intelligence team is seeking highly motivated Research Interns to join...

Location

United States , Menlo Park

Salary:

7650.00 - 12134.00 USD / Month

Meta

Expiration Date

Until further notice

Requirements

Currently has or is in the process of obtaining a Ph.D. degree in Computer Science, Electrical Engineering, or related field with a focus on generative modeling, computer vision, or machine learning
Programming experience in Python and hands-on experience in deep learning frameworks such as PyTorch
Experience working on generative models e.g. diffusion models, LLM, autoregressive transformers, etc
Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment

Job Responsibility

Conduct research on advanced topics in video generation and understanding, including but not limited to text-to-video generative models, image-to-video generative models, video understanding models, unified native video generative models
Design, implement, and evaluate novel algorithms and model architectures
Collaborate closely with researchers and engineers across the Video Intelligence group and broader GenAI teams
Contribute to publications in top-tier conferences and journals in AI, computer vision, and machine learning
Present findings and share insights that help shape both ongoing research and future directions

Research Scientist Intern, Audio

We are seeking a highly motivated and talented Audio Research Scientist Intern t...

Location

United States , Redmond

Salary:

7313.00 - 12134.00 USD / Month

Meta

Expiration Date

Until further notice

Requirements

Currently has, or in the process of obtaining a PhD in Computer Science, Electrical Engineering, Auditory Neuroscience, Audio Signal processing or a related field
Experience in building deep learning models
Experience with LLM models
2+ years experience with Python and PyTorch
Understanding of audio processing concepts
Proven communication and collaboration skills
Demonstrated skill in learning and applying new concepts, techniques, and tools to solve complex problems
Must obtain work authorization in country of employment at the time of hire and maintain ongoing work authorization during employment

Job Responsibility

Train or fine-tune audio models in Pytorch
Process and analyze speech and audio data: including binaural data simulation, data cleaning, feature extraction and visualization
Collaborate with other researchers to collect data through listening experiments
Design and conduct experiments to evaluate the performance of these models and interpret results
Communicate findings through written reports and presentations

Senior AI Research Scientist

Workato transforms technology complexity into business opportunity. As the leade...

Location

United States , San Francisco

Salary:

Not provided

Workato

Expiration Date

Until further notice

Requirements

MS/PhD in Computer Science, ML, or related field—or equivalent experience
Hands‑on with PyTorch/JAX and modern LLM frameworks
Strong publication record in top-tier ML venues (NeurIPS, ICML, ICLR) or demonstrable impactful experimental work
hands‑on experience with large‑scale model training, transformer architectures, reinforcement‑learning techniques, and CUDA
Curiosity‑driven and self‑directed
Ability to explain complex ideas to non‑experts
Team player who welcomes feedback and knowledge‑sharing

Job Responsibility

Explore workflow‑aware planning, cost‑optimised RAG, tool‑use evaluation, and multi‑agent collaboration
Prototype and benchmark models
present findings internally and externally
Collaborate with Product & Engineering to ship research‑backed features
Contribute to open‑source repos and author technical blogs

What we offer

vibrant and dynamic work environment
multitude of benefits they can enjoy inside and outside of their work lives

AI Applied Scientist - PhD Intern, Foundational IQ

As a PhD Research Intern on the Foundational IQ team, you will help train and ad...

Location

United States

Salary:

104000.00 - 166000.00 USD / Year

Zillow

Expiration Date

Until further notice

Requirements

Currently enrolled in a PhD program in Computer Science, Machine Learning, Artificial Intelligence or a related field with a strong research track record
Experience in one or more of the following: LLMs: instruction tuning/fine-tuning, prompting, and evaluation/measurement
Multimodal learning (image + text
familiarity with audio or geospatial a plus)
Representation learning with limited labels (self/semi/weakly-supervised)
User modeling for personalization systems
Reinforcement learning or sequential decision-making
Evaluating generative/agentic systems
privacy-aware and responsible AI practices (e.g., fair-housing considerations) are a plus
Proficiency in Python and modern ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face)

Job Responsibility

Research and develop methods for adapting LLMs and foundation models with Zillow’s domain-specific data
Build and evaluate multimodal models that combine text, images, geospatial and tabular signals for home and user understanding
Explore reinforcement learning and sequential decision-making for long-horizon, user-centric outcomes
Prototype agentic workflows
define success metrics and run rigorous offline/online evaluations
Partner across science, engineering, product, and design
share results via docs, presentations, and publications

Fulltime

Select Country

Research Scientist Intern, LLM Evaluation

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?