Research Scientist, Multi-Modal Job at Meta (Pittsburgh)

Research Scientist Intern, AI Research Multi-modal Post-Training

Meta is seeking Research Scientist Interns in the Meta Superintelligence org. We...

Location

United States , Menlo Park

Salary:

7650.00 - 12134.00 USD / Month

Meta

Expiration Date

Until further notice

Requirements

Currently has or is in the process of obtaining a Ph.D. degree in Computer Science, NLP, Reinforcement Learning (RL), Computer Vision, Artificial Intelligence, or relevant technical field
Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment
Experience in Python or other related programming languages
Experience building systems based on machine learning and/or deep learning methods

Job Responsibility

Perform research to advance the science and technology of generative AI
Perform research that enables learning the semantics of data at scale (images, video, text, audio, and other modalities)
Improve and propose new methods for post-training foundation models across the spectrum of techniques including reinforcement learning and supervised fine tuning
Collaborate with researchers and cross-functional partners including communicating research plans, progress, and results
Devise better data-driven models of image multi-modal understanding
Publish research results and contribute to research that can be applied to Meta product development

Ai Applied Scientist - Phd Intern, Next-Gen Agentic And Multi-Modal Home Exploration Experience

Are you passionate about creating AI agents capable of reasoning, planning, and ...

Location

United States

Salary:

104000.00 - 166000.00 USD / Year

Zillow

Expiration Date

Until further notice

Requirements

Currently enrolled in a PhD program in computer science, NLP, machine learning, or a related field, with solid publication record
Background in at least one of the following areas: Human computer interaction (HCI)
User behavior research in the context of agentic AI
Agentic AI (tool use, planning, reasoning, decision-making)
Conversational AI and dialogue optimization
Multi-modal inference models with focus on combining 3D Computer Vision and LLMs
Multi-agent systems and orchestration
Memory systems and context engineering
Reinforcement learning and reward modeling
Familiarity with modern deep learning frameworks (e.g., PyTorch, Hugging Face Transformers)

Job Responsibility

Personalized and Guided Home Exploration: An agentic approach that proactively guides and helps users navigate millions of listings to identify the best homes, the experience should be highly engaging, fun and goal oriented
Conversational Optimization: Enhanced multi-turn conversations with effective context management and improved dialogue quality, achieved through organized data from retrieved results
Multi-modal Collaboration System: A combination of 3D computer vision (utilizing 3D reconstructions and Gaussian splats) and LLM interfaces, powered by conversational AI

Fulltime

AI Applied Scientist - PhD Intern, Next-Gen Agentic and Multi-Modal Home Exploration Experience

Are you passionate about creating AI agents capable of reasoning, planning, and ...

Location

United States

Salary:

104000.00 - 166000.00 USD / Year

Zillow

Expiration Date

Until further notice

Requirements

Currently enrolled in a PhD program in computer science, NLP, machine learning, or a related field, with solid publication record
Background in at least one of the following areas: Human computer interaction (HCI)
User behavior research in the context of agentic AI
Agentic AI (tool use, planning, reasoning, decision-making)
Conversational AI and dialogue optimization
Multi-modal inference models with focus on combining 3D Computer Vision and LLMs
Multi-agent systems and orchestration
Memory systems and context engineering
Reinforcement learning and reward modeling
Familiarity with modern deep learning frameworks (e.g., PyTorch, Hugging Face Transformers)

Job Responsibility

Use expertise in Agentic systems, conversational AI, LLMs, and multi-modal inference to advance customer-facing experiences and interfaces
Build AI agents capable of handling complex, rich media oriented, multi-turn interactions while maintaining context and taking appropriate actions
Develop the next-generation real estate shopping experience that integrates Agentic and Multi-modal reasoning

Fulltime

Research Scientist Manager - ML Modeling & Applied Research

Reality Labs at Meta is seeking Research Scientist Manager with experience in ma...

Location

United States , Burlingame

Salary:

184000.00 - 257000.00 USD / Year

Meta

Expiration Date

Until further notice

Requirements

8+ years of experience working autonomously to design, execute, interpret, and present ML research outcomes
4+ years of experience as technical lead for a project of 4 or more individuals
2+ years of direct management experience, managing Researchers or Engineers
Experience in the analysis and modeling of high dimensional time series, such as neural signals, multi-channel audio recordings, multi-modal/multi-sensor signals, robotic sensory signals, financial time series, video, or other sensor modalities
Experience bringing machine learning-based products from research to production
Experience with interdisciplinary and/or cross-functional collaboration
Experience with large scale cluster computing for machine learning modeling
Experience developing end-to-end ML pipelines, including: dataset preprocessing, model development and evaluation, and software integration
Experience in software engineering in industry
Must obtain work authorization in country of employment at the time of hire and maintain ongoing work authorization during employment

Job Responsibility

Build cutting-edge machine learning and signal processing models (event detection, sequence-to-sequence, signal separation, time series regression, etc.) to advance neuromotor interface capabilities
Collaborate with engineering and Human-Computer Interactions (HCI) teams to deploy models that leverage fundamental scientific knowledge into new technology and user experiences
Use quantitative research methods to define, iterate upon and advance key areas of our research agenda
Develop research-grade code for deployment in research prototypes. Work across organizational boundaries to solve our biggest problems

What we offer

bonus
equity
benefits

Research Scientist – World Models, Robotics & Embodied AI

Meta Reality Labs Research (RL Research) brings together a team of researchers a...

Location

United Kingdom , London

Salary:

Not provided

Meta

Expiration Date

Until further notice

Requirements

Currently has or is in the process of obtaining a PhD in the field of Computer Vision, Robotics, AI, Computer Science, a related field, or equivalent practical experience. Degree must be completed prior to joining Meta
Research experience involving 3D Computer Vision, Deep Learning, or Robotics—specifically related to multimodal or 3D generative modeling, predictive world models, scene understanding, or learning-based robotic control
Experience with real-world system building and data collection, including design, coding, and evaluation with modern ML methods
Experience communicating research for public audiences of peers
Experience with deep learning frameworks (e.g., Pytorch, Tensorflow) and Python
Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment

Job Responsibility

Drive fundamental and applied research at the intersection of multi-modal generative AI, predictive world modeling, embodied reasoning, and robotic manipulation
Investigate or invent architectures that deliver a spectrum of embodied behaviors from simulated environments to real robots, and from tactile-driven motor control to high-level, long-horizon intelligence
Design research methodologies and lead empirical evaluations, authoring well-tested code for physical hardware and simulators
Build prototype systems that drive multi-step, long-horizon robotic perception, reasoning, and action
Contribute to and lead high-impact publications and open-sourcing efforts
Identify long-term research goals while executing intermediate milestones
Collaborate with a wide-ranging set of scientists and engineers across teams

Fulltime

Senior Scientist – Research Computational Biology (ARIA)

Join Amgen’s Mission of Serving Patients. The ARIA Computational Biology team is...

Location

United States , South San Francisco; Boston; Thousand Oaks

Salary:

146404.00 - 198076.00 USD / Year

Amgen

Expiration Date

Until further notice

Requirements

PhD in computational biology, bioinformatics, data science, or a related discipline [and relevant post-doc where applicable]
Master’s degree in computational biology, bioinformatics, data science, or a related discipline and 3 years of relevant research experience
Bachelor’s degree in computational biology, bioinformatics, data science, or a related discipline and 5 years of relevant research experience
Strong background in cardiometabolic disease and/or immunology, including applications in the interpretation of single-cell data
Proficient in extracting actionable mechanistic insights from complex biological datasets through development and creative application of AI/ML-based analytical strategies
Strong programming skills (Python, R, Linux/Unix) and experience with cloud computing environments, HPC, and collaborative coding practices (e.g., Git)
Track record of designing and executing creative and holistic computational strategies to address challenging research questions
Proven expertise in the analysis and interpretation of single-cell omics data
Excellent communication and presentation skills, with the ability to convey complex concepts to diverse audiences
Self-motivated, collaborative, and committed to continuous learning and growth

Job Responsibility

Deriving biological insight from complex multi-modal omics and perturbation screening data to characterize disease endotypes and mechanisms, identify novel targets and biomarkers, and test therapeutic hypotheses
Conducting innovative, collaborative research in close partnership with Amgen therapeutic area scientists and our Discovery Sciences, Advanced Technologies, and AI (DATA) team, spanning discovery platforms, internal pipeline programs, and external partnerships

What we offer

A comprehensive employee benefits package, including a Retirement and Savings Plan with generous company contributions, group medical, dental and vision coverage, life and disability insurance, and flexible spending accounts
A discretionary annual bonus program, or for field sales representatives, a sales-based incentive plan
Stock-based long-term incentives
Award-winning time-off plans
Flexible work models where possible

Fulltime

ML Research Scientist (Health & Sensing)

Join the Sleep Fitness Movement. At Eight Sleep, we’re on a mission to fuel huma...

Location

United States , San Francisco

Salary:

Not provided

Eight Sleep

Expiration Date

Until further notice

Requirements

Expertise in at least one area of machine learning and artificial intelligence (e.g., self-supervised learning, multi-modal ML, model optimization, NLP, LLM)
Strong interest in applying machine learning to health related problems and data
Experience using a programming language (Python, C/C++ etc.) to manipulate data, draw insights from large data sets, and train machine learning models
3+ years of practical experience applying ML to solve real-world problems or relevant quantitative and qualitative research and analytics experience
PhD in Computer Science, Machine Learning, AI, Statistics, Mathematics, or related quantitative field with a notable publication record
or BS/MS with publications at top venues (e.g. NeurIPS, ICML, ICLR, AAAI, CVPR, ICCV, ACL, EMNLP, INTERSPEECH)

Job Responsibility

Advance the Pod’s adaptive thermoregulation system - the “autopilot” system that continuously learns and reacts to micro-events like restlessness or awakenings
Design policies that optimize comfort and sleep quality in real time through reinforcement learning and closed-loop control
Develop a multimodal health foundation model that integrates physiology and environmental context - learning from Pod signals, wearable sensors, and contextual data
Build a high-fidelity physiological simulator that models how daily behaviors ripple into tonight’s sleep and tomorrow’s readiness

What we offer

Equity participation
Periodic equity refreshments based on performance
Your own Pod

Fulltime

Research Scientist Intern, AI Core Machine Learning

We are committed to advancing the field of artificial intelligence by making fun...

Location

United States , New York

Salary:

7650.00 - 12134.00 USD / Month

Meta

Expiration Date

Until further notice

Requirements

Currently has or is in the process of obtaining a PhD degree in Machine Learning, Artificial Intelligence, Computer Science, Information or Multimedia Retrieval, Reinforcement Learning, Mathematics, Signal Processing, or relevant technical field
Must obtain work authorization in country of employment at the time of hire and maintain ongoing work authorization during employment
Experience with Python, C++, C, Java or other related language
Experience with deep learning frameworks such as Pytorch or Tensorflow
Experience building systems based on machine learning and/or deep learning methods
Research experience with algorithms for sequential decision-making, e.g., planning, reinforcement learning, or similar

Job Responsibility

Develop novel state-of-the-art machine learning algorithms and corresponding systems, leveraging various deep learning techniques
Analyze and improve efficiency, scalability, and stability of corresponding deployed algorithms
Perform state of the art research to advance the science and technology of Machine Learning and Artificial Intelligence
Devise better data-driven models for information retrieval, Multi-modal fusion, generation or media understanding (CV, NLP, Speech/ Audio)
Collaborate with researchers and cross-functional partners including communicating research plans, progress, and results
Contribute to research that can be applied to Meta product development

Select Country

Research Scientist, Multi-Modal

Job Description

Job Responsibility

Requirements

Nice to have

What we offer

Looking for more opportunities?