CrawlJobs Logo

Research Scientist, Human AI Interaction

United States, San Francisco, CA, New York, NY 350000.00 - 420000.00 USD / Year · Job Posted February 20, 2026
Apply Position
Job Link Share

Job Description

As a Research Scientist, Human–AI Interaction, you will play a pivotal role in defining how AI systems support real human work by leading research at the intersection of Human–Computer Interaction (HCI), Large Language Models (LLMs), and task-level benchmarking. You will operate at the frontier of human-centered AI evaluation, with a focus on understanding what people actually do to accomplish meaningful work—and how AI systems change, accelerate, or reshape that activity. Your research will define jobs-to-be-done benchmarks, comparative evaluation frameworks, and empirical methods for measuring human effort, time, quality, and outcomes when working with AI copilots. Additionally, the Handshake AI platform is an interface used by thousands of the top subject matter experts in the world to evaluate AI systems, and offers numerous interesting HCI / HITL-AI research questions that will drive large business impact. You’ll set research direction, establish standards for measuring human activity in AI-mediated workflows, publish papers and open-source code, and lead the development of rigorous, scalable benchmarks that connect human work, AI assistance, and real economic value.

Job Responsibility

  • Lead high-impact research on jobs-to-be-done benchmarks for AI systems, including: Defining task taxonomies grounded in real professional and economic activities
  • Identifying what constitutes meaningful task completion, quality, and success
  • Translating qualitative work understanding into measurable, repeatable benchmarks
  • Develop methods to measure human activity in AI-mediated workflows
  • Design benchmarks to assess AI-as-a-collaborator/copilot, rather than autonomous agents / basic Q&A
  • Design and run empirical studies of how people use AI to solve tasks, including: Controlled experiments and field studies measuring task performance
  • Instrumentation for capturing fine-grained interaction traces and outcomes
  • Drive strategy for professional-domain AI benchmarks, focusing on: Understanding domain-specific workflows (e.g., analysis, writing, planning, coordination)
  • Grounding benchmark design in how work is actually performed, not idealized tasks
  • Build and prototype AI systems and evaluation infrastructure to support research and Data production, including: LLM-powered copilots and experimental tools used for task-level measurement
  • Benchmark harnesses that evaluate both model behavior and human outcomes
  • Data pipelines for analyzing human–AI interaction at scale
  • The human-in-the-loop experience for Handshake fellows to produce effective evaluations and training data for frontier models, through structured UI/UX interactions with these models
  • Collaborate closely with User Experience Research (UXR) to: Leverage deep qualitative insights into real user behavior and workflows
  • Translate ethnographic and observational findings into formal research constructs
  • Publish and present research that advances the field of human-centered AI benchmarking, with an expectation of regular contributions to top-tier venues such as CHI (Conference on Human Factors in Computing Systems), and related HCI and AI conferences

Requirements

  • PhD or equivalent experience in Human–Computer Interaction, Computer Science, Cognitive Science, or a related field, with a strong emphasis on empirical evaluation of interactive AI/LLM systems
  • 3+ years of academic or industry research experience post-PhD, including leadership on complex research initiatives and analyzing data from a real AI product
  • Strong publication record, with demonstrated impact in top-tier AI (NeurIPS, ICML, ICLR, ACL) and HCI (CHI) venues
  • Deep expertise in experimental design and measurement, particularly for: Task performance and human activity
  • Comparative evaluation frameworks
  • Mixed-methods research grounded in real-world behavior
  • Strong technical and coding skills, including: Python and data analysis / ML tooling
  • Experience building experimental systems and benchmark infrastructure
  • Familiarity working with LLM APIs, agent frameworks, or AI-assisted tooling
  • Proven ability to define and lead research agendas that connect human work, AI capability, and business or economic impact
  • Strong collaboration skills, especially working across research, engineering, product, and UXR teams

Nice to have

  • Experience developing benchmarks or evaluation frameworks for human–AI systems or AI-assisted productivity tools
  • Prior work on copilot-style systems, agentic workflows, or automation of professional tasks
  • Familiarity with workplace studies, CSCW, or socio-technical systems research
  • Contributions to open-source tools, datasets, or benchmarks related to task-level evaluation
  • Interest in how AI reshapes labor, productivity, and the future of work

What we offer

  • Equity in a fast-growing company
  • 401(k) match, competitive compensation, financial coaching
  • Paid parental leave, fertility benefits, parental coaching
  • Medical, dental, and vision, mental health support, $500 wellness stipend
  • $2,000 learning stipend, ongoing development
  • Internet, commuting, and free lunch/gym in our SF office
  • Flexible PTO, 15 holidays + 2 flex days, winter #ShakeBreak where our whole office closes for a week
  • Team outings & referral bonuses

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Research Scientist, Human AI Interaction

8 matching positions

Tech Lead, AI Research Scientist (Robotics)

Meta is seeking an AI Research Scientist to join Meta Superintelligence Labs. In...
Location
Location
United States , Menlo Park
Salary
Salary:
219000.00 - 301000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • PhD degree in the field of Artificial Intelligence, Robotics, Computer Vision, Machine Learning, Language, a related field, or equivalent practical experience
  • Experience with any of the following research areas: robotics, motion planning, embodied AI, human-robot interaction, sim-to-real transfer, learning from demonstration, reinforcement learning, dexterous manipulation, digital agents, vision language models, computer vision, egocentric perception, and/or LLMs
  • 5+ years of industry experience in relevant robotics related research areas, such as: robot learning, reinforcement learning, imitation learning, action-conditioned world models, task and motion planning, sim-to-real transfer robotic control, manipulation, navigation, or generally embodied AI
  • Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment
Job Responsibility
Job Responsibility
  • Perform fundamental and applied research to push the scientific and technological frontiers of embodied artificial intelligence
  • Invent/improve novel data-driven paradigms for robotics, leveraging a variety of modalities (images, video, text, audio, tactile, etc)
  • Investigate paradigms that can deliver a spectrum of embodied behaviors - from simulated characters to real robots, and from short-horizon, low-level to long-horizon, high-level intelligence
  • Develop algorithms based on state-of-the-art machine learning and neural network methodologies
  • Define, build and benchmark new capabilities needed for the next generation of AI
  • Conduct research towards long-term research goals while identifying intermediate milestones
  • Lead, plan, and execute novel research based on long-term objectives of the organization
  • Set research strategy and direction, and provide mentorship for a team of researchers
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

AI Research Scientist, Robotics

Meta is seeking a Research Scientist to join Meta Superintelligence Labs. Indivi...
Location
Location
United States , Menlo Park
Salary
Salary:
184000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • PhD degree in the field of Artificial Intelligence, Robotics, Computer Vision, Machine Learning, Language, a related field, or equivalent practical experience
  • Experience with any of the following research areas: robotics, motion planning, embodied AI, human-robot interaction, sim-to-real transfer, learning from demonstration, reinforcement learning, dexterous manipulation, digital agents, vision language models, computer vision, egocentric perception, and/or LLMs
  • 2+ years of industry experience in relevant robotics related research areas, such as: robot learning, reinforcement learning, imitation learning, action-conditioned world models, task and motion planning, sim-to-real transfer robotic control, manipulation, navigation, or generally embodied AI
  • Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment
Job Responsibility
Job Responsibility
  • Perform fundamental and applied research to push the scientific and technological frontiers of embodied artificial intelligence
  • Invent/improve novel data-driven paradigms for robotics, leveraging a variety of modalities (images, video, text, audio, tactile, etc)
  • Investigate paradigms that can deliver a spectrum of embodied behaviors - from simulated characters to real robots, and from short-horizon, low-level to long-horizon, high-level intelligence
  • Develop algorithms based on state-of-the-art machine learning and neural network methodologies
  • Define, build and benchmark new capabilities needed for the next generation of AI
  • Conduct research towards long-term research goals while identifying intermediate milestones
  • Lead, plan, and execute novel research based on long-term objectives of the organization
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

AI Research Scientist, Audio-Visual Understanding, FAIR

Meta is seeking a Research Scientist to join Fundamental AI Research (FAIR), a r...
Location
Location
United States , Menlo Park
Salary
Salary:
154000.00 - 217000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • A PhD in AI, computer science, data science, or related technical fields
  • Experience holding an industry, postdoctoral, faculty, or government researcher position
  • Research background in machine learning, artificial intelligence, computational statistics, or applied mathematics, or related areas
  • Research publications reflecting experience in theoretical or empirical research
  • Experience in developing and debugging in Python or similar programming languages
  • Experience in analyzing and collecting data from various sources
  • Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment
Job Responsibility
Job Responsibility
  • Develop joint audio-visual understanding systems that integrate visual and auditory signals for advanced perception
  • Build and evaluate audiovisual language models for social interactions and understanding, including predicting social intent, semantic function, and reasoning from human-centric inputs
  • Contribute to benchmarks and evaluation frameworks for visual social understanding and interactions
  • Train and optimize state-of-the-art machine learning and neural network methodologies
  • Conduct and collaborate on research projects within a globally-based team
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

AI Research Scientist - Speech and Language

Reality Labs Research is Meta’s innovation engine for next-generation AR/VR, AI,...
Location
Location
United States , Redmond
Salary
Salary:
184000.00 - 257000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Currently has or is in the process of obtaining a Ph.D. degree in Computer Science, Artificial Intelligence, Generative AI, or a relevant technical field
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
  • Demonstrated programming skills in Python and familiarity with large-scale distributed training
  • Familiarity to learn new programming languages quickly
  • Can design, implement, and evaluate RL algorithms in production or research settings
  • Problem-solving, communication, and collaboration skills
Job Responsibility
Job Responsibility
  • Design, implement, and optimize LLM-based agents for a variety of applications, leveraging the latest advances in generative AI
  • Apply reinforcement learning algorithms to improve LLM performance, safety, and alignment
  • Integrate models and orchestrations in production
  • Collaborate with cross-functional teams (research, engineering, product) to deploy and evaluate LLM agents in real-world scenarios
  • Analyze and interpret experimental results, iterate on model architectures, and drive continuous improvement
  • Contribute to the broader AI/ML community at Meta through knowledge sharing, code reviews, and technical mentorship
  • Lead and contribute to research and development of post-training methods, including RLHF (Reinforcement Learning from Human Feedback), reward modeling, and other feedback-based approaches
  • Apply AI Models to Speech Encoding, Decoding, and Synthesis problems
  • Develop Natural Language interaction systems
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

AI Research Scientist, Robotics

The ideal Research Scientist candidate will use their skills in system design an...
Location
Location
United States , Redmond
Salary
Salary:
154000.00 - 217000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Currently has or is in the process of obtaining a PhD degree in the field of Artificial Intelligence, Robotics, Computer Vision, Machine Learning, Language, a related field, or equivalent practical experience
  • Experience with any of the following research areas: robotics, motion planning, embodied AI, human-robot interaction, sim-to-real transfer, learning from demonstration, reinforcement learning, dexterous manipulation, digital agents, vision language models, computer vision, egocentric perception, and/or LLMs
  • Experience in relevant robotics related research areas, such as: VLM, robot learning, reinforcement learning, imitation learning, action-conditioned world models, task and motion planning, sim-to-real transfer robotic control, manipulation, navigation, or generally embodied AI
Job Responsibility
Job Responsibility
  • Perform fundamental and applied research to push the scientific and technological frontiers of embodied artificial intelligence
  • Invent/improve novel data-driven paradigms for robotics, leveraging a variety of modalities (images, video, text, audio, tactile, etc)
  • Investigate paradigms that can deliver a spectrum of embodied behaviors - from simulated characters to real robots, and from short-horizon, low-level to long-horizon, high-level intelligence
  • Develop algorithms based on state-of-the-art machine learning and neural network methodologies
  • Define, build and benchmark new functionalities needed for the next generation of AI
  • Conduct research towards long-term product goals while identifying intermediate milestones
  • Plan and execute novel research based on long-term objectives of the organization
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

AI Research Scientist, Robotics

At Meta, we’re building the future of human connection and the technology that e...
Location
Location
United States , Redmond
Salary
Salary:
219000.00 - 301000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • PhD degree in the field of Artificial Intelligence, Robotics, Computer Vision, Machine Learning, Language, a related field, or equivalent practical experience
  • Experience with any of the following research areas: robotics, motion planning, embodied AI, human-robot interaction, sim-to-real transfer, learning from demonstration, reinforcement learning, dexterous manipulation, digital agents, vision language models, computer vision, egocentric perception, and/or Large Language Models
  • 5+ years of industry experience in relevant robotics related research areas, such as: Vision Language Models robot learning, reinforcement learning, imitation learning, action-conditioned world models, task and motion planning, sim-to-real transfer robotic control, manipulation, navigation, or generally embodied AI
Job Responsibility
Job Responsibility
  • Perform fundamental and applied research to push the scientific and technological frontiers of embodied artificial intelligence
  • Invent/improve novel data-driven paradigms for robotics, leveraging a variety of modalities (images, video, text, audio, tactile, etc.)
  • Investigate paradigms that can deliver a spectrum of embodied behaviors - from simulated characters to real robots, and from short-horizon, low-level to long-horizon, high-level intelligence
  • Develop algorithms based on state-of-the-art machine learning and neural network methodologies
  • Define, build and benchmark new functionality needed for the next generation of AI
  • Conduct research towards long-term product goals while identifying intermediate milestones
  • Lead, plan, and execute novel research based on long-term objectives of the organization
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

Research Scientist Manager - ML Modeling & Applied Research

Reality Labs at Meta is seeking Research Scientist Manager with experience in ma...
Location
Location
United States , Burlingame
Salary
Salary:
184000.00 - 257000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience working autonomously to design, execute, interpret, and present ML research outcomes
  • 4+ years of experience as technical lead for a project of 4 or more individuals
  • 2+ years of direct management experience, managing Researchers or Engineers
  • Experience in the analysis and modeling of high dimensional time series, such as neural signals, multi-channel audio recordings, multi-modal/multi-sensor signals, robotic sensory signals, financial time series, video, or other sensor modalities
  • Experience bringing machine learning-based products from research to production
  • Experience with interdisciplinary and/or cross-functional collaboration
  • Experience with large scale cluster computing for machine learning modeling
  • Experience developing end-to-end ML pipelines, including: dataset preprocessing, model development and evaluation, and software integration
  • Experience in software engineering in industry
  • Must obtain work authorization in country of employment at the time of hire and maintain ongoing work authorization during employment
Job Responsibility
Job Responsibility
  • Build cutting-edge machine learning and signal processing models (event detection, sequence-to-sequence, signal separation, time series regression, etc.) to advance neuromotor interface capabilities
  • Collaborate with engineering and Human-Computer Interactions (HCI) teams to deploy models that leverage fundamental scientific knowledge into new technology and user experiences
  • Use quantitative research methods to define, iterate upon and advance key areas of our research agenda
  • Develop research-grade code for deployment in research prototypes. Work across organizational boundaries to solve our biggest problems
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

Ai Applied Scientist - Phd Intern, Next-Gen Agentic And Multi-Modal Home Exploration Experience

Are you passionate about creating AI agents capable of reasoning, planning, and ...
Location
Location
United States
Salary
Salary:
104000.00 - 166000.00 USD / Year
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently enrolled in a PhD program in computer science, NLP, machine learning, or a related field, with solid publication record
  • Background in at least one of the following areas: Human computer interaction (HCI)
  • User behavior research in the context of agentic AI
  • Agentic AI (tool use, planning, reasoning, decision-making)
  • Conversational AI and dialogue optimization
  • Multi-modal inference models with focus on combining 3D Computer Vision and LLMs
  • Multi-agent systems and orchestration
  • Memory systems and context engineering
  • Reinforcement learning and reward modeling
  • Familiarity with modern deep learning frameworks (e.g., PyTorch, Hugging Face Transformers)
Job Responsibility
Job Responsibility
  • Personalized and Guided Home Exploration: An agentic approach that proactively guides and helps users navigate millions of listings to identify the best homes, the experience should be highly engaging, fun and goal oriented
  • Conversational Optimization: Enhanced multi-turn conversations with effective context management and improved dialogue quality, achieved through organized data from retrieved results
  • Multi-modal Collaboration System: A combination of 3D computer vision (utilizing 3D reconstructions and Gaussian splats) and LLM interfaces, powered by conversational AI
  • Fulltime
Read More
Arrow Right