CrawlJobs Logo

Scientist / Senior Scientist, Multimodal AI

altoslabs.com Logo

Altos Labs

Location Icon

Location:
United States , San Francisco Bay Area, CA

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

188600.00 - 330000.00 USD / Year

Job Description:

Altos Labs is building a world-class AI ecosystem to solve the most complex problems in human biology. You will directly design and build high-performance, scalable solutions that unify high-dimensional biomedical imaging with molecular and language data. By implementing large-scale multimodal data fusion, you will move beyond simple image analysis to create predictive models that map across biological domains. You will be hands-on with the data and the code, collaborating with our engineering team to ensure these models are scalable, efficiently trainable on distributed cloud infrastructure, and accessible to our global research community.

Job Responsibility:

  • Model Development: Design, code, and train large-scale foundation models (e.g., Vision Transformers, Multimodal LLMs) that can embed spatial data and integrate multiple modalities
  • Hands-on Data Fusion: Implement innovative cross-domain mapping and fusion strategies to synchronize heterogeneous biological datasets
  • Scaling & Training: Build and manage high-performance ML pipelines capable of processing petabyte-scale image repositories and multi-omics streams in a cloud environment
  • Technical Collaboration: Work directly in the trenches with experimental scientists and software engineers to translate biological complexity into performant code and reliable distributed systems

Requirements:

  • PhD in Computer Science, AI/ML, Biomedical Engineering, or a related quantitative field
  • Deep experience building and deploying modern Computer Vision architectures (Vision Transformers, U-Nets, Self-Supervised Learning)
  • Proven experience training and fine-tuning large models at scale using frameworks like PyTorch Distributed, DeepSpeed, or Jax
  • Expert-level Python skills, with a focus on building production-ready machine learning code and large-scale data management systems
  • A track record of technical contributions via high-impact publications (CVPR, ICCV, NeurIPS, etc.) or significant contributions to open-source ML frameworks

Nice to have:

  • Direct experience with Multimodal Fusion (e.g., aligning image embeddings with transcriptomic or proteomic data)
  • Proficiency with cloud-native AI tools (AWS/GCP, Kubernetes, Docker) and building automated MLOps workflows
  • Experience handling the unique noise and sparsity of biological data

Additional Information:

Job Posted:
February 16, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Scientist / Senior Scientist, Multimodal AI

Senior Data Scientist

We are seeking a Senior Data Scientist with deep expertise in unstructured data ...
Location
Location
Taiwan
Salary
Salary:
Not provided
beyond.ai Logo
Beyond Limits
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience in AI, Machine Learning, and Data Science, with a strong focus on production-scale AI
  • Expertise in LLMs, including fine-tuning, distributed training, quantization, and pruning techniques
  • Experience working with OCR, ASR, and TTS applications in real-world deployments
  • Proven experience deploying AI models in production, with real-world examples of scaled AI applications
  • Strong understanding of cloud computing, containerization (Docker, Kubernetes), and ML Ops best practices
  • Proficiency in Python, PyTorch, and ML libraries
  • Hands-on experience with vector databases and retrieval-augmented generation (RAG) architectures
  • Strong awareness of AI system performance benchmarks (latency, speed, throughput) and ability to optimize models accordingly
  • Experience working with AI agents, designing real-world intelligent automation solutions beyond just open-source experimentation
  • Proficiency in transformer-based architectures (BERT, GPT, LLaMA, Whisper, etc.), including pre-training, fine-tuning, and task-specific adaptation
Job Responsibility
Job Responsibility
  • Develop and deploy AI models for unstructured data (text, speech, audio, images) with a focus on enterprise-scale performance
  • Fine-tune, optimize, and deploy LLMs and multimodal models, integrating distributed training, quantization, and pruning techniques for efficiency
  • Design and implement production-ready AI solutions, ensuring scalability, low-latency inference, and high throughput
  • Work with AI agents and automation frameworks to create intelligent, real-world AI applications for enterprise clients
  • Build and maintain end-to-end LLM Ops pipelines, ensuring efficient training, deployment, monitoring, and model updates
  • Implement vector search and retrieval-augmented generation (RAG) systems for large-scale data solutions
  • Monitor AI performance using key metrics such as speed, latency, and throughput, continuously refining models for real-world efficiency
  • Work with cloud-based AI infrastructure (AWS, GCP) and containerized environments (Docker, Kubernetes) to scale AI solutions
  • Collaborate with engineering, DevOps, and product teams to align AI solutions with business needs and client requirements
  • Implement data curation pipelines, including data collection, cleaning, deduplication, decontamination, etc. for training high-quality AI models
Read More
Arrow Right

Senior Data Scientist

We are seeking a Senior Data Scientist with deep expertise in unstructured data ...
Location
Location
Salary
Salary:
Not provided
beyond.ai Logo
Beyond Limits
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience in AI, Machine Learning, and Data Science, with a strong focus on production-scale AI
  • Expertise in LLMs, including fine-tuning, distributed training, quantization, and pruning techniques
  • Experience working with OCR, ASR, and TTS applications in real-world deployments
  • Proven experience deploying AI models in production, with real-world examples of scaled AI applications
  • Strong understanding of cloud computing, containerization (Docker, Kubernetes), and ML Ops best practices
  • Proficiency in Python, PyTorch, and ML libraries
  • Hands-on experience with vector databases and retrieval-augmented generation (RAG) architectures
  • Strong awareness of AI system performance benchmarks (latency, speed, throughput) and ability to optimize models accordingly
  • Experience working with AI agents, designing real-world intelligent automation solutions beyond just open-source experimentation
  • Proficiency in transformer-based architectures (BERT, GPT, LLaMA, Whisper, etc.), including pre-training, fine-tuning, and task-specific adaptation
Job Responsibility
Job Responsibility
  • Develop and deploy AI models for unstructured data (text, speech, audio, images) with a focus on enterprise-scale performance
  • Fine-tune, optimize, and deploy LLMs and multimodal models, integrating distributed training, quantization, and pruning techniques for efficiency
  • Design and implement production-ready AI solutions, ensuring scalability, low-latency inference, and high throughput
  • Work with AI agents and automation frameworks to create intelligent, real-world AI applications for enterprise clients
  • Build and maintain end-to-end LLM Ops pipelines, ensuring efficient training, deployment, monitoring, and model updates
  • Implement vector search and retrieval-augmented generation (RAG) systems for large-scale data solutions
  • Monitor AI performance using key metrics such as speed, latency, and throughput, continuously refining models for real-world efficiency
  • Work with cloud-based AI infrastructure (AWS, GCP) and containerized environments (Docker, Kubernetes) to scale AI solutions
  • Collaborate with engineering, DevOps, and product teams to align AI solutions with business needs and client requirements
  • Implement data curation pipelines, including data collection, cleaning, deduplication, decontamination, etc. for training high-quality AI models
Read More
Arrow Right

Senior Computer Vision and Machine Learning Research Scientist

We are seeking a skilled and innovative Senior Research Scientist to join one of...
Location
Location
United States , Seattle
Salary
Salary:
159750.00 - 234300.00 USD / Year
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD and 3+ years experience in Computer Science or a related field with a focus on computer vision, machine learning, artificial intelligence or related technical fields
  • Proven track record of research in machine learning, computer vision or related fields
  • Experience driving the ML development lifecycle and leveraging state-of-the-art research to deliver high quality models at scale
  • Strong computer vision fundamentals such as image processing, feature extractions, object detection, semantic segmentation, video analysis or action recognition
  • Excellent problem-solving skills, analytical thinking, and the ability to work independently as well as collaboratively in a team environment
  • Proficiency in Python and frameworks such as PyTorch, TensorFlow or Keras
  • Strong communication skills and the ability to effectively present complex technical concepts to both technical and non-technical audiences
Job Responsibility
Job Responsibility
  • Collaborate with other scientists, engineers and product managers to build proof-of-concepts to shape the Axon of tomorrow
  • Lead end-to-end research efforts in advanced computer vision, machine learning and gen-AI techniques for cloud and devices from multimodal data sources, including scene understanding, action recognition and anomaly detection
  • Design and implement responsible, privacy-preserving, efficient and scalable models for inference and analysis of visual data
  • Develop performance and quality metrics for CVML models and systems, and validate their effectiveness in real-world settings
  • Optimize algorithms for performance, memory footprint, and energy efficiency to meet the requirements of resource-constrained devices
  • Stay up-to-date with the latest research and advances in CVML and translate relevant findings into shipping Axon products
  • Contribute to academic publications, technical documentation, and patent disclosures to share insights and findings with the broader community
  • Coach and mentor junior scientists
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Snacks in our offices
  • Fulltime
Read More
Arrow Right

Senior Computer Vision and Machine Learning Research Scientist

Join Axon and be a Force for Good. At Axon, we’re on a mission to Protect Life. ...
Location
Location
United States , Seattle
Salary
Salary:
159750.00 - 234300.00 USD / Year
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD and 3+ years experience in Computer Science or a related field with a focus on computer vision, machine learning, artificial intelligence or related technical fields
  • Proven track record of research in machine learning, computer vision or related fields
  • Experience driving the ML development lifecycle and leveraging state-of-the-art research to deliver high quality models at scale
  • Strong computer vision fundamentals such as image processing, feature extractions, object detection, semantic segmentation, video analysis or action recognition
  • Excellent problem-solving skills, analytical thinking, and the ability to work independently as well as collaboratively in a team environment
  • Proficiency in Python and frameworks such as PyTorch, TensorFlow or Keras
  • Strong communication skills and the ability to effectively present complex technical concepts to both technical and non-technical audiences
Job Responsibility
Job Responsibility
  • Collaborate with other scientists, engineers and product managers to build proof-of-concepts to shape the Axon of tomorrow
  • Lead end-to-end research efforts in advanced computer vision, machine learning and gen-AI techniques for cloud and devices from multimodal data sources, including scene understanding, action recognition and anomaly detection
  • Design and implement responsible, privacy-preserving, efficient and scalable models for inference and analysis of visual data
  • Develop performance and quality metrics for CVML models and systems, and validate their effectiveness in real-world settings
  • Optimize algorithms for performance, memory footprint, and energy efficiency to meet the requirements of resource-constrained devices
  • Stay up-to-date with the latest research and advances in CVML and translate relevant findings into shipping Axon products
  • Contribute to academic publications, technical documentation, and patent disclosures to share insights and findings with the broader community
  • Coach and mentor junior scientists
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Snacks in our offices
  • Fulltime
Read More
Arrow Right
New

Senior AI Research Scientist

Join Axon and be a Force for Good. At Axon, we’re on a mission to Protect Life. ...
Location
Location
Belgium , Brussels
Salary
Salary:
Not provided
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD in Computer Science or a related field with a focus on LLM, MLLMs, Computer Vision, GenAI
  • +5 years for ML Scientist, +8 years for Sr. ML Scientist, +10 years for Principal ML Scientist experience
  • Proven track record of research excellence demonstrated through publications in top-tier conferences or journals
  • Strong proficiency in programming languages such as Python, C/C++
  • Experience with deep learning frameworks such as TensorFlow, PyTorch, or Keras
  • Experience with ROS or robotic operational system
  • Drive one or more phases of the ML development lifecycle
  • Leverage state-of-the-art research to deliver high quality models at scale
  • Contribute back to the research community via publications, blogs, open-source
  • Experience in developing computer vision algorithms for resource-constrained devices is highly desirable
Job Responsibility
Job Responsibility
  • Own one or more key technical areas across LLM, MLLM, CV product portfolio
  • Provide technical leadership to junior scientists
  • Research and develop cutting-edge techniques in LLM, MLLMs, GenAI, and Computer Vision
  • Design and implement efficient and scalable MLLM models for inference and analysis of multimodal data
  • Explore novel approaches to address challenges in NLP, NLU, Object Detection, Object Recognition, Object Tracking, Segmentation, and Scene Understanding
  • Optimize AI models, algorithms for performance, memory footprint, and energy efficiency
  • Join force with MLEs or firmware or hardware engineers to leverage hardware accelerators
  • Evaluate the performance of LLM, MLLM, CV models using real-world datasets
  • Stay up-to-date with the latest research trends and advancements
  • Contribute to patent disclosures, academic publications, and technical documentation
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Snacks in our offices
  • Fulltime
Read More
Arrow Right
New

Senior AI Research Scientist

Join Axon and be a Force for Good. At Axon, we’re on a mission to Protect Life. ...
Location
Location
Finland , Tampere
Salary
Salary:
Not provided
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD in Computer Science or a related field with a focus on LLM, MLLMs, Computer Vision, GenAI
  • +5 years for ML Scientist, +8 years for Sr. ML Scientist, +10 years for Principal ML Scientist experience
  • Proven track record of research excellence in LLM, MLLM, Computer Vision, Robotics Perception, GenAI, demonstrated through publications in top-tier conferences or journals
  • Strong proficiency in programming languages such as Python, C/C++
  • Experience with deep learning frameworks such as TensorFlow, PyTorch, or Keras
  • Experience with ROS or robotic operational system
  • Drive one or more phases of the ML development lifecycle: shape datasets, investigate modeling approaches and architectures, train/evaluate/tune models and implement the end-to-end training pipeline
  • Leverage state-of-the-art research to deliver high quality models enabling multiple AI projects at scale
  • Contribute back to the research community via academic publications, tech blogs, open-source code and contributing to internal/external AI challenges
  • Experience in developing computer vision algorithms for resource-constrained devices such as mobile phones, IoT devices, or embedded systems is highly desirable
Job Responsibility
Job Responsibility
  • Own one or more key technical areas across LLM, MLLM, CV product portfolio
  • Provide technical leadership to junior scientists, guiding the transition of R&D concepts into impactful Axon product feature
  • Research and develop cutting-edge techniques in LLM, MLLMs, GenAI, and Computer Vision across cloud, devices and sensors based data sources
  • Design and implement efficient and scalable MLLM models for inference and analysis of multimodal data
  • Explore novel approaches to address challenges in NLP, NLU, Object Detection, Object Recognition, Object Tracking, Segmentation, and Scene Understanding
  • Optimize AI models, algorithms for performance, memory footprint, and energy efficiency to meet the requirements of resource-constrained devices
  • Join force with MLEs or firmware or hardware engineers to leverage hardware accelerators and optimize algorithms for specific hardware architectures
  • Evaluate the performance of LLM, MLLM, CV models using real-world datasets and design experiments to validate their effectiveness
  • Stay up-to-date with the latest research trends and advancements in computer vision, machine learning, and deep learning, MLLMs, GenAI and integrate relevant findings into our projects
  • Contribute to patent disclosures, academic publications, and technical documentation to share insights and findings with the broader community
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Snacks in our offices
  • Fulltime
Read More
Arrow Right
New

Senior AI Research Scientist

We are seeking highly skilled and innovative Machine Learning Scientists to join...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD in Computer Science or a related field with a focus on LLM, MLLMs, Computer Vision, GenAI
  • +5 years for ML Scientist, +8 years for Sr. ML Scientist, +10 years for Principal ML Scientist experience
  • Proven track record of research excellence demonstrated through publications in top-tier conferences or journals
  • Strong proficiency in programming languages such as Python, C/C++
  • Experience with deep learning frameworks such as TensorFlow, PyTorch, or Keras
  • Experience with ROS or robotic operational system
  • Drive one or more phases of the ML development lifecycle: shape datasets, investigate modeling approaches and architectures, train/evaluate/tune models and implement the end-to-end training pipeline
  • Leverage state-of-the-art research to deliver high quality models enabling multiple AI projects at scale
  • Contribute back to the research community via academic publications, tech blogs, open-source code and contributing to internal/external AI challenges
  • Experience in developing computer vision algorithms for resource-constrained devices such as mobile phones, IoT devices, or embedded systems is highly desirable
Job Responsibility
Job Responsibility
  • Own one or more key technical areas across LLM, MLLM, CV product portfolio
  • Provide technical leadership to junior scientists, guiding the transition of R&D concepts into impactful Axon product feature
  • Research and develop cutting-edge techniques in LLM, MLLMs, GenAI, and Computer Vision across cloud, devices and sensors based data sources
  • Design and implement efficient and scalable MLLM models for inference and analysis of multimodal data
  • Explore novel approaches to address challenges in NLP, NLU, Object Detection, Object Recognition, Object Tracking, Segmentation, and Scene Understanding
  • Optimize AI models, algorithms for performance, memory footprint, and energy efficiency to meet the requirements of resource-constrained devices
  • Join force with MLEs or firmware or hardware engineers to leverage hardware accelerators and optimize algorithms for specific hardware architectures
  • Evaluate the performance of LLM, MLLM, CV models using real-world datasets and design experiments to validate their effectiveness
  • Stay up-to-date with the latest research trends and advancements in computer vision, machine learning, and deep learning, MLLMs, GenAI and integrate relevant findings into our projects
  • Contribute to patent disclosures, academic publications, and technical documentation to share insights and findings with the broader community
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Snacks in our offices
  • Fulltime
Read More
Arrow Right
New

Senior Machine Learning Scientist, Multimodal & Relational Foundation Models

As part of our team, you will help to accelerate and optimize our progress in de...
Location
Location
United States , Redwood City; San Diego
Salary
Salary:
251700.00 - 330000.00 USD / Year
altoslabs.com Logo
Altos Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD in Computer Science, Machine Learning, or a similar quantitative field with 5+ years of relevant work experience in academic or industry settings
  • Prior experience in developing and implementing novel generative AI models, specifically in multimodal integration, GraphRAG, or relational deep learning
  • Deep understanding of Machine Learning principles and how they apply to diverse architectures like Transformers, GNNs, and diffusion models
  • Very strong programming skills in Python and deep learning libraries (e.g., PyTorch, JAX, Hugging Face Transformers/Accelerate)
  • Proven experience with multi-GPU and distributed training at scale (e.g., DDP, FSDP, DeepSpeed, Megatron, or Ray)
  • Strong track record of published, peer-reviewed innovative AI/ML research at top-tier conferences (NeurIPS, ICML, ICLR, CVPR)
Job Responsibility
Job Responsibility
  • Pre-train and fine-tune large-scale machine learning systems using multimodal biological data, natural language, and structured relational inputs
  • Architect and implement novel hybrid models that integrate Large Language Models (LLMs) with Graph Neural Networks (GNNs) for multi-hop reasoning over biological knowledge graphs
  • Develop Relational Foundation Models (RFMs) that enable zero-shot predictive tasks over heterogeneous, multi-table biological datasets
  • Lead the design of efficient data loading strategies and distributed training recipes (e.g., FSDP, DeepSpeed) to train models across multiple GPU nodes
  • Gain insights into model performance based on theory, deep research, and the mathematical underpinnings of set-invariant and graph-structured architectures
  • Apply strong coding experience to model development and deployment, ensuring research prototypes transition into reliable, scalable production systems
  • Stay up-to-date on the latest developments in deep learning—including native early-fusion and Mixture-of-Experts (MoE) architectures—and apply this knowledge to Altos' research
  • Mentor junior staff while maintaining a high individual technical contribution to the core research ecosystem and peer-reviewed publications
  • Fulltime
Read More
Arrow Right