CrawlJobs Logo

Senior Applied Ai Engineer - Multimodal Transformers

United States, Mountain View Employment contract 200000.00 - 260000.00 USD / Year · Job Posted May 31, 2026
Apply Position
Job Link Share

Job Description

Kodiak Robotics, Inc. was founded in 2018 and has become a leader in autonomous ground transportation committed to a safer and more efficient future for all. The company has developed an artificial intelligence (AI) powered technology stack purpose-built for commercial trucking and the public sector. The company delivers freight daily for its customers across the southern United States using its autonomous technology. In 2024, Kodiak became the first known company to publicly announce delivering a driverless semi-truck to a customer. Kodiak is also leveraging its commercial self-driving software to develop, test and deploy autonomous capabilities for the U.S. Department of Defense. Kodiak's autonomy stack is built on AI that fuses diverse sensor streams into a unified, actionable understanding of the world. We are developing GigaFusionNet – a large-scale multimodal transformer that learns rich, joint representations across camera, LiDAR, and radar through attention-based fusion. We are looking for engineers to push the boundaries of how transformer architectures combine and reason over heterogeneous sensor data.This role is open to all levels – from those eager to contribute to cutting-edge research to experts driving innovation at scale.

Job Responsibility

  • Design and develop multimodal transformer architectures that fuse camera, LiDAR, and radar into unified representations
  • Research and implement cross-modal attention mechanisms, token fusion strategies, and efficient multi-stream tokenization
  • Build scalable training pipelines for large-scale multimodal transformers across massive real-world datasets
  • Explore self-supervised and contrastive pretraining objectives that learn transferable multimodal representations
  • Optimize transformer models for real-time inference under latency and compute constraints

Requirements

  • BS, MS, or PhD in AI, Computer Science, or a related field
  • 4+ years experience with transformer architectures, particularly in multimodal or multi-stream settings
  • Familiarity with cross-attention, token fusion, or modality alignment techniques
  • Proficiency in Python and deep learning frameworks like PyTorch or TensorFlow
  • Strong understanding of scalable training for large models, including distributed training and mixed-precision optimization
  • Passion for building AI that reasons over the full breadth of sensory input to operate safely in the real world

What we offer

  • Competitive compensation package including equity and annual bonuses
  • Excellent Medical, Dental, and Vision plans through Kaiser Permanente, Cigna, and MetLife (including a medical plan with infertility benefits)
  • MetLife Legal Services, Identity & Fraud Protection, Hospital Indemnity Insurance, Accident Insurance, & Critical Illness Insurance
  • Flexible PTO, 10 paid holidays, and generous parental leave policies
  • Office perks: dog-friendly, free catered lunch, a fully stocked kitchen, and free EV charging
  • Long Term Disability, Short Term Disability, Life Insurance
  • Wellbeing Benefits - Headspace through Cigna, Calm through Kaiser, One Medical, Gympass, Spring Health through Cigna, Rula (mental health navigation)
  • Fidelity 401(k)
  • Commuter, FSA, Dependent Care FSA, HSA
  • Various incentive programs (referral bonuses, patent bonuses, etc.)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Applied Ai Engineer - Multimodal Transformers

8 matching positions

Senior AI Engineer

This role will be tasked with applying machine learning/deep learning to the aut...
Location
Location
United States , Belmont
Salary
Salary:
170000.00 - 210000.00 USD / Year
https://www.volkswagen-group.com Logo
Volkswagen AG
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6-8 years of professional experience post graduate degree preferred
  • 4+ years' Deep Learning experience post graduate degree preferred
  • Master's Degree in Computer Science or equivalent
  • PhD Strongly Preferred
  • Strong knowledge of different machine learning algorithms
  • Proficiency in deep learning techniques and frameworks
  • Strong understanding of traditional machine learning algorithms and their applications
  • Expertise in computer vision, including object detection, image segmentation, and image recognition
  • Proficiency in NLP techniques, including sentiment analysis, text generation, and language understanding models
  • Experience with multimodal language modeling and applications
Job Responsibility
Job Responsibility
  • Applying machine learning/deep learning to the automotive industry
  • Maintaining and enhancing existing machine learning modules for autonomous vehicles
  • Designing and implementing new machine learning based approaches based on existing frameworks
  • Keeping up to speed with the state of the art of academic research and technology in the industry
  • Coordinating with engineers at the ICC and in Germany on the development of autonomous driving software
  • Transferring technologies and solutions to Volkswagen Group development divisions
  • Developing technical specifications and documentation
  • Representing Volkswagen Group in the technical community, such as at conferences
  • Fulltime
Read More
Arrow Right

Senior Machine Learning Engineer, Data for Embodied AI

The goal of this role is to build, scale, and optimise next-generation world mod...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
wayve.ai Logo
Wayve
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in ML engineering, data engineering, or applied ML roles focused on large-scale data systems
  • Proven experience building and maintaining large-scale data pipelines for machine learning, including data ingestion, transformation, and validation
  • Strong Python fundamentals and experience with modern ML and data frameworks (e.g. PyTorch, Ray, Dask, Spark, or equivalent)
  • Solid understanding of multimodal data (video, lidar, sensor telemetry) and its challenges in large-scale training
  • Experience defining and tracking data quality metrics, conducting dataset analysis, and driving data-informed improvements in model performance
  • Demonstrated ability to work collaboratively with ML researchers, platform engineers, and product teams in a fast-paced, experimental environment
  • Strong problem-solving skills, a data-driven mindset, and the ability to translate research needs into reliable data solutions
Job Responsibility
Job Responsibility
  • Design and implement large-scale data acquisition, processing, and curation pipelines, owning the full lifecycle of high-quality datasets used to train advanced robotics and foundation models
  • Continuously improve dataset quality and utility through sophisticated data analysis, debugging, and experimentation
  • developing metrics, tests, and monitoring mechanisms that directly drive model performance improvements
  • Develop and scale multimodal data pipelines for ingestion, preprocessing, filtering, annotation, and storage across video, LiDAR, and telemetry modalities
  • Run systematic experiments on data ablations and composition to assess their impact on model training dynamics, generalisation, and downstream performance
  • Collaborate with ML researchers and platform engineers to ensure datasets are fit for purpose and efficiently integrated into large-scale training workflows
  • Build internal tools and workflows for dataset auditing, visualization, and versioning to streamline iteration and reproducibility
  • Advance best practices for data governance, reliability, and scalability across the data lifecycle
  • ensuring data safety, privacy, and long-term maintainability
Read More
Arrow Right

Senior Machine Learning Engineer, Data for Embodied AI

The goal of this role is to build, scale, and optimise next-generation world mod...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
wayve.ai Logo
Wayve
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in ML engineering, data engineering, or applied ML roles focused on large-scale data systems
  • Proven experience building and maintaining large-scale data pipelines for machine learning, including data ingestion, transformation, and validation
  • Strong Python fundamentals and experience with modern ML and data frameworks (e.g. PyTorch, Ray, Dask, Spark, or equivalent)
  • Solid understanding of multimodal data (video, lidar, sensor telemetry) and its challenges in large-scale training
  • Experience defining and tracking data quality metrics, conducting dataset analysis, and driving data-informed improvements in model performance
  • Demonstrated ability to work collaboratively with ML researchers, platform engineers, and product teams in a fast-paced, experimental environment
  • Strong problem-solving skills, a data-driven mindset, and the ability to translate research needs into reliable data solutions
Job Responsibility
Job Responsibility
  • Design and implement large-scale data acquisition, processing, and curation pipelines, owning the full lifecycle of high-quality datasets used to train advanced robotics and foundation models
  • Continuously improve dataset quality and utility through sophisticated data analysis, debugging, and experimentation
  • developing metrics, tests, and monitoring mechanisms that directly drive model performance improvements
  • Develop and scale multimodal data pipelines for ingestion, preprocessing, filtering, annotation, and storage across video, LiDAR, and telemetry modalities
  • Run systematic experiments on data ablations and composition to assess their impact on model training dynamics, generalisation, and downstream performance
  • Collaborate with ML researchers and platform engineers to ensure datasets are fit for purpose and efficiently integrated into large-scale training workflows
  • Build internal tools and workflows for dataset auditing, visualization, and versioning to streamline iteration and reproducibility
  • Advance best practices for data governance, reliability, and scalability across the data lifecycle
  • ensuring data safety, privacy, and long-term maintainability
Read More
Arrow Right

Senior AI Engineer (ML/DL)

This role will be tasked with applying machine learning/deep learning to the aut...
Location
Location
United States , Belmont
Salary
Salary:
170000.00 - 210000.00 USD / Year
https://www.volkswagen-group.com Logo
Volkswagen AG
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6-8 years of professional experience post graduate degree PREFERRED
  • 4+ years’ Deep Learning experience post graduate degree PREFERRED
  • Master’s Degree in Computer Science or equivalent
  • Proficiency in deep learning techniques and frameworks
  • Strong understanding of traditional machine learning algorithms and their applications
  • Expertise in computer vision, including object detection, image segmentation, and image recognition
  • Proficiency in NLP techniques, including sentiment analysis, text generation, and language understanding models
  • Experience with multimodal language modeling and applications
  • Deep understanding of various neural network architectures such as CNNs, RNNs, and Transformers
  • Familiarity with reinforcement learning algorithms and their applications in AI
Job Responsibility
Job Responsibility
  • Applying machine learning/deep learning to the automotive industry
  • Applications could include autonomous driving, manufacturing, design etc
  • Integrating the modules you build into real cars
  • Thinking about questions around testability and proving safety
  • Maintaining, as well as furthers, enhances existing machine learning modules for autonomous vehicles
  • Designing and implementing new machine learning based approaches based on existing frameworks
  • Keeping up to speed with the state of the art of academic research and technology in the industry
  • Coordinating with engineers at the ICC and in Germany on the development of autonomous driving software
  • Transferring technologies and solutions to Volkswagen Group development divisions
  • Developing technical specifications and documentation
What we offer
What we offer
  • Eligibility for annual performance bonus
  • Healthcare benefits
  • 401(k), with company match
  • Defined contribution retirement program
  • Tuition reimbursement
  • Company lease car program
  • Paid time off
  • Fulltime
Read More
Arrow Right

Software & Data Engineer Intern

Join Entalpic's Platform team and contribute to the core software foundations of...
Location
Location
France , Paris
Salary
Salary:
Not provided
breega.com Logo
Breega
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently pursuing or recently completed a Bachelor’s or Master’s degree in Computer Science, Data Engineering, Software Engineering, or a related field
  • Strong interest in data engineering, data systems, and infrastructure for machine learning or scientific applications
  • Proficiency in Python and familiarity with at least one other programming language is a plus
  • Foundational knowledge of SQL and relational databases, with curiosity about NoSQL systems
  • Understanding of core data concepts such as ETL, data modeling, and data pipelines
  • Must be comfortable working in English in a technical environment
  • Motivated, curious, and eager to learn in a fast-paced startup setting
Job Responsibility
Job Responsibility
  • Data Engineering Implementation: Help build and maintain data pipelines that process and integrate multimodal data including simulation results, scientific text, and experimental measurements
  • Data Storage and Organization: Contribute to the implementation and organization of data storage solutions, ensuring data is well-structured, accessible, and documented
  • Automation and Tooling: Write scripts to automate data ingestion, cleaning, and transformation tasks under the guidance of senior engineers
  • Data Visualization and Analytics: Support the creation of basic data visualizations and analytical dashboards to help teams explore datasets, monitor data quality, and gain insights from experimental, simulation, and textual data
  • Applied ML Research: Prototype end-to-end pipelines using state-of-the-art LLMs for chemical entity extraction and explore ranking methods to improve data quality and retrieval for downstream AI systems
  • Data Quality and Documentation: Assist with data validation, basic lineage tracking, and documentation to improve data reliability and reproducibility
  • Infrastructure Collaboration: Work with data engineers, data scientists, and DevOps to understand how data systems are deployed and scaled on cloud platforms such as AWS or GCP
  • Cross-team Collaboration: Interact with scientists and engineers to understand data needs and help translate them into practical data solutions
What we offer
What we offer
  • Competitive salary + full reimbursement of your transport card
  • Flexible work environment: Remote-Friendly with a minimum of 3 days in Paris offices per week (Station F)
  • 1 paid day off per month
  • Professional development opportunities: access to conferences and internal learning sessions
  • Fulltime
Read More
Arrow Right

Senior Engineer, Machine Learning Engineering

Mastercard’s Business & Market Insights (B&MI) group empowers organizations to a...
Location
Location
India , Pune
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s/bachelor’s degree in computer science or engineering
  • Considerable work experience with a proven track-record of successfully leading and managing complex projects/products and delivering to aggressive market needs
  • Expert-level hands on experience designing, building and deploying both conventional AI/ML solutions and LLM/Agentic solutions
  • Strong analytical and problem-solving abilities, with quick adaptation to new technologies, methodologies, and systems
  • Strong applied knowledge and hands on experience in advanced statistical techniques, predictive modelling, machine learning algorithms, GenAI and deep learning frameworks
  • Experience with AI and machine learning platforms such as TensorFlow, PyTorch, or similar
  • Strong programming skills in languages such as Python/SQL is a must
  • Experience with data visualization tools (e.g., Tableau, Power BI) and understanding of cloud computing services (AWS, Azure, GCP) related to data processing and storage is a plus
Job Responsibility
Job Responsibility
  • Implement multi-agent intelligence frameworks (LangGraph, CrewAI, AutoGen) to enable reasoning, coordination, and adaptive decision-making across specialized AI agents
  • Design and operationalize multi-modal AI pipelines combining text, image, tabular, and graph data using transformer-based architectures (BERT, CLIP, LLaVA, T5, Whisper, etc.) for unified intelligence
  • Build scalable RAG and Graph-RAG systems integrating vector stores and knowledge graphs (Neo4j, AWS Neptune) to enable contextual retrieval, semantic linking, and entity-aware reasoning
  • Develop and productionize transformer-based models for NLP, vision-language understanding, and sequential prediction tasks leveraging Hugging Face, PyTorch, and TensorFlow ecosystems
  • Implement advanced Python-based backend services for inference orchestration, async job handling, and distributed data workflows supporting high-throughput AI operations
  • Establish end-to-end LLMOps and MLOps pipelines on Databricks (AWS) integrating MLflow, feature stores, model lineage, prompt evaluation, and continuous retraining frameworks
  • Apply traditional AI/ML and statistical modeling techniques (regression, clustering, forecasting, ensemble methods) alongside deep learning models for hybrid interpretability and explainability
  • Engineer state and memory management subsystems that preserve context, track embeddings, and enable agents to reason temporally across multiple modalities and interactions
  • Implement Responsible AI practices—bias detection, explainability dashboards, data ethics checks, and performance governance ensuring fairness and transparency of deployed models
  • Continuously research, benchmark, and productionize innovations in multimodal transformers, generative modeling, and agentic orchestration to drive enterprise-scale intelligence and automation
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

Windows Agents and Growth Innovations (WinAGI) is pioneering next-generation AI-...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 7+ years technical engineering experience with coding in languages on C or C++
  • Hands-on experience with AI-assisted development tools such as GitHub Copilot, Copilot Studio, AI Foundry, or similar
  • Proven expertise in full-stack development, with emphasis on client-side application engineering and user-facing experiences
  • Deep knowledge of interaction models and multimodal interfaces (inking, stylus, voice, touch, sensors, haptics, gestures, etc.)
Job Responsibility
Job Responsibility
  • Design and deliver high-quality software components aligned to WinAGI’s vision of AI-driven Windows experiences and growth innovations
  • Work across the stack — from user interface to backend services — with a strong bias for impact and rapid iteration
  • Apply data-driven engineering practices to inform design decisions, validate hypotheses, and optimize performance through telemetry and measurable outcomes
  • Leverage modern development practices and AI-assisted tools to accelerate coding, reduce boilerplate, and enable intelligent test automation
  • Collaborate closely with product, design, and partner teams to shape priorities and deliver intuitive, high-value user experiences
  • Transform loosely defined ideas into tangible outcomes, navigating evolving priorities with creativity and technical rigor
  • Contribute to architecture discussions, code reviews, and prototyping efforts to ensure scalability and maintainability
  • Foster a culture of agility, experimentation, and outcome-driven development within the Windows ecosystem
  • Fulltime
Read More
Arrow Right

Senior Researcher - Foundations of Generative AI

Microsoft Research AI Frontiers lab is seeking applications for the position of ...
Location
Location
United States , New York
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Doctorate (or currently pursuing) in Computer Science or relevant field OR equivalent experience
  • Doctorate in Computer Science or relevant field AND 2+ years related research experience OR equivalent experience
  • Research program demonstrated by public artifacts like models, tools, code in the AI space or publications at conferences: NeurIPS, ICML, ICLR, ACL, NAACL, CVPR, COLT, ECCV, ICCV, EMNLP
  • 2+ years of academic or industry experience in developing, applying, and/or implementing algorithms for machine learning/statistics, using common ML engineering programming languages and platforms such as Python, Python numerical libraries, PyTorch, TensorFlow and/or HuggingFace
  • Experience publishing academic papers as a lead author or essential contributor in a top AI conference or journal
  • Deep understanding of frontier model architectures, especially transformers and state space models
  • Hands-on experience building and working with Large Language Models (LLMs) or multimodal models (VLMs, VLAs), including pre-training, fine-tuning, and inference
  • 2+ years of industry or academic experience with building, debugging and optimizing large-scale ML training pipelines
  • Demonstrated software engineering excellence building and deploying prototypes, applications, or open-source (OSS) technologies
  • Ability to work independently and ramp-up quickly on complex projects or unfamiliar code
Job Responsibility
Job Responsibility
  • Apply research and engineering skills to develop, prototype, and evaluate cutting-edge research ideas
  • Work closely with other researchers and engineers to rapidly prototype and test new research ideas, driving a high-impact agenda and publishing results where appropriate
  • Collaborate hands-on with other researchers, engineers, and internal and external product groups to deliver high-impact solutions to real-world problems
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right