CrawlJobs Logo

Senior Applied Ai Engineer - Multimodal Transformers

United States, Mountain View Employment contract 200000.00 - 260000.00 USD / Year · Job Posted May 31, 2026
Apply Position
Job Link Share

Job Description

Kodiak Robotics, Inc. was founded in 2018 and has become a leader in autonomous ground transportation committed to a safer and more efficient future for all. The company has developed an artificial intelligence (AI) powered technology stack purpose-built for commercial trucking and the public sector. The company delivers freight daily for its customers across the southern United States using its autonomous technology. In 2024, Kodiak became the first known company to publicly announce delivering a driverless semi-truck to a customer. Kodiak is also leveraging its commercial self-driving software to develop, test and deploy autonomous capabilities for the U.S. Department of Defense. Kodiak's autonomy stack is built on AI that fuses diverse sensor streams into a unified, actionable understanding of the world. We are developing GigaFusionNet – a large-scale multimodal transformer that learns rich, joint representations across camera, LiDAR, and radar through attention-based fusion. We are looking for engineers to push the boundaries of how transformer architectures combine and reason over heterogeneous sensor data.This role is open to all levels – from those eager to contribute to cutting-edge research to experts driving innovation at scale.

Job Responsibility

  • Design and develop multimodal transformer architectures that fuse camera, LiDAR, and radar into unified representations
  • Research and implement cross-modal attention mechanisms, token fusion strategies, and efficient multi-stream tokenization
  • Build scalable training pipelines for large-scale multimodal transformers across massive real-world datasets
  • Explore self-supervised and contrastive pretraining objectives that learn transferable multimodal representations
  • Optimize transformer models for real-time inference under latency and compute constraints

Requirements

  • BS, MS, or PhD in AI, Computer Science, or a related field
  • 4+ years experience with transformer architectures, particularly in multimodal or multi-stream settings
  • Familiarity with cross-attention, token fusion, or modality alignment techniques
  • Proficiency in Python and deep learning frameworks like PyTorch or TensorFlow
  • Strong understanding of scalable training for large models, including distributed training and mixed-precision optimization
  • Passion for building AI that reasons over the full breadth of sensory input to operate safely in the real world

What we offer

  • Competitive compensation package including equity and annual bonuses
  • Excellent Medical, Dental, and Vision plans through Kaiser Permanente, Cigna, and MetLife (including a medical plan with infertility benefits)
  • MetLife Legal Services, Identity & Fraud Protection, Hospital Indemnity Insurance, Accident Insurance, & Critical Illness Insurance
  • Flexible PTO, 10 paid holidays, and generous parental leave policies
  • Office perks: dog-friendly, free catered lunch, a fully stocked kitchen, and free EV charging
  • Long Term Disability, Short Term Disability, Life Insurance
  • Wellbeing Benefits - Headspace through Cigna, Calm through Kaiser, One Medical, Gympass, Spring Health through Cigna, Rula (mental health navigation)
  • Fidelity 401(k)
  • Commuter, FSA, Dependent Care FSA, HSA
  • Various incentive programs (referral bonuses, patent bonuses, etc.)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Applied Ai Engineer - Multimodal Transformers

8 matching positions

Senior Applied Scientist

Frontier Tuning is Microsoft’s AI customization platform that enables enterprise...
Location
Location
United Kingdom , Multiple Locations
Salary
Salary:
74700.00 - 122600.00 GBP / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND advanced related experience (e.g., statistics predictive analytics, research)
  • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND solid related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND some related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience
  • Experience contributing to research, open‑source systems, or production deployments involving model training or adaptation
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND extensive related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND advanced related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience
Job Responsibility
Job Responsibility
  • Design and develop methods to adapt foundation models (e.g., language, diffusion, or multimodal models) for enterprise‑specific tasks such as document understanding, workflow automation, or content generation
  • Contribute to one or more aspects of the post-training stack, including: Reinforcement learning or fine-tuning methods
  • Architectural or parameter‑efficient adaptation techniques
  • Inference‑time steering or controllability approaches
  • Tooling for evaluation, debugging, or model development
  • Privacy- or security‑preserving training techniques (e.g., differential privacy)
  • Harnesses
  • Implement and evaluate adaptation approaches under real‑world enterprise deployment constraints such as latency, safety, privacy, policy compliance, and compute efficiency
  • Partner with research and engineering teams to translate product or customer requirements into scalable model adaptation solutions
  • Explore post‑training techniques that improve domain specialization, tool use, planning, or agentic behaviors in enterprise environments
  • Fulltime
Read More
Arrow Right

Senior Engineer, Machine Learning Engineering

Mastercard’s Business & Market Insights (B&MI) group empowers organizations to a...
Location
Location
India , Pune
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s/bachelor’s degree in computer science or engineering
  • Considerable work experience with a proven track-record of successfully leading and managing complex projects/products and delivering to aggressive market needs
  • Expert-level hands on experience designing, building and deploying both conventional AI/ML solutions and LLM/Agentic solutions
  • Strong analytical and problem-solving abilities, with quick adaptation to new technologies, methodologies, and systems
  • Strong applied knowledge and hands on experience in advanced statistical techniques, predictive modelling, machine learning algorithms, GenAI and deep learning frameworks
  • Experience with AI and machine learning platforms such as TensorFlow, PyTorch, or similar
  • Strong programming skills in languages such as Python/SQL is a must
  • Experience with data visualization tools (e.g., Tableau, Power BI) and understanding of cloud computing services (AWS, Azure, GCP) related to data processing and storage is a plus
Job Responsibility
Job Responsibility
  • Implement multi-agent intelligence frameworks (LangGraph, CrewAI, AutoGen) to enable reasoning, coordination, and adaptive decision-making across specialized AI agents
  • Design and operationalize multi-modal AI pipelines combining text, image, tabular, and graph data using transformer-based architectures (BERT, CLIP, LLaVA, T5, Whisper, etc.) for unified intelligence
  • Build scalable RAG and Graph-RAG systems integrating vector stores and knowledge graphs (Neo4j, AWS Neptune) to enable contextual retrieval, semantic linking, and entity-aware reasoning
  • Develop and productionize transformer-based models for NLP, vision-language understanding, and sequential prediction tasks leveraging Hugging Face, PyTorch, and TensorFlow ecosystems
  • Implement advanced Python-based backend services for inference orchestration, async job handling, and distributed data workflows supporting high-throughput AI operations
  • Establish end-to-end LLMOps and MLOps pipelines on Databricks (AWS) integrating MLflow, feature stores, model lineage, prompt evaluation, and continuous retraining frameworks
  • Apply traditional AI/ML and statistical modeling techniques (regression, clustering, forecasting, ensemble methods) alongside deep learning models for hybrid interpretability and explainability
  • Engineer state and memory management subsystems that preserve context, track embeddings, and enable agents to reason temporally across multiple modalities and interactions
  • Implement Responsible AI practices—bias detection, explainability dashboards, data ethics checks, and performance governance ensuring fairness and transparency of deployed models
  • Continuously research, benchmark, and productionize innovations in multimodal transformers, generative modeling, and agentic orchestration to drive enterprise-scale intelligence and automation
  • Fulltime
Read More
Arrow Right

Senior Applied Scientist

Microsoft Teams is the hub for teamwork that integrates all the people, content,...
Location
Location
United Kingdom , Cambridge
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Undergraduate or Master’s degree in Computer Science, Mathematics, Electrical or Computer Engineering, or related field
  • 2+ years practical ML Engineering and Python coding experience leveraging PyTorch, TensorFlow or similar framework, within large code repositories and in collaboration with additional team members
  • 2+ years’ practical experience in designing, training or fine-tuning transformer-based models or LLMs
  • 2+ years’ experience of working with language, transcription, audio or multimodal applications (e.g., combining audio and video, text and audio)
  • Excellent analytical, coding, communication, and collaborative skills
Job Responsibility
Job Responsibility
  • Research, design, implement, adapt, train, fine tune or distil state-of-the-art multimodal models with the aim to support human communication in Teams
  • Prepare datasets, design and implement metrics and optimize model efficiency and performance
  • Collaborate closely with other groups (research, engineering and product groups) within the wider Microsoft organization, to create the next generation of AI innovation in our products and services
  • Embody Microsoft culture and values
  • Fulltime
Read More
Arrow Right

Senior AI/ML Engineer

At General Motors, our product teams are redefining mobility. Through a human-ce...
Location
Location
United States , Mountain View
Salary
Salary:
170600.00 - 261300.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ph.D. in Machine Learning, Robotics, Computer Science, Electrical Engineering, or a related technical field
  • 2+ years of experience in AI/ML research and applied development
  • Expertise in modern ML architectures (transformers, generative AI, multimodal systems)
  • Strong programming skills in Python
  • Strong communication, collaboration, and mentoring abilities
Job Responsibility
Job Responsibility
  • Research, design, and implement advanced Vision-Language Models and Vision-Language-Action models to enhance the autonomous vehicle's semantic understanding and decision-making capabilities
  • Develop and execute techniques for onboard model optimization, including quantization, distillation, and architecture search, to ensure large foundational models run efficiently on vehicle edge hardware
  • Partner closely with downstream engineering teams (perception, planning, and control) to integrate foundational VLM/VLA outputs into the active vehicle software stack
  • Contribute to the technical roadmap by identifying high-impact research areas and translating strategic machine learning priorities into concrete, actionable prototypes
  • Provide technical mentorship to junior researchers and engineers, fostering a culture of excellence and collaborative innovation
  • Secure intellectual property through patents and represent the company externally by publishing peer-reviewed research at top-tier machine learning conferences
What we offer
What we offer
  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • tuition assistance programs
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

Windows Agents and Growth Innovations (WinAGI) is pioneering next-generation AI-...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 7+ years technical engineering experience with coding in languages on C or C++
  • Hands-on experience with AI-assisted development tools such as GitHub Copilot, Copilot Studio, AI Foundry, or similar
  • Proven expertise in full-stack development, with emphasis on client-side application engineering and user-facing experiences
  • Deep knowledge of interaction models and multimodal interfaces (inking, stylus, voice, touch, sensors, haptics, gestures, etc.)
Job Responsibility
Job Responsibility
  • Design and deliver high-quality software components aligned to WinAGI’s vision of AI-driven Windows experiences and growth innovations
  • Work across the stack — from user interface to backend services — with a strong bias for impact and rapid iteration
  • Apply data-driven engineering practices to inform design decisions, validate hypotheses, and optimize performance through telemetry and measurable outcomes
  • Leverage modern development practices and AI-assisted tools to accelerate coding, reduce boilerplate, and enable intelligent test automation
  • Collaborate closely with product, design, and partner teams to shape priorities and deliver intuitive, high-value user experiences
  • Transform loosely defined ideas into tangible outcomes, navigating evolving priorities with creativity and technical rigor
  • Contribute to architecture discussions, code reviews, and prototyping efforts to ensure scalability and maintainability
  • Foster a culture of agility, experimentation, and outcome-driven development within the Windows ecosystem
  • Fulltime
Read More
Arrow Right

Senior Researcher - Foundations of Generative AI

Microsoft Research AI Frontiers lab is seeking applications for the position of ...
Location
Location
United States , New York
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Doctorate (or currently pursuing) in Computer Science or relevant field OR equivalent experience
  • Doctorate in Computer Science or relevant field AND 2+ years related research experience OR equivalent experience
  • Research program demonstrated by public artifacts like models, tools, code in the AI space or publications at conferences: NeurIPS, ICML, ICLR, ACL, NAACL, CVPR, COLT, ECCV, ICCV, EMNLP
  • 2+ years of academic or industry experience in developing, applying, and/or implementing algorithms for machine learning/statistics, using common ML engineering programming languages and platforms such as Python, Python numerical libraries, PyTorch, TensorFlow and/or HuggingFace
  • Experience publishing academic papers as a lead author or essential contributor in a top AI conference or journal
  • Deep understanding of frontier model architectures, especially transformers and state space models
  • Hands-on experience building and working with Large Language Models (LLMs) or multimodal models (VLMs, VLAs), including pre-training, fine-tuning, and inference
  • 2+ years of industry or academic experience with building, debugging and optimizing large-scale ML training pipelines
  • Demonstrated software engineering excellence building and deploying prototypes, applications, or open-source (OSS) technologies
  • Ability to work independently and ramp-up quickly on complex projects or unfamiliar code
Job Responsibility
Job Responsibility
  • Apply research and engineering skills to develop, prototype, and evaluate cutting-edge research ideas
  • Work closely with other researchers and engineers to rapidly prototype and test new research ideas, driving a high-impact agenda and publishing results where appropriate
  • Collaborate hands-on with other researchers, engineers, and internal and external product groups to deliver high-impact solutions to real-world problems
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

Do you thrive on solving complex problems, uncovering insights, and shaping inno...
Location
Location
United States , Multiple Locations
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR equivalent experience.
  • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 7+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR equivalent experience.
  • Proven consulting and stakeholder engagement skills with proven ability to influence decisions.
  • Proficiency in Python and SQL
Job Responsibility
Job Responsibility
  • Own end-to-end delivery of strategic data science projects
  • partner with customers and internal teams to design and implement advanced analytics and AI solutions that create measurable business impact
  • Own delivery of complex, high-impact data science and AI solutions for strategic consulting engagements
  • Collaborate with stakeholders to define business problems and translate them into actionable AI-driven solutions
  • Develop project plans, assess risks, and ensure alignment with strategic objectives and ethical AI principles
  • Identify opportunities to leverage generative AI for business transformation and innovation
  • Acquire, clean, and prepare large datasets for modeling
  • Build and deploy predictive and prescriptive models using modern machine learning techniques
  • Design, develop, and integrate generative AI applications (e.g., text, image, multimodal) into client workflows and solutions
  • Write efficient, maintainable code and ensure scalability for production environments
  • Fulltime
Read More
Arrow Right

Software & Data Engineer Intern

Join Entalpic's Platform team and contribute to the core software foundations of...
Location
Location
France , Paris
Salary
Salary:
Not provided
breega.com Logo
Breega
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently pursuing or recently completed a Bachelor’s or Master’s degree in Computer Science, Data Engineering, Software Engineering, or a related field
  • Strong interest in data engineering, data systems, and infrastructure for machine learning or scientific applications
  • Proficiency in Python and familiarity with at least one other programming language is a plus
  • Foundational knowledge of SQL and relational databases, with curiosity about NoSQL systems
  • Understanding of core data concepts such as ETL, data modeling, and data pipelines
  • Must be comfortable working in English in a technical environment
  • Motivated, curious, and eager to learn in a fast-paced startup setting
Job Responsibility
Job Responsibility
  • Data Engineering Implementation: Help build and maintain data pipelines that process and integrate multimodal data including simulation results, scientific text, and experimental measurements
  • Data Storage and Organization: Contribute to the implementation and organization of data storage solutions, ensuring data is well-structured, accessible, and documented
  • Automation and Tooling: Write scripts to automate data ingestion, cleaning, and transformation tasks under the guidance of senior engineers
  • Data Visualization and Analytics: Support the creation of basic data visualizations and analytical dashboards to help teams explore datasets, monitor data quality, and gain insights from experimental, simulation, and textual data
  • Applied ML Research: Prototype end-to-end pipelines using state-of-the-art LLMs for chemical entity extraction and explore ranking methods to improve data quality and retrieval for downstream AI systems
  • Data Quality and Documentation: Assist with data validation, basic lineage tracking, and documentation to improve data reliability and reproducibility
  • Infrastructure Collaboration: Work with data engineers, data scientists, and DevOps to understand how data systems are deployed and scaled on cloud platforms such as AWS or GCP
  • Cross-team Collaboration: Interact with scientists and engineers to understand data needs and help translate them into practical data solutions
What we offer
What we offer
  • Competitive salary + full reimbursement of your transport card
  • Flexible work environment: Remote-Friendly with a minimum of 3 days in Paris offices per week (Station F)
  • 1 paid day off per month
  • Professional development opportunities: access to conferences and internal learning sessions
  • Fulltime
Read More
Arrow Right