CrawlJobs Logo

Staff ML Validation Applied Scientist

United States, Sunnyvale 218800.00 - 335300.00 USD / Year · Job Posted April 16, 2026
Apply Position
Job Link Share

Job Description

As a Staff ML Validation Applied Scientist on the Software Validation team within the Autonomous Vehicle (AV) organization, you will lead applied machine learning research focused on improving verification and validation of ML components and autonomous driving behavior at scale. You will push the frontier of simulation-led ML validation, creating metrics, tools, and agentic workflows that make it dramatically faster, more automated, and more robust to evaluate autonomy systems across large fleets, diverse scenarios, and continuous release cycles. You will transform advanced ML research into working prototypes and production-grade validation services, including AI validation critics that automatically review model behavior, logs, and simulation traces to surface issues, regressions, and coverage gaps.

Job Responsibility

  • Lead ML-centric validation strategy for deep learning components across perception, prediction, and planning in AV, defining evaluation methodologies with cross-functional partners
  • Build AI validation critics and agentic acceleration workflows using LLM- and model-based agents plus orchestration to automate scenario review, anomaly detection, and end-to-end validation flows
  • Prototype ML research into scalable tools by transforming ML research into performant tools integrated into CI/CD and large-scale pipelines, owning key behavior and ML validation services and data pipelines
  • Drive simulation-based ML evaluation at scale by evaluating deep learning modules in realistic sensor and traffic simulation and expanding behavioral and scenario coverage tightly linked to ML models
  • Provide cross-functional collaboration and leadership across Simulation, Safety, Systems Engineering, Autonomy, and tools teams through reviews, roadmapping, standards, and mentorship focused on high-quality, automation-first software

Requirements

  • 8+ years of experience and MS/PhD in Computer Science, Machine Learning, Robotics, Software Engineering, Data Science, or a related field
  • Strong proficiency in Python and at least one systems language (e.g., C++), with experience building production systems over large datasets
  • Deep understanding of and experience evaluating modern ML for robotic systems
  • Hands-on experience using AI agents, LLM-based tools, or workflow orchestration to automate parts of the development, validation, or operations lifecycle
  • Demonstrated ability to design and implement behavioral and ML metrics and associated tooling for validation and regression detection of complex ML systems
  • Strong analytical skills and systems thinking
  • able to reason about complex AV behavior and ML model interactions and turn insights into code and tools
  • Effective communicator who can work across teams and provide technical leadership and mentorship to other engineers and researchers

Nice to have

  • Background in autonomous vehicles, vehicle development, or ADAS
  • Demonstrated impact from introducing automation and AI-assisted tooling (e.g., AI agents, AI validation critics, smart monitoring) that improved scale, reliability, or engineering velocity in ML validation workflows
  • Experience building verification and validation tools or infrastructure for safety-critical ML or control systems
  • Experience working with simulation environments and large scenario or telemetry datasets for ML evaluation and behavior validation

What we offer

  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • tuition assistance programs
  • employee assistance program
  • GM vehicle discounts

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Staff ML Validation Applied Scientist

8 matching positions

Applied Scientist II, Central Machine Learning

Do you want to join an innovative team of scientists who use machine learning an...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
Amazon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of building models for business application experience
  • PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
  • Experience in patents or publications at top-tier peer-reviewed conferences or journals
  • Experience programming in Java, C++, Python or related language
  • Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing
Job Responsibility
Job Responsibility
  • Use machine learning and analytical techniques to create scalable solutions for business problems
  • Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes
  • Design, development, evaluate and deploy innovative and highly scalable models for predictive learning
  • Research and implement novel machine learning and statistical approaches
  • Work closely with software engineering teams to drive real-time model implementations and new feature creations
  • Work closely with business owners and operations staff to optimize various business operations
  • Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation
  • Mentor other scientists and engineers in the use of ML techniques
Read More
Arrow Right

Applied Scientist

Do you want to join an innovative team of scientists who use machine learning an...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
Amazon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience programming in Java, C++, Python or related language
  • Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse
Job Responsibility
Job Responsibility
  • Use machine learning and analytical techniques to create scalable solutions for business problems
  • Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes
  • Design, development, evaluate and deploy innovative and highly scalable models for predictive learning
  • Research and implement novel machine learning and statistical approaches
  • Work closely with software engineering teams to drive real-time model implementations and new feature creations
  • Work closely with business owners and operations staff to optimize various business operations
  • Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation
  • Mentor other scientists and engineers in the use of ML techniques
Read More
Arrow Right
New

Applied Artificial Intelligence Scientist III

The Applied Artificial Intelligence (AI) Scientist III is a subject matter exper...
Location
Location
United States , Los Angeles
Salary
Salary:
135136.00 - 216218.00 USD / Year
lacare.org Logo
L.A. Care Health Plan
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree
  • At least 6 years of professional experience developing and deploying machine learning and AI solutions in enterprise or healthcare environments
  • Demonstrated experience leading full AI solution lifecycles – from problem definition to deployment and monitoring
  • Proven successful experience developing predictive models using structured and unstructured healthcare data (e.g., claims, encounters, eligibility, provider, quality metrics)
  • Experience with Python (Pandas, Scikit-learn, PySpark), distributed data frameworks (Spark), and MLOps concepts
  • Strong collaboration and mentorship experience, including guiding junior data scientists and analysts
  • Experience integrating AI solutions into production environments in collaboration with IT or Data Engineering
  • Experience with version control (Git) and model documentation best practices
  • Experience building and deploying models in production using MLOps frameworks and cloud platforms
  • Advanced programming skills in Python, including libraries for data processing, modeling, and analytics (e.g., Pandas, Scikit-learn, PySpark)
Job Responsibility
Job Responsibility
  • Design, train, validate, and deploy complex AI and ML models to address enterprise use cases across departments such as Health Services, Payment Integrity, Quality Improvement, Finance, and Provider Network Management
  • Lead all phases of the AI solution lifecycle – from problem framing and data engineering through model design, validation, and operational integration
  • Implement production-grade ML pipelines using modern MLOps practices, ensuring scalability, reproducibility, and continuous model performance monitoring
  • Serve as a subject matter expert in responsible and explainable AI, ensuring model fairness, transparency, and compliance with regulatory and ethical standards
  • Partner with business and technology leaders to identify and prioritize new AI use cases that align with the organization’s transformation strategy
  • Translate business challenges into well-structured analytical problems and lead cross-functional teams through data discovery, feature engineering, and algorithm development
  • Work directly with cloud-based data and AI platforms (e.g., Snowflake, Azure ML, Databricks) to operationalize model delivery and integration with enterprise data assets
  • Mentor and coach staff, providing technical guidance, code reviews, and knowledge sharing
  • Document all model design assumptions, data sources, evaluation metrics, and deployment protocols for transparency and reproducibility
  • Communicate complex technical results in accessible, actionable ways for both executive and operational stakeholders
What we offer
What we offer
  • Paid Time Off (PTO)
  • Tuition Reimbursement
  • Retirement Plans
  • Medical, Dental and Vision
  • Wellness Program
  • Volunteer Time Off (VTO)
  • Fulltime
Read More
Arrow Right

Staff Scientist - Reservations

The Reservations data science team owns the experience and algorithms powering t...
Location
Location
United States , Seattle
Salary
Salary:
216000.00 - 240000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ph.D., M.S. or Bachelor's degree in Statistics, Economics, Mathemathics, Computer Science, Machine Learning, Operations Research, or other quantitative fields.
  • 6+ years of industry experience as an Applied or Data Scientist or equivalent.
  • Proficiency in programming languages (Python, Java, Scala) and ML frameworks (TensorFlow, PyTorch, Scikit-Learn), underpinned by a solid grasp of MLOps practices, including design documentation, testing, and source code management with Git.
  • Agile project management capabilities, adept at using tools like JIRA, and a driven problem-solver with a passion for impacting the retail sector at scale.
  • Advanced skills in the development and deployment of large-scale ML models
  • Experience in experimental design and analysis (e.g., A/B and market-level experiments), causal inference.
  • Strong business and product sense: delight in shaping vague questions into well-defined analyses and success metrics that drive business decisions.
  • Strong experience in causal inference, optimization, and machine learning.
  • Experience in algorithm development and prototyping. Particularly in Pricing domain.
  • Ability to drive clarity on the best modeling or analytic solution for a business objective
Job Responsibility
Job Responsibility
  • Deploy a wide variety of methodologies, including causal inference techniques, funnel analyses, and econometric modeling to identify our largest business opportunities.
  • Work together with Product, Operations, and Engineering partners to design a roadmap of features and initiatives as well as the long-term team strategy.
  • Run large scale experiments to validate the impact of new features.
  • Present findings to business and executive audiences
What we offer
What we offer
  • Bonus program
  • Equity award
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Staff Scientist - Reservations

The Reservations data science team owns the experience and algorithms powering t...
Location
Location
United States , Seattle
Salary
Salary:
216000.00 - 240000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ph.D., M.S. or Bachelor's degree in Statistics, Economics, Mathematics, Computer Science, Machine Learning, Operations Research, or other quantitative fields
  • 6+ years of industry experience as an Applied or Data Scientist or equivalent
  • Proficiency in programming languages (Python, Java, Scala) and ML frameworks (TensorFlow, PyTorch, Scikit-Learn), underpinned by a solid grasp of MLOps practices, including design documentation, testing, and source code management with Git
  • Agile project management capabilities, adept at using tools like JIRA, and a driven problem-solver with a passion for impacting the retail sector at scale
  • Advanced skills in the development and deployment of large-scale ML models
  • Experience in experimental design and analysis (e.g., A/B and market-level experiments), causal inference
  • Strong business and product sense: delight in shaping vague questions into well-defined analyses and success metrics that drive business decisions
Job Responsibility
Job Responsibility
  • Deploy a wide variety of methodologies, including causal inference techniques, funnel analyses, and econometric modeling to identify our largest business opportunities
  • Work together with Product, Operations, and Engineering partners to design a roadmap of features and initiatives as well as the long-term team strategy
  • Run large scale experiments to validate the impact of new features
  • Present findings to business and executive audiences
What we offer
What we offer
  • Eligible to participate in Uber's bonus program
  • May be offered an equity award & other types of comp
  • All full-time employees are eligible to participate in a 401(k) plan
  • Eligible for various benefits
  • Fulltime
Read More
Arrow Right

Staff Scientist, Marketplace (Multiple Teams)

Location
Location
United States , New York, New York; San Francisco, California; Sunnyvale, California
Salary
Salary:
216000.00 - 240000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ph.D., M.S. or Bachelor's degree in Economics, Statistics, Machine Learning, Operations Research, or other quantitative fields
  • 7+ years of industry experience as an Applied or Data Scientist or equivalent (or 4+ years with Ph.D.)
  • Excellent communication and collaboration skills: Able to lead initiatives across multiple product areas and communicate findings with leadership and product teams
  • Background in at least one programming language (eg. Python, R, Java, Ruby, Scala/Spark or Perl)
  • Ability to use Python or similar technologies to work efficiently with large data sets and prototype algorithms & models
  • Coding and SQL proficiency and ability to develop statistical analysis and algorithm prototyping in Python or R
  • Experience designing experiments and interpreting the results to draw detailed and actionable conclusions across a variety of key performance indicators
Job Responsibility
Job Responsibility
  • Solve ambiguous, challenging business problems using data-driven approaches including Causal Inference, Optimization and ML
  • Own the product development cycle end to end from data and science aspects
  • Provide thought leadership and mentorship for critical science problems across teams / orgs
  • Develop data-driven business insights and work with cross-functional customers to find opportunities and recommend prioritization of initiatives
  • Design and analyze experiments, present results that provide actionable recommendations
  • Develop and implement statistical / econometric methodologies to improve results validity, power and generalizability
  • Orient the teams around data-driven product development by driving the creation of logging, metrics, data visualization and diagnostic tools, and experimentation paradigms
  • Define how our teams measure success, by developing metrics, in close partnership with cross-functional partners
What we offer
What we offer
  • Bonus program
  • Equity award
  • Other types of comp
  • 401(k) plan
  • Various benefits (see https://jobs.uber.com/en/benefits)
  • Fulltime
Read More
Arrow Right

Staff Medical Product Manager

We’re hiring a Staff Medical Product Manager to help lead strategy and execution...
Location
Location
Canada , Toronto
Salary
Salary:
130000.00 - 150000.00 CAD / Year
fullscript.com Logo
Fullscript
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years in product management or a related role in software, digital health, or healthtech
  • A background in clinical sciences—either through a graduate degree (MD, ND, NP, DO, PharmD) or 10+ years of relevant integrative medicine or industry experience in a clinical support role in healthtech
  • Experience bridging medical topics with confidence to non-medical colleagues, and the ability to represent the clinician perspective in product and strategy conversations
  • Strong technical literacy—comfortable working with data scientists, ML engineers, and backend developers
  • Experience in high-growth or startup environments where speed, ambiguity, and ownership are the norm
  • Strong cross-functional leadership, clear communication, and excellent judgment
  • A builder’s mindset—you can work autonomously, create clarity in ambiguity, and ship meaningful outcomes fast
Job Responsibility
Job Responsibility
  • Support strategy and delivery for high-impact product initiatives focused on improving care delivery and patient outcomes
  • Translate practitioner and patient needs into scalable product opportunities, collaborating closely with Product, Design, Engineering, and Data
  • Apply technical fluency in backend systems, ML, and data architecture to inform product decisions and system design
  • Support the development and validation of AI/ML models, helping ensure medical accuracy, safety, and utility
  • Help evolve our clinical data infrastructure to support research, personalization, and feature development
  • Serve as a trusted voice in strategic product conversations—bringing clinical context, clear judgment, and a focus on outcomes
  • Collaborate with Clinical Research, Marketing, and Product teams to ensure our features are both credible and clearly communicated
What we offer
What we offer
  • Generous PTO and competitive pay
  • Fullscript’s RRSP match program for financial health
  • Flexible benefits package and workplace wellness program
  • Training budget and company-wide learning initiatives
  • Discount on Fullscript catalog of products
  • Fulltime
Read More
Arrow Right

Staff Machine Learning Engineer

Tonal is looking for a Staff Machine Learning Engineer to help expand Tonal’s in...
Location
Location
United States , San Francisco; Toronto
Salary
Salary:
200000.00 - 235000.00 USD / Year
tonal.com Logo
Tonal
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7 plus years of experience in software engineering or applied ML
  • 5 plus with a Master’s degree
  • PhD with 3 plus years of experience
  • Strong coding skills in Python
  • Experience with frameworks such as PyTorch, TensorFlow, or JAX
  • Experienced in ML training, evaluation, and deployment workflows such as Sagemaker, MLFlow, Databricks, or similar
  • Deep understanding of time series modeling, human motion, or sensor based learning from devices such as force transducers, position encoders, IMUs, or cameras
  • Familiar with MLOps best practices and scalable model training pipelines
  • Strong communicator who can collaborate with scientists, product managers, and engineers
  • Track record of delivering performant ML systems from prototype to production
Job Responsibility
Job Responsibility
  • Design, implement, and optimize machine learning training pipelines and model serving infrastructure for real time applications
  • Develop algorithms and ML models that enable personalized training, adaptive coaching, and performance prediction
  • Fine tune and evaluate transformer based or self supervised learning models using Tonal’s multimodal dataset
  • Build data driven systems that measure training effectiveness, effort, and progression beyond traditional weight based metrics
  • Prototype, train, and deploy ML models that run efficiently at scale or on device
  • Collaborate cross functionally with Exercise Science, Product, and Software teams to deliver intelligent features that improve the member experience
  • Contribute to the development of automated tools for experimentation, model validation, and continuous retraining
  • Write high quality, maintainable Python code and work closely with backend engineers to integrate models into Tonal’s production systems
  • Mentor teammates and help shape Tonal’s growing AI and ML best practices
What we offer
What we offer
  • Offers Equity
  • Health insurance
  • Retirement savings benefits
  • Life insurance
  • Disability benefits
  • Flexible paid time off
  • Parental leave
  • Other additional benefits (location dependent)
  • Fulltime
Read More
Arrow Right