CrawlJobs Logo

Applied ML Validation Manager

gm.com Logo

General Motors

Location Icon

Location:
United States , Sunnyvale

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

218000.00 - 335000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

As an Applied ML Validation Manager on the Software Validation team within the AV organization, you will lead a team focused on building and operating behavior critics and human benchmarking capabilities for ML-driven autonomy systems. Your team will turn subjective human expectations about safe, comfortable, and intuitive driving into rigorous, scalable evaluation frameworks that directly inform model development and release decisions. You will partner closely with autonomy, simulation, safety, and product teams to define how behavior is judged against human drivers and integrate behavior critic signals into validation pipelines, continuous release, and long-term performance monitoring.

Job Responsibility:

  • Lead and grow an Applied ML validation team focused on behavior evaluation and human benchmarking for autonomy ML systems
  • Define the strategy and roadmap for evaluating ML behavior against human-like driving expectations across simulation, replay, and on-road environments
  • Design, implement, and operate behavior critic frameworks that assess model actions and trajectories, turning qualitative human feedback into structured labels, metrics, and scorecards
  • Develop and scale human benchmarking programs, including rater guidelines, calibration, and quality controls, to compare ML system performance against expert and typical human drivers
  • Partner closely with autonomy, simulation, safety, and product teams to integrate behavior critic and human benchmarking outputs into training, offline validation, release gating, and reporting

Requirements:

  • 8+ years of experience and MS/PhD in Computer Science, Machine Learning, Robotics, Software Engineering, Data Science, or a related field
  • 2+ years of people management experience leading engineering, validation, or applied ML teams
  • Strong programming and data skills in Python and common analysis/ML tooling (e.g., PyTorch)
  • Demonstrated experience designing and operating evaluation/validation pipelines for complex ML systems
  • Proven ability to define, implement, and track metrics that capture system quality, reliability, safety, or user experience

Nice to have:

  • Experience with autonomous driving, robotics, or other safety-critical domains, especially in validation, safety, or systems engineering roles
  • Demonstrated background with simulation-based validation, including VLM critics, human benchmarking, and scalable evaluation for ML or autonomy systems
  • Hands-on experience with agentic workflows used to accelerate analyses, automate documentation, or orchestrate complex data and metric pipelines
  • Track record of building or scaling technical teams and tooling in fast-evolving domains, especially focused on evaluation, automation, and ML observability
What we offer:
  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • tuition assistance programs
  • employee assistance program
  • GM vehicle discounts

Additional Information:

Job Posted:
April 16, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
General Motors - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon
PREMIUM
More languages and countries
Unlock more languages and countries
Languages
English Čeština Deutsch Ελληνικά Español Français +15
Countries
United States United Kingdom India Canada Australia +
See plans
Plans from $2.99 / month

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Applied ML Validation Manager

Safety Engineer Expert – Machine Learning - ISO 26262

As a Safety Expert for Machine Learning, you will address one of the most challe...
Location
Location
Canada , Montréal
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Electrical/Computer Engineering, AI/ML Engineering, or a related discipline
  • Strong expertise in functional safety and AI/ML safety challenges, ideally in the context of automotive ADAS and autonomous systems
  • Advanced studies (PhD) in AI safety, ML validation, or related research areas are considered a strong asset
  • Solid understanding of machine learning model development, validation, and testing, and life-cycle data management
  • Practical experience applying STPA, FMEA, or similar system-theoretic hazard analyses to automotive or aerospace systems
  • Knowledge of emerging standards and guidelines for ML safety (e.g., ISO 21448 – SOTIF, ISO 8800, UL 4600)
  • Ability to bridge the gap between research and practical engineering implementation
  • Collaborative mindset, able to work across data, perception, and system safety teams
Job Responsibility
Job Responsibility
  • Researching, defining, and pioneering best practices and standards for the verification and validation of ML systems
  • Applying STPA and related system-safety techniques to identify unsafe control actions and derive ML-specific safety requirements
  • Collaborating closely with World Understanding and Behavior teams to define processes for data quality, model robustness, and Operational Design Domain (ODD)
  • Developing and formalizing novel safety arguments and evidence to support production-ready deployment of AI-based ADAS features
  • Acting as a thought leader, helping shape the integration of machine learning into safety-critical automotive systems
What we offer
What we offer
  • Hybrid Work
  • Industry leading medical, dental, and vision Insurance
  • Access to a telemedicine service
  • RRSP program
  • Personal and sick days
  • Recreation room with pool table and foosball table
  • Fulltime
Read More
Arrow Right

Senior Staff Perception/ML Research Engineer

As a Senior Staff Perception/ML Research Engineer on the Perception and Safety R...
Location
Location
United States , Waltham
Salary
Salary:
173732.00 - 238882.00 USD / Year
bostondynamics.com Logo
Boston Dynamics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience working with perception sensor data, including stereo, LiDAR, radar, ToF, or IR data
  • 5+ years of experience applying ML to perception problems, ideally on embedded systems
  • Deep knowledge of state of the art in related areas including human detection, autonomous vehicle and driver assist systems, and robot safety
  • Experience developing and deploying ML-based perception software for time-sensitive control systems, such as robotics
  • Experience developing specifications for perception systems from high-level product requirements
  • Experience with the full lifecycle of deep learning development, including network design, data management, training, evaluation, hyperparameter search, deployment, and validation
  • Strong communication skills, including ability to author technical documentation and deliver presentations on technical topics
  • History of leading cross-functional technical efforts through planning, technical requirement development, and interdisciplinary collaboration
  • History of working in small, interdisciplinary teams
  • Eligible to work in the United States
Job Responsibility
Job Responsibility
  • Help build the systems that allow our robots to operate safely around people
  • Develop datasets, metrics, and validation plans for ML models
  • Build, validate, and deploy ML models to detect hazards, humans, and other environmental features
  • Integrate these models onto our robots' embedded systems to collect data and evaluate performance
  • Work to improve model accuracy and run-time performance of models on specific hardware
  • Lead cross-functional technical efforts involving interdisciplinary efforts to develop robotic systems
  • Work closely with a small team to design and prototype new payloads, platforms, and product features which create safety features for our robots
What we offer
What we offer
  • medical
  • dental
  • vision
  • 401(k)
  • paid time off
  • annual bonus structure
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

We are looking for a Senior Data Scientist to join our mission to make our platf...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree in computer science, data science, statistics, mathematics or related field (or equivalent experience)
  • At least 5+ years of proven experience applying ML methods to build and deploy production-grade models (e.g., XGBoost, Random Forests, Logistic Regression, Neural Networks, Transformers)
  • Strong proficiency in Python and ML libraries (e.g., scikit-learn, PyTorch, XGBoost), with proven experience applying classical ML to structured and time series data, including feature engineering, model evaluation (e.g., precision/recall, AUC), and deploying scalable models (e.g., XGBoost, Random Forests, Logistic Regression) to production.
  • Solid understanding of ML/DS best practices, including model validation, A/B testing, feature engineering, and pipeline management ensuring quality and robustness of data science outputs.
  • Practical experience with Large Language Models (LLMs) for tasks such as classification, summarization, or risk signal extraction from unstructured text, with a clear understanding of evaluation and ethical considerations in production use.
  • True team player mentality, with excellent communication skills including ability to explain complex ML results to non-technical stakeholders.
Job Responsibility
Job Responsibility
  • Understand fraud patterns, user trust needs and identify where Machine Learning can bring the greatest impact.
  • Train and evaluation of ML models from scratch or fine-tune existing ones for fraud detection and behavioural analytics
  • Work as part of an agile cross-functional development team with a “win together, lose together” mindset, having end-to-end responsibility from design and development to deployment, monitoring, and maintenance in production.
  • Engineer and select features from large, complex datasets to improve model accuracy and robustness.
  • Monitor and evaluate ML models in production, conduct model experiments, comparing variants and identifying improvement and retraining needs.
  • Ensure data and model quality, integrity, and reproducibility in production environments.
  • Share your knowledge, evolve best practices with your colleagues to boost machine learning at Kleinanzeigen strengthening our ML community.
  • Proactively identify opportunities to apply ML for fraud detection and increased user trust.
  • Promote ethical AI use, ensuring fairness, transparency, and accountability in all models developed.
  • Proactive collaboration with data and application engineers to shape data models and ensure ML-readiness for production.
What we offer
What we offer
  • An attractive Base Salary.
  • Participation in our Short Term Incentive plan (annual bonus).
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere!
  • A 24/7 Employee Assistance Program for you and your family, because we care.
  • Win together, lose together is one of our key behaviours. At Adevinta you will find a collaborative environment with an opportunity to explore your potential and grow.
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

We are looking for a Senior Data Scientist to join our mission to make our platf...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree in computer science, data science, statistics, mathematics or related field (or equivalent experience)
  • At least 5+ years of proven experience applying ML methods to build and deploy production-grade models (e.g., XGBoost, Random Forests, Logistic Regression, Neural Networks, Transformers)
  • Strong proficiency in Python and ML libraries (e.g., scikit-learn, PyTorch, XGBoost), with proven experience applying classical ML to structured and time series data, including feature engineering, model evaluation (e.g., precision/recall, AUC), and deploying scalable models (e.g., XGBoost, Random Forests, Logistic Regression) to production
  • Solid understanding of ML/DS best practices, including model validation, A/B testing, feature engineering, and pipeline management ensuring quality and robustness of data science outputs
  • Practical experience with Large Language Models (LLMs) for tasks such as classification, summarization, or risk signal extraction from unstructured text, with a clear understanding of evaluation and ethical considerations in production use
  • True team player mentality, with excellent communication skills including ability to explain complex ML results to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Understand fraud patterns, user trust needs and identify where Machine Learning can bring the greatest impact
  • Train and evaluation of ML models from scratch or fine-tune existing ones for fraud detection and behavioural analytics
  • Work as part of an agile cross-functional development team with a “win together, lose together” mindset, having end-to-end responsibility from design and development to deployment, monitoring, and maintenance in production
  • Engineer and select features from large, complex datasets to improve model accuracy and robustness
  • Monitor and evaluate ML models in production, conduct model experiments, comparing variants and identifying improvement and retraining needs
  • Ensure data and model quality, integrity, and reproducibility in production environments
  • Share your knowledge, evolve best practices with your colleagues to boost machine learning at Kleinanzeigen strengthening our ML community
  • Proactively identify opportunities to apply ML for fraud detection and increased user trust
  • Promote ethical AI use, ensuring fairness, transparency, and accountability in all models developed
  • Proactive collaboration with data and application engineers to shape data models and ensure ML-readiness for production
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

We are looking for a Senior Data Scientist to join our mission to make our platf...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree in computer science, data science, statistics, mathematics or related field (or equivalent experience)
  • At least 5+ years of proven experience applying ML methods to build and deploy production-grade models (e.g., XGBoost, Random Forests, Logistic Regression, Neural Networks, Transformers)
  • Strong proficiency in Python and ML libraries (e.g., scikit-learn, PyTorch, XGBoost), with proven experience applying classical ML to structured and time series data, including feature engineering, model evaluation (e.g., precision/recall, AUC), and deploying scalable models (e.g., XGBoost, Random Forests, Logistic Regression) to production.
  • Solid understanding of ML/DS best practices, including model validation, A/B testing, feature engineering, and pipeline management ensuring quality and robustness of data science outputs.
  • Practical experience with Large Language Models (LLMs) for tasks such as classification, summarization, or risk signal extraction from unstructured text, with a clear understanding of evaluation and ethical considerations in production use.
  • True team player mentality, with excellent communication skills including ability to explain complex ML results to non-technical stakeholders.
Job Responsibility
Job Responsibility
  • Understand fraud patterns, user trust needs and identify where Machine Learning can bring the greatest impact.
  • Train and evaluation of ML models from scratch or fine-tune existing ones for fraud detection and behavioural analytics
  • Work as part of an agile cross-functional development team with a “win together, lose together” mindset, having end-to-end responsibility from design and development to deployment, monitoring, and maintenance in production.
  • Engineer and select features from large, complex datasets to improve model accuracy and robustness.
  • Monitor and evaluate ML models in production, conduct model experiments, comparing variants and identifying improvement and retraining needs.
  • Ensure data and model quality, integrity, and reproducibility in production environments.
  • Share your knowledge, evolve best practices with your colleagues to boost machine learning at Kleinanzeigen strengthening our ML community.
  • Proactively identify opportunities to apply ML for fraud detection and increased user trust.
  • Promote ethical AI use, ensuring fairness, transparency, and accountability in all models developed.
  • Proactive collaboration with data and application engineers to shape data models and ensure ML-readiness for production.
What we offer
What we offer
  • An attractive Base Salary.
  • Participation in our Short Term Incentive plan (annual bonus).
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere!
  • A 24/7 Employee Assistance Program for you and your family.
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

We are looking for a Senior Data Scientist to join our mission to make our platf...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree in computer science, data science, statistics, mathematics or related field (or equivalent experience)
  • At least 5+ years of proven experience applying ML methods to build and deploy production-grade models (e.g., XGBoost, Random Forests, Logistic Regression, Neural Networks, Transformers)
  • Strong proficiency in Python and ML libraries (e.g., scikit-learn, PyTorch, XGBoost), with proven experience applying classical ML to structured and time series data, including feature engineering, model evaluation (e.g., precision/recall, AUC), and deploying scalable models (e.g., XGBoost, Random Forests, Logistic Regression) to production
  • Solid understanding of ML/DS best practices, including model validation, A/B testing, feature engineering, and pipeline management ensuring quality and robustness of data science outputs
  • Practical experience with Large Language Models (LLMs) for tasks such as classification, summarization, or risk signal extraction from unstructured text, with a clear understanding of evaluation and ethical considerations in production use
  • True team player mentality, with excellent communication skills including ability to explain complex ML results to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Understand fraud patterns, user trust needs and identify where Machine Learning can bring the greatest impact
  • Train and evaluation of ML models from scratch or fine-tune existing ones for fraud detection and behavioural analytics
  • Work as part of an agile cross-functional development team with a “win together, lose together” mindset, having end-to-end responsibility from design and development to deployment, monitoring, and maintenance in production
  • Engineer and select features from large, complex datasets to improve model accuracy and robustness
  • Monitor and evaluate ML models in production, conduct model experiments, comparing variants and identifying improvement and retraining needs
  • Ensure data and model quality, integrity, and reproducibility in production environments
  • Share your knowledge, evolve best practices with your colleagues to boost machine learning at Kleinanzeigen strengthening our ML community
  • Proactively identify opportunities to apply ML for fraud detection and increased user trust
  • Promote ethical AI use, ensuring fairness, transparency, and accountability in all models developed
  • Proactive collaboration with data and application engineers to shape data models and ensure ML-readiness for production
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

We are looking for a Senior Data Scientist to join our mission to make our platf...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree in computer science, data science, statistics, mathematics or related field (or equivalent experience)
  • At least 5+ years of proven experience applying ML methods to build and deploy production-grade models (e.g., XGBoost, Random Forests, Logistic Regression, Neural Networks, Transformers)
  • Strong proficiency in Python and ML libraries (e.g., scikit-learn, PyTorch, XGBoost), with proven experience applying classical ML to structured and time series data, including feature engineering, model evaluation (e.g., precision/recall, AUC), and deploying scalable models (e.g., XGBoost, Random Forests, Logistic Regression) to production
  • Solid understanding of ML/DS best practices, including model validation, A/B testing, feature engineering, and pipeline management ensuring quality and robustness of data science outputs
  • Practical experience with Large Language Models (LLMs) for tasks such as classification, summarization, or risk signal extraction from unstructured text, with a clear understanding of evaluation and ethical considerations in production use
  • True team player mentality, with excellent communication skills including ability to explain complex ML results to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Understand fraud patterns, user trust needs and identify where Machine Learning can bring the greatest impact
  • Train and evaluation of ML models from scratch or fine-tune existing ones for fraud detection and behavioural analytics
  • Work as part of an agile cross-functional development team with a “win together, lose together” mindset, having end-to-end responsibility from design and development to deployment, monitoring, and maintenance in production
  • Engineer and select features from large, complex datasets to improve model accuracy and robustness
  • Monitor and evaluate ML models in production, conduct model experiments, comparing variants and identifying improvement and retraining needs
  • Ensure data and model quality, integrity, and reproducibility in production environments
  • Share your knowledge, evolve best practices with your colleagues to boost machine learning at Kleinanzeigen strengthening our ML community
  • Proactively identify opportunities to apply ML for fraud detection and increased user trust
  • Promote ethical AI use, ensuring fairness, transparency, and accountability in all models developed
  • Proactive collaboration with data and application engineers to shape data models and ensure ML-readiness for production
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • A collaborative environment with an opportunity to explore your potential and grow
  • A range of locally relevant benefits
  • Fulltime
Read More
Arrow Right

Senior Applied Scientist

The Teams Search Intelligence Team builds largescale machine learning systems th...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics predictive analytics, research)
  • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ year(s) related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience
  • 6+ years of experience in predictive analytics, statistical modelling, or applied ML, including data preparation and evaluation
  • Experience with synthetic data generation and data management for evaluation/training
  • Proficiency in English with solid cross functional collaboration and communication skills
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Solve complex relevance and ranking problems using applied machine learning and statistical methods
  • Design, train, evaluate, and improve ML models and signals that power search and personalized discovery experiences
  • Integrate scientific methods into the product lifecycle, including offline evaluation, metric design, and online experimentation
  • Write productionquality code and apply strong debugging, validation, and reliability practices in largescale ML systems
  • Collaborate closely with software engineers, product managers, designers, and partner science teams to drive endtoend impact from research to production
  • Mentor and guide colleagues without formal research backgrounds on ML best practices, experimentation, and evaluation
  • Share learnings and results through design reviews, internal presentations, and external publications or patents where appropriate
  • Fulltime
Read More
Arrow Right