CrawlJobs Logo

Data Scientist, Integrity Measurement

United Kingdom, London · Job Posted May 31, 2026
Apply Position
Job Link Share

Job Description

The Applied Foundations team at OpenAI is dedicated to ensuring that our cutting-edge technology is not only revolutionary, but also secure from a myriad of adversarial threats. We strive to maintain the integrity of our platforms as they scale. Our team is at the front lines of defending against financial abuse, scaled attacks, and other forms of misuse that could undermine the user experience or harm our operational stability The Integrity pillar within Applied Foundations is responsible for the scaled systems that help identify and respond to bad actors and harm on OpenAI’s platforms. As the systems that address some of our most severe usage harms become more mature, we’re adding data scientists to help us measure robustly the prevalence of these problems and the quality of our response to them.

Job Responsibility

  • own measurement and quantitative analysis for a group of severe, actor- and network-based usage harm verticals
  • develop and implement AI-first methods for prevalence measurement and other productionised safety metrics, which may necessarily include off-platform indicators or other non-standard datasets
  • build metrics that can be used for goaling or A/B tests when prevalence or other top line metrics are not suitable
  • own dashboards and metrics reporting for harm verticals
  • conduct analyses and generate insights that inform improvements to review, detection, or enforcement, and that influence roadmaps
  • optimise LLM prompts for the purpose of measurement
  • collaborate w/ other safety teams to understand key safety concerns and create relevant policies that will support safety needs
  • provide metrics for leadership and external reporting
  • develop automation to scale yourself, leveraging our agentic products

Requirements

  • are a senior DS with trust and safety experience that can drive measurement direction
  • have deep statistics skills, specifically around sampling methods and prevalence estimation of complicated problem areas (ideally activity- rather than content-based)
  • have experience working with severe and sensitive harm areas like child safety or violence
  • are an excellent communicator, and have strong cross-functional collaboration skills
  • are capable in data programming languages (R or python, SQL)
  • (ideally) have experience with AI harms or leveraging AI for measurement

Nice to have

have experience with AI harms or leveraging AI for measurement

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Scientist, Integrity Measurement

8 matching positions

Data Scientist, Integrity Measurement

The Integrity pillar within Applied Foundations is responsible for the scaled sy...
Location
Location
United States , San Francisco; New York City
Salary
Salary:
293000.00 - 385000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Senior DS with trust and safety experience that can drive measurement direction
  • Deep statistics skills, specifically around sampling methods and prevalence estimation of complicated problem areas (ideally activity- rather than content-based)
  • Experience working with severe and sensitive harm areas like child safety or violence
  • Excellent communicator, and have strong cross-functional collaboration skills
  • Capable in data programming languages (R or python, SQL)
Job Responsibility
Job Responsibility
  • Own measurement and quantitative analysis for a group of severe, actor- and network-based usage harm verticals
  • Develop and implement AI-first methods for prevalence measurement and other productionised safety metrics, which may necessarily include off-platform indicators or other non-standard datasets
  • Build metrics that can be used for goaling or A/B tests when prevalence or other top line metrics are not suitable
  • Own dashboards and metrics reporting for harm verticals
  • Conduct analyses and generate insights that inform improvements to review, detection, or enforcement, and that influence roadmaps
  • Optimise LLM prompts for the purpose of measurement
  • Collaborate w/ other safety teams to understand key safety concerns and create relevant policies that will support safety needs
  • Provide metrics for leadership and external reporting
  • Develop automation to scale yourself, leveraging our agentic products
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Senior Data Scientist, Platform (Integrity)

This role directly improves the safety, trust, and quality of real-world user ex...
Location
Location
United States
Salary
Salary:
177000.00 - 208000.00 USD / Year
airbnb.com Logo
Airbnb
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of industry experience in a quantitative analysis role with a Master’s degree in a quantitative field (computer science, statistics etc.), or 2+ years of experience with a Ph.D.
  • State-of-the-art knowledge of AI/ML models
  • Hands-on experience building, evaluating, and deploying NLP and LLM-based solutions, including text classification, information extraction, semantic understanding or generative applications
  • Working knowledge of causal inference
  • Skilled in statistical programming (Python or R) and database usage (SQL)
  • Proven ability to communicate clearly and effectively to audiences of varying technical levels
  • Ability to translate complex findings and results into compelling narratives that drive impact
  • Excellent project management, communication, and collaboration skills
Job Responsibility
Job Responsibility
  • Advance Airbnb’s content integrity capabilities by building Natural Language Processing (NLP) and LLM-based models that understand intent, policy compliance, quality and risk across listings, profiles, and user communications
  • Develop high-performing models for detecting problematic or misleading content, including text classification, semantic similarity, information extraction and generative model-based reasoning for policy interpretation and enforcement
  • Design and optimize human-in-the-loop Machine Learning (ML) systems for content review, labeling, escalation and continuous model improvement
  • Build systems to detect emerging content risks and abuse patterns across regions, cohorts and surfaces using statistical, ML and representation-learning approaches
  • Design intelligent sampling and evaluation strategies to measure rare events, policy recall, false positives/negatives and model blind spots in large-scale content systems
  • Build and deploy production AI/ML systems for content integrity and trust content understanding, including feature engineering, model development and evaluation, thresholding, error analysis and end-to-end model lifecycle management
  • Partner with inference data scientists to conduct rigorous quantitative analyses, applying working knowledge of causal inference to interpret results, assess impact, and identify gaps and opportunities to improve content quality and trust outcomes
  • Develop frameworks to analyze tradeoffs between enforcement accuracy, user experience, operational cost and coverage, and propose strategies to optimize overall system effectiveness
  • Deliver robust research reports with effective data visualizations, clear storytelling and bullet-proof accuracy to drive forward impact in collaboration with cross-functional partners in product, engineering and operations
  • Think strategically about how to scale and evolve Airbnb’s content integrity defenses, helping define the long-term vision for the role of AI-driven content understanding across the Trust ecosystem
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Employee Travel Credits
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

The Senior Data Scientist is an applied data science leader within the Data & An...
Location
Location
Canada , Toronto
Salary
Salary:
85000.00 - 125000.00 USD / Year
fourseasons.com Logo
Four Seasons
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of working experience in data science, data wrangling, management, and/or ML engineering
  • University degree in Computer Science, Statistics, Data Science, Applied Mathematics, Engineering, or substantial coursework in relevant quantitative field
  • Applied modeling and analytics: strong foundation in statistics and ML (supervised/unsupervised), feature engineering, and model evaluation
  • ability to explain tradeoffs and drive business decisions
  • Experience in NLP and/or GenAI techniques for applied use cases (e.g., classification, entity extraction, semantic search) with an evaluation-first mindset
  • Data proficiency: advanced SQL and Python
  • strong data wrangling skills (profiling, cleansing, merging, validation) for large, messy datasets
  • Cloud & tooling (preferred): Azure and Databricks ecosystem (e.g., Databricks, Data Factory, Data Lake/Blob, Azure Function App, Azure AI Foundry), with ability to run scalable experimentation and modeling workflows
  • Production readiness (in partnership with Engineering): familiarity with CI/CD, version control (Azure DevOps/GitHub), reproducible pipelines, and monitoring principles for models and data products
  • Visualization & communication: experience using notebooks and BI tools (e.g., Power BI, Tableau, PowerPoint) to tell clear stories to technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Lead Data Science in Designing Prototypes Supporting Commercial Strategy
  • Own applied data science problem framing: translate business goals into clear hypotheses, success metrics, and an analytical approach (e.g., forecasting, propensity, segmentation, optimization, NLP)
  • Lead the design and delivery of data science prototypes aligned to commercial strategy, ensuring measurable business impact (e.g., cost savings, revenue growth, improved guest experience)
  • Define and execute measurement and experimentation plans (e.g., A/B tests, holdouts, quasi-experiments) to quantify incremental impact and guide product/business decisions
  • Plan and manage the data science / ML project pipeline by developing roadmaps, aligning business priorities, communicating tradeoffs, and coordinating dependencies with partners (e.g., Data Engineering, Data Governance, Product/Digital/Business teams)
  • Identify, collect, and validate datasets
  • define data quality checks and partner with data stewards/engineering to ensure data is fit for purpose
  • Design, develop, and evaluate models and prototypes
  • select the best approach balancing accuracy, interpretability, scalability, and business constraints
  • Present insights and recommendations to non-technical and leadership audiences, driving alignment, decision-making, and adoption
  • Fulltime
Read More
Arrow Right

Ic8 Data Scientist, Product Analytics - Cp New Revenue Bets

We're looking for a experienced Data Scientist who can serve as a product analyt...
Location
Location
United States , Menlo Park
Salary
Salary:
253000.00 - 314000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 12+ years of experience in data science, analytics, or a quantitative field
  • Advanced degree (MS/PhD) in Statistics, Economics, Computer Science, or related quantitative discipline
  • Demonstrated company-wide influence, cross-org strategy, and sustained execution on high-complexity problems
  • Proven ability to context-switch across disparate problem domains (growth, monetization, international expansion, AI products) while maintaining high-quality output
  • Track record of setting direction on company-critical problems and influencing cross-org strategy
  • Experience thriving in multi-team, multi-stakeholder environments with the ability to build trust quickly and drive outcomes through influence
  • Comfort operating in early-stage, high-ambiguity environments where metrics, frameworks, and questions haven't been defined yet
  • Ability to synthesize complex analysis into clear narratives for VP+ and cross-functional leadership
Job Responsibility
Job Responsibility
  • Provide senior analytical leadership across New Revenue Bets workstreams - Subscriptions, BizAI, and XF APAC - where it's most needed at any given moment
  • Work directly with VPs and senior cross-functional leaders across the company
  • synthesize complex analysis into actionable insights for executive audiences and shape investment decisions at the highest levels
  • Define measurement frameworks and success metrics for nascent revenue products where playbooks don't yet exist
  • make ambiguity tractable for emerging business models
  • Drive analytical insights on subscriber growth, retention, LTV modeling, pricing/packaging strategy, and product-market fit for Meta's subscription offerings
  • Partner on the data strategy for AI-powered business tools - measurement of AI agent effectiveness, ROI frameworks for business customers, and opportunity sizing for new capabilities
  • Lead cross-functional analytics supporting APAC market expansion - localization insights, regional product-market dynamics, and go-to-market measurement
  • Serve as a unifying analytical voice across multiple teams and workstreams
  • identify shared challenges, propagate learnings, and ensure teams are building on each other's work
What we offer
What we offer
  • bonus
  • equity
  • Fulltime
Read More
Arrow Right
New

Senior Data Scientist

Design, develop, and deploy machine learning models for predictive analytics, cl...
Location
Location
United States , Lincolnshire
Salary
Salary:
145000.00 - 150000.00 USD / Year
advancedtechsearch.com Logo
Advanced Technology Search Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Data Science, Statistics, Mathematics, Engineering, or a related discipline
  • 5+ years of professional experience developing machine learning solutions in production environments
  • Strong experience with Python and PySpark
  • Hands-on experience with Azure Databricks or similar large-scale distributed data processing platforms
  • Experience building and deploying end-to-end machine learning solutions
  • Strong understanding of statistical modelling, regression, classification, clustering, and predictive analytics
  • Experience with time-series forecasting is highly desirable
  • Familiarity with TensorFlow, scikit-learn, MLflow, Spark MLlib, or similar machine learning frameworks
  • Experience working with cloud platforms such as Azure, AWS, or Google Cloud Platform
  • Strong SQL and data engineering skills
Job Responsibility
Job Responsibility
  • Design, develop, and deploy machine learning models for predictive analytics, classification, regression, clustering, and forecasting applications
  • Build scalable machine learning pipelines using Python, PySpark, and cloud-based technologies
  • Perform feature engineering, model evaluation, and optimization using structured and unstructured data
  • Develop production-ready AI and machine learning solutions that integrate with enterprise software platforms
  • Partner with Product Management, Engineering, and business stakeholders to translate business challenges into data-driven solutions
  • Analyze large datasets to identify trends, patterns, and opportunities that improve operational performance and customer outcomes
  • Develop dashboards, visualizations, and analytical tools that communicate insights to technical and non-technical audiences
  • Evaluate emerging machine learning and AI technologies and recommend improvements to existing solutions
  • Support production model monitoring, performance measurement, and continuous model improvement
  • Mentor junior team members and contribute to a collaborative, innovation-driven environment
What we offer
What we offer
  • Competitive compensation, annual bonus, and comprehensive benefits
  • Hybrid work environment with opportunities for continued professional growth
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

Do you thrive on solving complex problems, uncovering insights, and shaping inno...
Location
Location
United States , Multiple Locations
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR equivalent experience.
  • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 7+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR equivalent experience.
  • Proven consulting and stakeholder engagement skills with proven ability to influence decisions.
  • Proficiency in Python and SQL
Job Responsibility
Job Responsibility
  • Own end-to-end delivery of strategic data science projects
  • partner with customers and internal teams to design and implement advanced analytics and AI solutions that create measurable business impact
  • Own delivery of complex, high-impact data science and AI solutions for strategic consulting engagements
  • Collaborate with stakeholders to define business problems and translate them into actionable AI-driven solutions
  • Develop project plans, assess risks, and ensure alignment with strategic objectives and ethical AI principles
  • Identify opportunities to leverage generative AI for business transformation and innovation
  • Acquire, clean, and prepare large datasets for modeling
  • Build and deploy predictive and prescriptive models using modern machine learning techniques
  • Design, develop, and integrate generative AI applications (e.g., text, image, multimodal) into client workflows and solutions
  • Write efficient, maintainable code and ensure scalability for production environments
  • Fulltime
Read More
Arrow Right

Manager Data Scientist

We are seeking an exceptional Data Scientist to join our dynamic Data Science te...
Location
Location
India , Gurgaon
Salary
Salary:
Not provided
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 12+ years of progressive experience in AI/Data Science
  • At least 8 to 10 years of hands-on experience in building AI /ML models for Financial domain
  • Proven track record of design and delivering production-grade AI/ML projects in enterprise environments for finance
  • Experience working with large-scale financial transactional datasets and ERP systems (SAP, Oracle, Workday etc)
  • Demonstrated success in cross-functional collaboration with Finance, IT, and Business teams
  • Hands-on experience in designing and deploying forecasting (Statistical and ML based) applied to financial metrics
  • Experience in enterprise grade implementation of cutting edge Agentic AI solution
  • Taking ownership spans the entire AI delivery lifecycle for project, encompassing the orchestration of multi-agent workflows, Retrieval-Augmented Generation (RAG) architectures, and high-performance LLM integration pipelines
  • Taking responsibility for AI tech stack selection, governance, and the mitigation of stochastic drift or model hallucinations
  • Proven experience in designing and deploying production-ready solutions powered by Large Language Models (LLMs) at enterprise level
Job Responsibility
Job Responsibility
  • Design, develop, and deploy advanced machine learning models to forecast key business KPIs including expense allocation and cash flow management
  • Build automated business process optimization model and reporting systems using AI
  • Design variance analysis frameworks to identify key drivers of financial performance
  • Conduct scenario analysis and sensitivity modelling for strategic initiatives
  • Present findings and recommendations to senior leadership and stakeholders
  • Establish data quality standards and governance frameworks for financial analytics
  • Drive innovation by evaluating and implementing emerging AI/data science technologies
  • Mentor junior team members and foster a culture of data-driven decision making
  • Partner with business leaders to translate complex financial data into actionable insights
What we offer
What we offer
  • Paid Time Off
  • Employee Heath & Well-Being Benefits
  • Continuing Education/ Professional Development
  • Support for Parents
  • Employee Assistance Program
  • Competitive salary package commensurate with experience and market standards
  • Comprehensive health insurance coverage for self and dependents
  • Clear career progression path with regular performance reviews
  • Mentorship from senior leaders and exposure to global projects
  • Collaborative and inclusive culture that values innovation and diversity
  • Fulltime
Read More
Arrow Right

Data Scientist, Product

Meta is seeking a Data Scientist to partner with product teams and drive data-in...
Location
Location
United States , New York
Salary
Salary:
147000.00 - 208000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Experience in data science, applied analytics, or a related quantitative field working on consumer or enterprise products
  • Experience designing and analyzing controlled experiments, including hypothesis formulation, statistical testing, and interpretation of results
  • Experience writing production-quality code in SQL and at least one scripting language such as Python or R to manipulate and analyze large-scale datasets
  • Experience building predictive models using statistical or machine learning techniques and translating model outputs into product recommendations
  • Experience developing data visualizations and self-service dashboards to communicate product performance to diverse stakeholders
Job Responsibility
Job Responsibility
  • Design and evaluate A/B experiments to measure the causal impact of product changes on user behavior and key product metrics
  • Develop and maintain predictive models and statistical frameworks to generate actionable insights that inform product strategy
  • Build scalable data pipelines and self-service visualization interfaces that enable cross-functional partners to explore and interpret product performance data
  • Define success metrics and measurement frameworks that connect product goals to business outcomes
  • Conduct exploratory and confirmatory analyses on large-scale behavioral datasets to identify opportunities and surface risks
  • Collaborate with product managers, engineers, and designers to translate analytical findings into prioritized product decisions
  • Communicate complex analytical results clearly to technical and non-technical stakeholders through written narratives and data presentations
  • Advise cross-functional partners on analytical design, hypothesis formulation, and interpretation of quantitative and qualitative research
  • Integrate AI tools into analytical workflows to accelerate insight generation, improve reproducibility, and expand the scope of analyses
  • Contribute to team-level goal setting by sizing opportunities, tracking operational performance, and identifying gaps in existing measurement approaches
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right