This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems.
Job Responsibility:
Lead the development of comprehensive quality strategies and auditing frameworks
Design auditing strategies with detailed SOPs, quality metrics, and sampling methodologies
Perform expert-level manual audits
Conduct meta-audits to evaluate auditor performance
Provide targeted coaching to uplift overall quality capabilities
Develop and maintain LLM-as-a-Judge systems
Set up the configuration of data collection workflows
Communicate quality feedback to stakeholders
Requirements:
Master's degree in computer science, mathematics, statistics, machine learning or equivalent quantitative field
Experience programming in Java, C++, Python or related language
Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse
Nice to have:
Experience implementing algorithms using both toolkits and self-developed code
Have publications at top-tier peer-reviewed conferences or journals
What we offer:
Sign-on payments
Restricted stock units (RSUs)
Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)