This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Silicon Valley’s top AI companies work with Mercor to find domain experts who can help train and evaluate their models. As a researcher at Mercor, you will be responsible for advancing the frontier of model evaluations to drive model improvements across the industry that create real world economic value. You will be frequently publishing impactful papers with industry leading collaborators, have ample resources to create high-impact datasets, and access to the frontier of evaluation and training data. You will work closely with Mercor’s Forward Deployed Research, Applied AI, and Operations teams, and have unmatched access to evaluate frontier models
Job Responsibility:
Build benchmarks that measure real world value of AI models
Publish LLM evaluation papers in top conferences with the support of the Mercor Applied AI and Operations teams
Push the frontier of understanding data ROI in model development including multi-modality, code, tool-use, and more
Design and validate novel data collection and annotation offerings for the leading industry labs and big tech companies
Requirements:
PhD or M.S. and 2+ years of work experience in a computer science, electrical engineering, econometrics, or another STEM field that provides a solid understanding of ML and model evaluation
Strong publication record in AI research, ideally in LLM evaluation. Dataset and evaluation papers are preferred
Strong understanding of LLMs and the data on which they are trained and evaluated against
Strong communication skills and ability to present findings clearly and concisely
Familiarity with data annotation workflows
Good understanding of statistics
Willingness to work 6 days a week, with monday-friday in person in San Francisco
What we offer:
Offers Equity
A $20K relocation bonus (if moving to the Bay Area)
A $10K housing bonus (if you live within 0.5 miles of our office)