Member of Technical Staff, Pre-Training Data

• Conduct data ablations to assess data quality and experiment with data mixtures to enhance model performance
• Develop robust data modeling techniques to ensure datasets are structured and formatted for optimal training efficiency
• Research and implement innovative data curation methods, leveraging Cohere’s infrastructure to drive advancements in natural language processing
• Collaborate with cross-functional teams, including researchers and engineers, to ensure data pipelines meet the demands of cutting-edge language models

• Strong software engineering skills, with proficiency in Python and experience building data pipelines
• Familiarity with curriculum learning, data mixing and data attribution
• Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools
• Experience working with large-scale datasets, including web data, code data, and multilingual corpora
• Knowledge of data quality assessment techniques and experimentation with data mixtures
• A passion for bridging research and engineering to solve complex data-related challenges in AI model training

Bonus: paper at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)

• An open and inclusive culture and work environment
• Work closely with a team on the cutting edge of AI research
• Weekly lunch stipend, in-office lunches & snacks
• Full health and dental benefits, including a separate budget to take care of your mental health
• 100% Parental Leave top-up for up to 6 months
• Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
• Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
• 6 weeks of vacation (30 working days!)