Senior/Staff Machine Learning Engineer - Health Evaluation - AI Teams

• Define and own the evaluation strategy for our AI agentic system - metrics, protocols, datasets, and tooling
• Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment across iterations
• Run systematic experiments to assess reasoning, factuality, robustness, and user experience
• Collaborate closely with model developers and research scientists to provide insights and drive iterative improvement
• Contribute to research and internal knowledge sharing on LLM evaluation methodologies and best practices

• MSc or PhD in Computer Science, Machine Learning, Data Science, or related field
• 7+ years of hands-on experience working with large language models (e.g., GPT, Claude, Llama, or BERT-like architectures)
• Proven experience in evaluating agentic or reasoning systems (e.g., autonomous agents, tool-using LLMs, dialogue systems, or task-oriented assistants)
• Strong track record in experiment design, metric definition, and evaluation automation
• Ability to bridge research and production, influencing modeling and product decisions
• Excellent communication skills and a collaborative mindset

Experience in the clinical or medical domain and sensitivity to ethical or regulatory challenges in healthcare AI

• Free health insurance for you and your children
• Parent Care Program: receive one additional month of leave on top of the legal parental leave
• Free mental health and coaching services through our partner Moka.care
• For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
• Work from EU countries and the UK for up to 10 days per year, thanks to our flexibility days policy
• Work Council subsidy to refund part of sport club membership or creative class
• Up to 14 days of RTT
• Lunch voucher with Swile card