ML Research Engineer, ML Systems

• Build, profile and optimize our training and inference framework
• Collaborate with ML teams to accelerate their research and development and enable them to develop the next generation of models and data curation
• Research and integrate state-of-the-art technologies to optimize our ML system

• Strong excitement about system optimization
• Experience with multi-node LLM training and inference
• Experience with developing large-scale distributed ML systems
• Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers, flash attention, etc.
• Strong written and verbal communication skills and the ability to operate in a cross functional team environment

Demonstrated expertise in post-training methods &/or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc.

• Comprehensive health, dental and vision coverage
• retirement benefits
• a learning and development stipend
• generous PTO
• additional benefits such as a commuter stipend
• equity based compensation