This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
As a Research Engineer, you will be a core contributor to Zyphra’s AI Architecture Research Team.
Job Responsibility:
Designing and rigorously testing novel model architectures and training methodologies, focusing on improving core modelling capabilities (in loss per flop or loss per parameter) and on solving fundamental bottlenecks in contemporary models
Interface extremely closely with our pretraining team, who will be integrating your insights into our next generation of models
Requirements:
Previous research experience in designing novel architectures such as state-space models, diffusion models, MoEs, and others
Previous experience with long-term memory, RAG/retrieval systems, dynamic/adaptive computation, and alternative approaches to credit assignment
Experience with reinforcement learning, control theory, and signal processing
Understanding of modern training pipelines and the hardware requirements to design efficient architectures for GPU hardware
Strong grasp of proper experimental methodology for running rigorous ablations and other hypothesis testing
High proficiency with PyTorch and Python
Strong ability to jump into large pre-existing codebases and rapidly get up to speed and become productive
Previously published machine learning research in well-respected venues
Postgraduate degree in a scientific subject (Computer Science, EE/EECS, Math, Physics)
Nice to have:
Strong research taste and intuition
The ability to work through a research project from conception to execution to write-up
Strong implementation and prototyping skillset
A researcher who can take an idea from conception to experimentation extremely quickly
The ability to work well and cooperate with others in a high-paced research setting
Curiosity, interest, and joy in understanding intelligence
Generally, a joy in inventing and seriously assessing ‘crazy’ ideas, and the ability to have a unique perspective on things
What we offer:
Comprehensive medical, dental, vision, and FSA plans
Competitive compensation and 401(k)
Relocation and immigration support on a case-by-case basis
On-site meals prepared by a dedicated culinary team
Thursday Happy Hours
In-person team in Palo Alto, CA, with a collaborative, high-energy environment