This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Amazon Devices is an inventive research and development company that designs and engineer high-profile devices like Echo, Fire Tablets, Fire TV, and other consumer devices. We are looking for exceptional scientists to join our Applied Science team to advance the state-of-the-art in developing efficient multimodal language models across our product portfolio. Through close hardware-software integration, we design and train models for resource efficiency across the hardware and software tech stack. The Silicon and Solutions Group Edge AI team is looking for a talented Applied Scientist who will develop new evaluation methods for multimodal language models and agents for our devices, including audio and vision experiences.
Job Responsibility
Collaborate with cross-functional engineers and scientists to advance the state of the art in multimodal model evaluations for devices, including audio, images, and videos
Invent and validate reliability for novel automated evaluation methods for perception tasks, such as fine-tuned LLM-as-judge
Develop and extend our evaluation framework(s) to support expanding capabilities for multimodal language models
Analyze large offline and online datasets to understand model gaps, develop methods to interpret model failures, and collaborate with training teams to enhance model capabilities for product use cases
Work closely with other scientists, compiler engineers, data collection, and product teams to advance evaluation methods
Requirements
PhD, or a Master's degree and experience in CS, CE, ML or related field
Experience in patents or publications at top-tier peer-reviewed conferences or journals
Experience programming in Java, C++, Python or related language
Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing
Experience in building machine learning models for business application