HPC AI Benchmark specialist

• AI benchmark analysis: Literature review on the application considered
• Code exploration (if available)
• Match between hardware architecture and hyperparameters
• Benchmark preparation: Software environment (usually in a container)
• Training and job scripts
• Dataset preparation
• Hyperparameter search
• Documentation
• Benchmark execution and performance estimation: Test executions
• Analysis
• Reports

• Relevant degree in higher education or university
• Ideally, several years of experience in the field of AI
• Autonomous with team spirit
• Good understanding of the fundamentals of deep learning
• Experience in training classic neural network architectures (MLP, CNN, RNN)
• Transformers and LLM
• Large-scale distributed training strategies (parallel data, parallel tensors, parallel pipelines, FSPD, DeepSpeed, ..)
• Containers (docker, singularity)
• Job scheduler (SLURM mainly)
• Knowledge of architectures will be a plus (GPU, Network, storage)
• Python
• Bash
• PyTorch, TensorFlow
• Strong resilience and an ability to question things
• Strong sense of curiosity
• Ability to work closely with other team members
• Ability to take your own initiative
• Strong-willed and questioning by nature
• Know how to technically solve complex optimization problems
• Organized and rigorous in your approach
• Able to balance time and priorities
• Maintaining an open dialogue to find the best compromise for a given problem

Knowledge of architectures will be a plus (GPU, Network, storage)