CrawlJobs Logo
Cerebras Systems Logo Cerebras Systems · IT - Software Development

LLM Inference Performance & Evals Engineer

Canada, Toronto · Job Posted February 17, 2026
Apply Position
Job Link Share

Job Description

Join the inference model team dedicated to bring up the state-of-the-art models, numerically validating and accelerating new model ideas on wafer-scale hardware. You will prototype architectural tweaks, build performance-eval pipelines, and turn hard numbers into changes that land in production.

Job Responsibility

  • Prototype and benchmark cutting-edge ideas: new attentions, MoE, speculative decoding, and many more innovations as they emerge
  • Develop agent-driven automation that designs experiments, schedules runs, triages regressions, and drafts pull-requests
  • Work closely with compiler, runtime, and silicon teams: unique opportunity to experience the full stack of software/hardware innovation
  • Keep pace with the latest open- and closed-source models
  • run them first on wafer scale to expose new optimization opportunities

Requirements

  • 3+ years building high-performance ML or systems software
  • Solid grounding in Transformer math—attention scaling, KV-cache, quantisation—or clear evidence you learn this material rapidly
  • Comfort navigating the full AI toolchain: Python modeling code, compiler IRs, performance profiling, etc.
  • Strong debugging skills across performance, numerical accuracy, and runtime integration
  • Prior experience in modeling, compilers or crafting benchmarks or performance studies
  • not just black-box QA tests
  • Strong passion to leverage AI agents or workflow orchestration tools to boost personal productivity

Nice to have

  • Hands-on with flash-attention, Triton kernels, linear-attention, or sparsity research
  • Performance-tuning experience on custom silicon, GPUs, or FPGAs
  • Proficiency in C/C++ programming and experience with low-level optimization
  • Proven experience in compiler development, particularly with LLVM and/or MLIR
  • Publications, repos, or blog posts dissecting model speed-ups
  • Contributions to open-source agent frameworks

What we offer

  • Build a breakthrough AI platform beyond the constraints of the GPU
  • Publish and open source their cutting-edge AI research
  • Work on one of the fastest AI supercomputers in the world
  • Enjoy job stability with startup vitality
  • Our simple, non-corporate work culture that respects individual beliefs
Cerebras Systems - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

LLM Inference Performance & Evals Engineer

8 matching positions

Ai Engineer

We're hiring a senior AI Engineer to design, build, and ship production AI syste...
Location
Location
India , Jaipur
Salary
Salary:
Not provided
HabileLabs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ yrs ML/software engineering
  • 2+ yrs on production AI systems
  • Strong Python
  • PyTorch or TensorFlow
  • LLM fine-tuning: LoRA / QLoRA / PEFT
  • End-to-end ML pipeline experience (train → serve)
  • Cloud (AWS / GCP / Azure) + Docker / Kubernetes
  • ASR & TTS integration in real-time streaming systems
  • VAD, noise suppression, and barge-in handling
  • Telephony APIs (Twilio, Vonage) or WebRTC experience
Job Responsibility
Job Responsibility
  • LLM & GenAI: Fine-tune and deploy LLMs
  • build RAG pipelines and agentic workflows (LangChain, LlamaIndex)
  • Voice Pipelines: Architect real-time ASR → LLM → TTS pipelines with <300 ms latency
  • Voice Agents: Build production voice agents with turn-taking, barge-in handling, and emotion-aware dialogue
  • Speech Fine-Tuning: Adapt ASR/TTS models for domain-specific accents, terminology, and speaking styles
  • MLOps: Build reproducible ML pipelines (Kubeflow / MLflow)
  • maintain CI/CD, monitoring, and model versioning
  • Inference Optimization: Apply quantization (GGUF, GPTQ), distillation, and hardware-aware inference (TensorRT, vLLM) to cut cost and latency
  • APIs & Services: Ship high-performance inference APIs in Python (FastAPI) or Go on Kubernetes
  • Data & Evaluation: Curate text + speech corpora
  • Fulltime
Read More
Arrow Right

Senior Applied AI Engineer, Image Generation

We’re hiring a Senior Applied AI Engineer, Image Generation to join a fast‑movin...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Master’s Degree AND 3+ years of experience in engineering, problem solving, model building, evaluation, data analysis OR equivalent experience.
  • PhD in engineering, applied math, statistics, or related analytical field.
  • 2+ years shipping production-level code, models, or data analysis.
  • 1+ years using AI-assisted coding and analysis techniques.
  • Solid grasp of deep learning: loss functions, optimization, regularization, training stability
  • Experience deploying ML models at scale (inference optimization, quantization, distillation)
  • Familiarity with image preprocessing pipelines, data augmentation, and dataset curation
  • Experience working on small teams and mid-stage startup environments.
  • Experience working on AI products.
Job Responsibility
Job Responsibility
  • Model Development & Training
  • Train, fine-tune, and evaluate image generation models (diffusion, GAN, transformer-based)
  • Implement and adapt techniques from research papers into working production systems
  • Design and run experiments to improve image quality, diversity, and controllability
  • Curate, clean, and manage large-scale image-text training datasets
  • Evaluation, Hillclimbing & Quality Systems
  • Build and maintain evaluation frameworks for correctness, safety, grounding, and UX quality.
  • Run hillclimbing loops across prompts, models, and tool‑use strategies to continuously improve assistant performance.
  • Analyze failure modes, design mitigations, and drive systematic improvements across the stack.
  • LLM Tooling & Internal Infrastructure
  • Fulltime
Read More
Arrow Right

Tech Lead, LLM & Generative AI

At EverAI, we’re shaping what it means to connect with AI. With 40 million users...
Location
Location
Salary
Salary:
Not provided
everai.ai Logo
EverAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of engineering experience with a significant portion dedicated to shipping ML/LLM features to millions of active users
  • Proficient in Python/PyTorch and comfortable with the modern LLM stack (vLLM, HuggingFace, fine-tuning pipelines, eval frameworks)
  • Comfortable working with NSFW content and understanding the technical rigor required to moderate it effectively without breaking the user experience
  • Intuition for Alignment: understanding the physics of LLMs—how prompt conditioning, temperature, and sampling affect the 'soul' of a chatbot
  • Doer Mindset: valuing velocity and distinguishing between a 'perfect' academic solution and a 'shippable' production solution
  • Owner: obsessing over metrics, regressions, and the user experience long after the code has been merged
Job Responsibility
Job Responsibility
  • Ship Code & Lead from the Front: Architect the system and mentor the team, but spend significant time hands-on in the codebase (Python/PyTorch)
  • Own the core chat loop: Optimize context windows, memory/RAG retrieval, and inference latency to ensure a seamless, real-time experience
  • Own the Model Lifecycle: Drive our strategy for SFT (Supervised Fine-Tuning) and RLHF/DPO (Preference Optimization)
  • Manage the 'Data Engine': oversee the sourcing, labeling, and cleaning of diverse datasets to improve model steerability and multicultural performance
  • Architect High-Precision Moderation: Build the immune system of the platform
  • Design and train custom classifiers to detect and filter non-consensual or illegal content within an explicit environment
  • Move beyond binary 'safe/unsafe' flags to create nuanced, context-aware moderation systems
What we offer
What we offer
  • Work From Anywhere: Fully remote
  • Paid Time Off: 4 weeks (20 working days) of PTO per year
  • Annual Gathering: A yearly in-person meetup
  • Health & Wellness Support: Up to $200 per year for wellbeing expenses + unlimited 1:1 sessions with psychologists and lifestyle experts through OpenUp (also available for up to three family members)
  • Co-Working Space Budget: Work from a co-working space up to twice per month (35 EUR / 40 USD per visit)
  • Learning Budget: Dedicated funds to support your professional growth: courses, books, conferences, events, or certifications
  • Equipment: Company laptop provided + monitor budget up to $250 for your workspace setup
  • AI Tools Access: Premium access to ChatGPT, Cursor, Hugging Face, and others
  • Fulltime
Read More
Arrow Right

Tech Lead, LLM & Generative AI

We are looking for a Tech Lead to take the helm of our LLM team (currently 3 eng...
Location
Location
Hungary
Salary
Salary:
Not provided
everai.ai Logo
EverAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of engineering experience, with a significant portion dedicated to shipping ML/LLM features to millions of active users
  • Proficient in Python/PyTorch and comfortable with the modern LLM stack (vLLM, HuggingFace, fine-tuning pipelines, eval frameworks)
  • Comfortable working with NSFW content and understand the technical rigor required to moderate it effectively without breaking the user experience
  • Understand the physics of LLMs—how prompt conditioning, temperature, and sampling affect the 'soul' of a chatbot
  • Can distinguish between a 'perfect' academic solution and a 'shippable' production solution
  • Obsess over metrics, regressions, and the user experience long after the code has been merged
Job Responsibility
Job Responsibility
  • Ship Code & Lead from the Front: Architect the system and mentor the team, but spend significant time hands-on in the codebase (Python/PyTorch)
  • Own the core chat loop: Optimize context windows, memory/RAG retrieval, and inference latency to ensure a seamless, real-time experience
  • Own the Model Lifecycle: Drive our strategy for SFT (Supervised Fine-Tuning) and RLHF/DPO (Preference Optimization)
  • Manage the 'Data Engine': oversee the sourcing, labeling, and cleaning of diverse datasets to improve model steerability and multicultural performance
  • Architect High-Precision Moderation: Build the immune system of the platform
  • Design and train custom classifiers to detect and filter non-consensual or illegal content within an explicit environment
  • Move beyond binary 'safe/unsafe' flags to create nuanced, context-aware moderation systems
What we offer
What we offer
  • Fully remote
  • 4 weeks (20 working days) of PTO per year
  • Annual in-person meetup
  • Up to $200 per year for wellbeing expenses
  • Unlimited 1:1 sessions with psychologists and lifestyle experts through OpenUp (also available for up to three family members)
  • Co-Working Space Budget: Work from a co-working space up to twice per month (35 EUR / 40 USD per visit)
  • Learning Budget: Dedicated funds to support your professional growth: courses, books, conferences, events, or certifications
  • Company laptop provided + monitor budget up to $250 for your workspace setup
  • Premium access to ChatGPT, Cursor, Hugging Face, and others
  • Fulltime
Read More
Arrow Right

Tech Lead, LLM & Generative AI

EverAI is processing 80 million tokens per day and growing. We are looking for a...
Location
Location
Spain
Salary
Salary:
Not provided
everai.ai Logo
EverAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of engineering experience, with a significant portion dedicated to shipping ML/LLM features to millions of active users
  • Proficient in Python/PyTorch and comfortable with the modern LLM stack (vLLM, HuggingFace, fine-tuning pipelines, eval frameworks)
  • Comfortable working with NSFW content and understand the technical rigor required to moderate it effectively without breaking the user experience
  • Intuition for Alignment: understand the physics of LLMs—how prompt conditioning, temperature, and sampling affect the 'soul' of a chatbot
  • Doer Mindset: value velocity, can distinguish between a 'perfect' academic solution and a 'shippable' production solution
  • Owner: obsess over metrics, regressions, and the user experience long after the code has been merged
Job Responsibility
Job Responsibility
  • Ship Code & Lead from the Front: Architect the system and mentor the team, but spend significant time hands-on in the codebase (Python/PyTorch)
  • Own the core chat loop: Optimize context windows, memory/RAG retrieval, and inference latency to ensure a seamless, real-time experience
  • Own the Model Lifecycle: Drive our strategy for SFT (Supervised Fine-Tuning) and RLHF/DPO (Preference Optimization)
  • Manage the 'Data Engine': oversee the sourcing, labeling, and cleaning of diverse datasets to improve model steerability and multicultural performance
  • Architect High-Precision Moderation: Build the immune system of the platform
  • design and train custom classifiers to detect and filter non-consensual or illegal content within an explicit environment
  • Move beyond binary 'safe/unsafe' flags to create nuanced, context-aware moderation systems
What we offer
What we offer
  • Paid Time Off: 4 weeks (20 working days) of PTO per year
  • Annual Gathering: A yearly in-person meetup
  • Health & Wellness Support: Up to $200 per year for wellbeing expenses + unlimited 1:1 sessions with psychologists and lifestyle experts through OpenUp (also available for up to three family members)
  • Co-Working Space Budget: Work from a co-working space up to twice per month (35 EUR / 40 USD per visit)
  • Learning Budget: Dedicated funds to support your professional growth: courses, books, conferences, events, or certifications
  • Equipment: Company laptop provided + monitor budget up to $250 for your workspace setup
  • AI Tools Access: Premium access to ChatGPT, Cursor, Hugging Face, and others
  • Fulltime
Read More
Arrow Right

Tech Lead, LLM & Generative AI

We are looking for a Tech Lead to take the helm of our LLM team (currently 3 eng...
Location
Location
Norway
Salary
Salary:
Not provided
everai.ai Logo
EverAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of engineering experience, with a significant portion dedicated to shipping ML/LLM features to millions of active users
  • Proficient in Python/PyTorch and comfortable with the modern LLM stack (vLLM, HuggingFace, fine-tuning pipelines, eval frameworks)
  • Comfortable working with NSFW content and understand the technical rigor required to moderate it effectively without breaking the user experience
  • Understand the physics of LLMs—how prompt conditioning, temperature, and sampling affect the 'soul' of a chatbot
  • Value velocity
  • can distinguish between a 'perfect' academic solution and a 'shippable' production solution
  • Obsess over metrics, regressions, and the user experience long after the code has been merged
Job Responsibility
Job Responsibility
  • Ship Code & Lead from the Front: Architect the system and mentor the team, but spend significant time hands-on in the codebase (Python/PyTorch)
  • Own the core chat loop: Optimize context windows, memory/RAG retrieval, and inference latency to ensure a seamless, real-time experience
  • Own the Model Lifecycle: Drive our strategy for SFT (Supervised Fine-Tuning) and RLHF/DPO (Preference Optimization)
  • Manage the 'Data Engine': oversee the sourcing, labeling, and cleaning of diverse datasets to improve model steerability and multicultural performance
  • Architect High-Precision Moderation: Build the immune system of the platform
  • design and train custom classifiers to detect and filter non-consensual or illegal content within an explicit environment
  • Move beyond binary 'safe/unsafe' flags to create nuanced, context-aware moderation systems
What we offer
What we offer
  • Fully remote
  • 4 weeks (20 working days) of PTO per year
  • Annual in-person meetup
  • Up to $200 per year for wellbeing expenses
  • Unlimited 1:1 sessions with psychologists and lifestyle experts through OpenUp (also available for up to three family members)
  • Co-Working Space Budget: Work from a co-working space up to twice per month (35 EUR / 40 USD per visit)
  • Learning Budget: Dedicated funds to support your professional growth
  • Company laptop provided + monitor budget up to $250 for your workspace setup
  • AI Tools Access: Premium access to ChatGPT, Cursor, Hugging Face, and others
  • Fulltime
Read More
Arrow Right

Tech Lead, LLM & Generative AI

At EverAI, we’re shaping what it means to connect with AI. With 40 million users...
Location
Location
Serbia
Salary
Salary:
Not provided
everai.ai Logo
EverAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of engineering experience, with a significant portion dedicated to shipping ML/LLM features to millions of active users
  • Proficient in Python/PyTorch and comfortable with the modern LLM stack (vLLM, HuggingFace, fine-tuning pipelines, eval frameworks)
  • Comfortable working with NSFW content and understand the technical rigor required to moderate it effectively without breaking the user experience
  • Understand the physics of LLMs—how prompt conditioning, temperature, and sampling affect the 'soul' of a chatbot
  • Value velocity
  • can distinguish between a 'perfect' academic solution and a 'shippable' production solution
  • Obsess over metrics, regressions, and the user experience long after the code has been merged
Job Responsibility
Job Responsibility
  • Ship Code & Lead from the Front: Architect the system and mentor the team, but spend significant time hands-on in the codebase (Python/PyTorch)
  • Own the core chat loop: Optimize context windows, memory/RAG retrieval, and inference latency to ensure a seamless, real-time experience
  • Own the Model Lifecycle: Drive our strategy for SFT (Supervised Fine-Tuning) and RLHF/DPO (Preference Optimization)
  • Manage the 'Data Engine': oversee the sourcing, labeling, and cleaning of diverse datasets to improve model steerability and multicultural performance
  • Architect High-Precision Moderation: Build the immune system of the platform
  • design and train custom classifiers to detect and filter non-consensual or illegal content within an explicit environment
  • Move beyond binary 'safe/unsafe' flags to create nuanced, context-aware moderation systems
What we offer
What we offer
  • Fully remote
  • 4 weeks (20 working days) of PTO per year
  • Annual in-person meetup
  • Up to $200 per year for wellbeing expenses
  • Unlimited 1:1 sessions with psychologists and lifestyle experts through OpenUp (also available for up to three family members)
  • Co-Working Space Budget: Work from a co-working space up to twice per month (35 EUR / 40 USD per visit)
  • Learning Budget: Dedicated funds to support your professional growth
  • Company laptop provided + monitor budget up to $250 for your workspace setup
  • Premium access to ChatGPT, Cursor, Hugging Face, and others
  • Fulltime
Read More
Arrow Right

Tech Lead, LLM & Generative AI

We are looking for a Tech Lead to take the helm of our LLM team (currently 3 eng...
Location
Location
Romania
Salary
Salary:
Not provided
everai.ai Logo
EverAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of engineering experience, with a significant portion dedicated to shipping ML/LLM features to millions of active users
  • Proficient in Python/PyTorch and comfortable with the modern LLM stack (vLLM, HuggingFace, fine-tuning pipelines, eval frameworks)
  • Comfortable working with NSFW content and understand the technical rigor required to moderate it effectively without breaking the user experience
  • Intuition for Alignment: understand the physics of LLMs—how prompt conditioning, temperature, and sampling affect the 'soul' of a chatbot
  • Doer Mindset: value velocity, can distinguish between a 'perfect' academic solution and a 'shippable' production solution
  • Owner: obsess over metrics, regressions, and the user experience long after the code has been merged
Job Responsibility
Job Responsibility
  • Ship Code & Lead from the Front: Architect the system and mentor the team, but spend significant time hands-on in the codebase (Python/PyTorch)
  • Own the core chat loop: Optimize context windows, memory/RAG retrieval, and inference latency to ensure a seamless, real-time experience
  • Own the Model Lifecycle: Drive our strategy for SFT (Supervised Fine-Tuning) and RLHF/DPO (Preference Optimization)
  • Manage the 'Data Engine': oversee the sourcing, labeling, and cleaning of diverse datasets to improve model steerability and multicultural performance
  • Architect High-Precision Moderation: Build the immune system of the platform
  • Design and train custom classifiers to detect and filter non-consensual or illegal content within an explicit environment
  • Move beyond binary 'safe/unsafe' flags to create nuanced, context-aware moderation systems
What we offer
What we offer
  • Fully remote
  • 4 weeks (20 working days) of PTO per year
  • Annual Gathering: A yearly in-person meetup
  • Health & Wellness Support: Up to $200 per year for wellbeing expenses + unlimited 1:1 sessions with psychologists and lifestyle experts through OpenUp (also available for up to three family members)
  • Co-Working Space Budget: Work from a co-working space up to twice per month (35 EUR / 40 USD per visit)
  • Learning Budget: Dedicated funds to support your professional growth: courses, books, conferences, events, or certifications
  • Equipment: Company laptop provided + monitor budget up to $250 for your workspace setup
  • AI Tools Access: Premium access to ChatGPT, Cursor, Hugging Face, and others
  • Fulltime
Read More
Arrow Right