CrawlJobs Logo

Senior Runtime Engineer

United States; Canada, Sunnyvale · Job Posted February 17, 2026
Apply Position
Job Link Share

Job Description

We are building the next generation of large-scale AI systems that power training and inference workloads at unprecedented scale and efficiency. You will design and develop high-performance distributed software that orchestrates massive compute and data pipelines across heterogeneous clusters. Your work will push the limits of concurrency, throughput, and scalability—enabling efficient execution of models at massive scale. This role sits at the intersection of systems engineering and machine learning performance, demanding both architectural depth and low-level implementation skills. You will help shape how models are executed and optimized end-to-end, from data ingestion to distributed execution, across cutting-edge hardware platforms. We’re hiring for runtime roles across both Training and Inference.

Job Responsibility

  • Design and implement distributed runtime components to efficiently manage large-scale execution workloads
  • Develop and optimize high-performance data and communication pipelines that fully utilize CPU, memory, storage, and network resources
  • Enable scalable execution across multiple compute nodes, ensuring high concurrency and minimal bottlenecks
  • Collaborate closely with ML and compiler teams to integrate new model architectures, training regimes, and hardware-specific optimizations
  • Diagnose and resolve complex performance issues across the software stack using profiling and instrumentation tools
  • Contribute to overall system design, architecture reviews, and roadmap planning for large-scale AI workloads

Requirements

  • 3+ years of experience developing high-performance or distributed system software
  • Strong programming skills in C/C++, with expertise in multi-threading, memory management, and performance optimization
  • Experience with distributed systems, networking, or inter-process communication
  • Solid understanding of data structures, concurrency, and system-level resource management (CPU, I/O, and memory)
  • Proven ability to debug, profile, and optimize code across scales—from threads to clusters
  • Bachelor’s, Master’s, or equivalent experience in Computer Science, Electrical Engineering, or related field

Nice to have

  • Familiarity with machine learning training or inference pipelines, especially distributed training and large-model scaling
  • Exposure to Python and PyTorch, particularly in the context of model training or performance tuning
  • Experience with compiler internals, custom hardware interfaces, or low-level protocol design
  • Prior work on high-performance clusters, HPC systems, or custom hardware/software co-design
  • Deep curiosity about how to unlock new levels of performance for large-scale AI workloads

What we offer

  • Build a breakthrough AI platform beyond the constraints of the GPU
  • Publish and open source their cutting-edge AI research
  • Work on one of the fastest AI supercomputers in the world
  • Enjoy job stability with startup vitality
  • Our simple, non-corporate work culture that respects individual beliefs

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Runtime Engineer

8 matching positions

Senior Inference ML Runtime Engineer

The Inference ML Engineering team at Cerebras Systems is dedicated to enabling o...
Location
Location
United States; Canada , Sunnyvale; Toronto
Salary
Salary:
Not provided
cerebras.net Logo
Cerebras Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Mathematics, or a related field
  • 8+ years of experience in large-scale software engineering, with a focus on deep learning or related domains
  • Proficiency in Python for building and maintaining scalable systems
  • Advanced proficiency in C++, with an emphasis on multi-threaded programming, performance optimization, and system-level development
  • Demonstrated experience driving cross-functional projects
  • Experience building and scaling large-scale inference systems for LLMs or multimodal models
  • Familiarity with LLM serving frameworks, such as vLLM, SGLang, and TensorRT-LLM
  • Solid understanding of software architectural patterns for large-scale, high-performance applications
  • Hands-on experience with ML frameworks, such as PyTorch, and a strong understanding of their underlying architectures
  • Strong problem-solving skills, with the ability to balance technical depth with practical implementation constraints
Job Responsibility
Job Responsibility
  • Drive and provide technical guidance to a team of software engineers working on complex machine learning integration projects
  • Design and implement ML features (e.g., structured outputs, biased sampling, predicted outputs) that improve performance of generative AI models at inference time
  • Design and implement high-throughput, low-latency multimodal inference models that support delivery of image, audio, and video inputs and outputs
  • Maintain our scalable serving backend for handling many concurrent requests per minute
  • Scale our inference service by implementing detailed observability throughout the entire stack
  • Analyze and improve latency, throughput, memory usage, and compute efficiency on the service and the implementation of various features
  • Optimize software to accelerate generative LLM inference by achieving high throughput and low latency
  • Stay up-to-date with advancements in machine learning and deep learning, and apply state-of-the-art techniques to enhance our solutions
  • Evaluate trade-offs between different approaches, clearly articulate design choices, and develop detailed proposals for implementing new features
  • Uncover, scope, and prioritize significant areas of technical debt across the software stack to ensure continued high quality of the inference service
What we offer
What we offer
  • Build a breakthrough AI platform beyond the constraints of the GPU
  • Publish and open source their cutting-edge AI research
  • Work on one of the fastest AI supercomputers in the world
  • Enjoy job stability with startup vitality
  • Our simple, non-corporate work culture that respects individual beliefs
Read More
Arrow Right

Senior Software Engineer / Principal Software Engineer - Copilot CLI

Within GitHub and Microsoft CoreAI, the Copilot CLI team builds GitHub's coding ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years
Job Responsibility
Job Responsibility
  • Take ownership of critical product and platform areas of the Copilot CLI and shared agent runtime
  • Set a high technical and quality bar for agentic systems and developer-facing tooling
  • Design and ship performant, reliable terminal experiences that developers depend on for daily work
  • Use data, benchmarks, and direct user feedback to guide iteration and investment
  • Collaborate across org boundaries to enable other teams to build agentic products on top of a shared foundation
  • Influence architecture, technical direction, and engineering standards beyond your immediate team
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation
  • Fulltime
Read More
Arrow Right

Digital Software Engineer Senior Analyst

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in product development/product management environment, with a strong background in developing single-page applications using Angular 19+
  • Strong analytical and quantitative skills
  • Data driven and results-oriented
  • Experience delivering with an agile methodology
  • Experience in affecting large culture change
  • Experience leading infrastructure programs
  • Skilled at working with third party service providers
  • Excellent written and oral communication skills
  • Knowledge of Node.js scripting, Webpack, esbuild, Unit Testing, Integration Testing, Modfed, and shell scripting
  • Experience with Angular Library package development
Job Responsibility
Job Responsibility
  • Accountable for executing and driving mid-size feature application design and development efforts to completion, serving as a development lead on medium-scale projects and supporting the execution of larger efforts, specifically focusing on complex Angular applications and component development
  • Proficient at operating with considerable autonomy and discretion as you will significantly influence the way an application is designed and developed by providing subject specific expertise and an advanced level of understanding of application programming principles, especially within the Angular framework and its ecosystem
  • Sought after due to ability to analyze and troubleshoot coding, application performance and design challenges, with a particular focus on optimizing Angular application performance, scalability, and maintainability
  • Capable of research in root cause of development and performance concerns as well as the resolution of defects in frontend Angular applications
  • Have a deep understanding of the technical requirements for the solutions being built, including Angular best practices, state management patterns (e.g., NgRx), and modular architecture
  • Understand engineering needs including those required to build, maintain, and operate the system through all phases of its life, with an emphasis on efficient Angular development workflows, build processes, and deployment strategies
  • Proficient in information modeling, data structures and algorithms, applied to frontend data handling and complex UI interactions within Angular
  • Understand maintenance characteristics, runtime properties and dependencies that exist in support of your system’s software
  • Demonstrate an advanced understanding of supported main system flows and possess a comprehensive understanding of how the system and others (i.e. architecture or infrastructure) collectively integrate to contribute towards achieving business objectives
  • Participate in design discussions as a Development Lead and as such will play the part of a key decision maker in driving design decisions, especially concerning Angular application architecture, component design, and integration patterns
  • Fulltime
Read More
Arrow Right

Senior Engineer, Quantum Algorithms

We are looking for a Software Engineer with deep expertise in Mathematical Optim...
Location
Location
United States , Hoboken
Salary
Salary:
Not provided
Quantum Computing Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in software engineering with a focus on systems or HPC
  • Strong proficiency in C++ and Python
  • Experience with quantum algorithms, quantum information, or quantum optics
  • Strong mathematical background in Convex Optimization, Quadratic Programming (QP), Mixed-Integer Linear Programming (MILP), or Gradient-Free Methods
  • Experience with Numerical Analysis and high-performance math libraries (e.g., BLAS, LAPACK, Eigen)
  • Familiarity with protocols (e.g., UART, SPI, gRPC, REST) and software integration
  • Strong understanding of performance tuning, memory management, and fault-tolerant design
  • Familiarity with Linux system programming and build toolchains (CMake, GCC/Clang)
  • Experience working in cross-functional teams involving hardware, physics, and software.
Job Responsibility
Job Responsibility
  • Design and implement the high-performance C++ runtime and Hardware Abstraction Layer (HAL) for photonic optimization computers
  • Profile and optimize critical execution paths to minimize latency, addressing bottlenecks in memory bandwidth, cache locality, and data transfer
  • Collaborate with FPGA, Electrical engineers and Firmware engineers to ensure to create, test, and optimize device interfaces
  • Develop algorithmic enhancements to usage of quantum feedback to solve NP hard optimization problems more efficiently with higher solution quality
  • Write efficient, thread-safe code for concurrent hardware control and real-time signal processing
  • Design and implement novel algorithms that map optimization and machine-learning problems onto entropy-based photonic quantum processors, including post-processing pipelines
  • Build software layers to decompose and orchestrate large-scale optimization problems across multiple photonic hardware resources
  • Contribute to quantum algorithms on the company roadmap
  • Fulltime
Read More
Arrow Right

Digital Software Engineer Senior Analyst - Assistant Vice President

Location
Location
United States , Tampa
Salary
Salary:
96960.00 - 145440.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
August 31, 2026
Flip Icon
Requirements
Requirements
  • 5-8 years experience with PL/SQL, Oracle and integration with Java applications
  • Exposure to architecture experience in building horizontally scalable, highly available, highly resilient, and low latency applications
  • Experience with data engineering techniques like building data lakes and data warehouses, data mesh, data pipelines, ETL vs. ELT
  • Exposure to Cloud infrastructure both on-premise and public cloud (i.e., OpenShift, AWS, Snowflake, Databricks)
  • Exposure to Continuous Integration and Continuous Delivery (CI/CD) pipelines, either on-premise or public cloud (i.e., Tekton, Harness, CircleCI, Cloudbees Jenkins, etc.)
  • Exposure to API Management tools
  • Exposure to Infrastructure as Code tools (i.e., IntelliJ, Cloudformation, PiSpark, etc.)
  • Experience mentoring junior developers
Job Responsibility
Job Responsibility
  • Accountable for executing and driving mid-size feature application design and development efforts to completion, serving as a development lead on medium-scale projects and supporting the execution of larger efforts
  • Proficient at operating with considerable autonomy and discretion as you will significantly influence the way an application is designed and developed by providing subject specific expertise and an advanced level of understanding of application programming principles
  • Sought after due to ability to analyze and troubleshoot coding, application performance and design challenges
  • Capable of research in root cause of development and performance concerns as well as the resolution of defects
  • Have a deep understanding of the technical requirements for the solutions being built
  • Understand engineering needs including those required to build, maintain, and operate the system through all phases of its life
  • Proficient in information modeling, data structures and algorithms
  • Understand maintenance characteristics, runtime properties and dependencies that exist in support of your system’s software
  • Demonstrate an advanced understanding of supported main system flows and possess a comprehensive understanding of how the system and others collectively integrate to contribute towards achieving business objectives
  • Participate in design discussions as a Development Lead and as such will play the part of a key decision maker in driving design decisions
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • planned time off (vacation)
  • unplanned time off (sick leave)
  • paid holidays
  • Fulltime
Read More
Arrow Right

Digital Software Engineer Senior Analyst – Assistant Vice President

The Digital S/W Engineer Sr Analyst is a seasoned professional role. Applies in-...
Location
Location
India , Pune, Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years in a product development/product management environment
  • Strong analytical and quantitative skills
  • Data driven and results-oriented
  • Strong coding skills in Java
  • Hands on experience in API, Microservices, Angular / React
  • Experience delivering with an agile methodology
  • Experience in affecting large culture change
  • Experience leading infrastructure programs
  • Skilled at working with third party service providers
  • Excellent written and oral communication skills
Job Responsibility
Job Responsibility
  • Accountable for executing and driving mid-size feature application design and development efforts to completion, serving as a development lead on medium-scale projects and supporting the execution of larger efforts
  • Proficient at operating with considerable autonomy and discretion as you will significantly influence the way an application is designed and developed by providing subject specific expertise and an advanced level of understanding of application programming principles
  • Sought after due to ability to analyze and troubleshoot coding, application performance and design challenges
  • Capable of research in root cause of development and performance concerns as well as the resolution of defects
  • Have a deep understanding of the technical requirements for the solutions being built
  • Understand engineering needs including those required to build, maintain, and operate the system through all phases of its life
  • Proficient in information modeling, data structures and algorithms
  • Understand maintenance characteristics, runtime properties and dependencies that exist in support of your system’s software
  • Demonstrate an advanced understanding of supported main system flows and possess a comprehensive understanding of how the system and others collectively integrate to contribute towards achieving business objectives
  • Participate in design discussions as a Development Lead and as such will play the part of a key decision maker in driving design decisions
  • Fulltime
Read More
Arrow Right

DevOps Principle Engineer Senior VP

TheDevOps Principle Engineeris a highly skilled and hands-on technical leader re...
Location
Location
India , Chennai; Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s/University degree in Computer Science, Computer or Electronics Engineering, Information Technology, or a related discipline. Master’s degree preferred
  • Minimum 15+ years of relevant experience in DevOps platform services with subject matter expertise in principle engineering
  • Proven hands-on expertise in establishing and implementing new technologies, design patterns, and frameworks
  • Passion for engineering, automation, standardization, and best practices
  • Deep understanding and extensive hands-on experience of software development tools, CICD Pipelines and deployment strategies and their underlying principles
  • Expertise in containerization (Docker) and orchestration (Kubernetes, OpenShift)
  • Experience with scripting languages (Python/Bash shell) for dynamic cloud infrastructure automation
  • Self-motivated, excellent communication skills (written and verbal), and strong interpersonal skills with the ability to influence and collaborate across diverse teams
  • Ability to appropriately assess risk in technical decisions, demonstrating consideration for the firm's reputation and compliance with Citi policies and regulations
  • Proficient with JIRA, Bitbucket, Github Enterprise, Jenkins, Teamcity, uDeploy, Tekton, Harness, RLM, Release-on-Demand (ROD)
Job Responsibility
Job Responsibility
  • Define and champion the technical strategy for DevOps platforms and services, aligning with global Citi Technology standards and organizational objectives
  • Lead the design and implementation of new technologies and design patterns for experience platform services, with strong emphasis on driving the migration of legacy pipeline infrastructure to modern, scalable, and secure platforms
  • Establish and certify best practices for containerizing existing applications for deploying onto Internal or external cloud platforms
  • Develop cohesive interpersonal working relationships with peers and team members, Engineering partners and internal customers fostering a collaborative environment for achieving the delivery expectations
  • Lead efforts in process re-engineering within the DevOps domain to eliminate bottlenecks, streamline workflows, and drive continuous improvement
  • Lead the Team of Junior engineers and team members located in Chennai and Pune
  • Work as Site-lead for Devops team in India to drive adoption, share knowledge and provide key management updates to local site leadership
  • Drive Adoption of standard tools and pipelines inline with organizational targets
  • Lead the support of application production releases, focusing on zero-touch deployments and automated rollbacks
  • Optimize pipeline services for reliability, responsiveness, runtime footprint, and recoverability using performance engineering and memory profiling tools
  • Fulltime
Read More
Arrow Right

Digital Software Engineer Senior Analyst

The Digital S/W Engineer Sr Analyst is a seasoned professional role. Applies in-...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years in a product development/product management environment in Devops
  • DevOps Engineer who has worked in and advocated for agile environments
  • Proficiency: Groovy / fluent in Python and Python testing best practices
  • Jenkins configuration using Groovy or Python
  • Various managed and self-hosted CI / CD tools
  • Strong analytical and quantitative skills
  • Data driven and results-oriented
  • Experience delivering with an agile methodology
  • Experience in affecting large culture change
  • Experience leading infrastructure programs
Job Responsibility
Job Responsibility
  • Accountable for executing and driving mid-size feature application design and development efforts to completion, serving as a development lead on medium-scale projects and supporting the execution of larger efforts
  • Proficient at operating with considerable autonomy and discretion as you will significantly influence the way an application is designed and developed by providing subject specific expertise and an advanced level of understanding of application programming principles
  • Sought after due to ability to analyze and troubleshoot coding, application performance and design challenges
  • Capable of research in root cause of development and performance concerns as well as the resolution of defects
  • Have a deep understanding of the technical requirements for the solutions being built
  • Understand engineering needs including those required to build, maintain, and operate the system through all phases of its life
  • Proficient in information modeling, data structures and algorithms
  • Understand maintenance characteristics, runtime properties and dependencies that exist in support of your system’s software
  • Demonstrate an advanced understanding of supported main system flows and possess a comprehensive understanding of how the system and others collectively integrate to contribute towards achieving business objectives
  • Participate in design discussions as a Development Lead and as such will play the part of a key decision maker in driving design decisions
  • Fulltime
Read More
Arrow Right