CrawlJobs Logo

Senior Software Engineer - Together Cloud Infrastructure

United States, San Francisco 160000.00 - 230000.00 USD / Year · Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior AI Infrastructure Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables state-of-the-art ML practitioners with self-serve AI cloud services, such as on-demand + managed Kubernetes and Slurm clusters. This platform serves both our internal SaaS products (inference, fine-tuning) and our external cloud customers, spanning dozens of data centers across the world.

Job Responsibility

  • Design, build, and maintain performant, secure, and highly-available backend services/operators that run in our data centers and automate hardware management, such as Infiniband partitioning, in-DC parallel storage provisioning, and VM provisioning
  • Design and build out the IaaS software layer for a new GB200 data center with thousands of GPUs
  • Work on a global multi-exabyte high-performance object store, serving massive datasets for pretraining
  • Build advanced observability stacks for our customers with automated node lifecycle management for fault-tolerant distributed pretraining
  • Perform architecture and research work for decentralized AI workloads
  • Work on the core, open-source Together AI platform
  • Create services, tools, and developer documentation
  • Create testing frameworks for robustness and fault-tolerance

Requirements

  • 5+ years of professional software development experience and proficiency in at least one backend programming language (Golang desired)
  • 5+ years experience writing high-performance, well-tested, production quality code
  • Demonstrated experience with building and operating high-performance and/or globally distributed micro-service architectures across one or more cloud providers (AWS, Azure, GCP)
  • Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
  • Deep experience with Kubernetes internals a big plus, such as implementing non-trivial Kubernetes operators, device/storage/network plugins, custom schedulers, or patches thereon or Kubernetes itself
  • Deep experience with VMs/hypervisors a big plus, such as QEMU/KVM, cloud-hypervisor, VFIO, virtio, PCIE passthrough, Kubevirt, SR-IOV
  • Deep experience with DC networking tech + solutions a big plus, such as VLAN, VXLAN, VPN, VPC, OVS/OVN
  • Experience with Cluster API or similar a big plus
  • Experience working on high-performance compute, networking, and/or storage a big plus
  • Experience virtualizing GPUs and/or Infiniband a big plus
  • Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
  • Experience with infrastructure automation tools (Terraform, Ansible), monitoring/observability stacks (Prometheus, Grafana), and CI/CD pipelines (GitHub Actions, ArgoCD)
  • Experience building IaaS or PaaS systems at scale a plus
  • Experience with DPUs/SmartNICs a plus
  • GPU programming, NCCL, CUDA knowledge a plus

Nice to have

  • Deep experience with Kubernetes internals
  • Deep experience with VMs/hypervisors
  • Deep experience with DC networking tech + solutions
  • Experience with Cluster API or similar
  • Experience working on high-performance compute, networking, and/or storage
  • Experience virtualizing GPUs and/or Infiniband
  • Experience building IaaS or PaaS systems at scale
  • Experience with DPUs/SmartNICs
  • GPU programming, NCCL, CUDA knowledge

What we offer

  • competitive compensation
  • startup equity
  • health insurance
  • other benefits
  • flexibility in terms of remote work

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer - Together Cloud Infrastructure

8 matching positions

Senior Software Engineer - Together Cloud Platform

About the Role: Together AI is building the AI Acceleration Cloud, an end-to-end...
Location
Location
United States , San Francisco
Salary
Salary:
160000.00 - 230000.00 USD / Year
together.ai Logo
Together AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices
  • Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
  • Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
  • Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers (AWS, Azure, GCP)
  • Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
  • Experience developing against and managing a relational database, such as PostgreSQL
  • Expert-level programmer in one or more of programming language (Golang preferred)
  • Proficiency in version control practices and integrating IaC with CI/CD pipelines
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Identify, design, and develop foundational backend services that power Together’s cloud platform
  • Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure
  • Partner with product teams to understand functional requirements and deliver solutions that meet business needs
  • Write clear, well-tested, and maintainable software and IaC for both new and existing systems
  • Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
  • Participate in an on-call rotation to address critical incidents when necessary
What we offer
What we offer
  • competitive compensation
  • startup equity
  • health insurance
  • flexibility in terms of remote work
  • Fulltime
Read More
Arrow Right
New

Senior Software Engineer, Cloud Development

The AI Platform team is responsible for building the foundational infrastructure...
Location
Location
Canada
Salary
Salary:
Not provided
mozilla.org Logo
Mozilla
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree with 4–6 years of relevant industry experience, or Master's degree with significant hands-on experience building and operating production systems, or work experience equivalent
  • Strong, modern Python skills, with experience writing clean, maintainable code and working with a fast toolchain (dependency management, linting, formatting, type checks, pre-commit), building both libraries and CLIs that output structured data
  • Advance experience with database deployment and management, bonus points for familiarity with Postgres
  • Proven experience deploying and operating workloads in cloud environments, including production-grade infrastructure on GCP and GKE (artifact registries, managed caches, networking and internal load balancing, VPC, DNS, and separation of nonprod and prod)
  • Hands-on experience with Kubernetes and Helm, writing charts that deploy across environments with per-environment configuration and progressive feature rollout
  • Experience with Terraform for provisioning infrastructure across environments, including schema validation and PR-level plan review
  • Experience designing and running scalable APIs that hold up under load, including health and readiness checks, auth, and clean startup and shutdown
  • Experience with Grafana or similar tools for metrics, dashboards, and reading application and infrastructure health together during rollouts
  • Strong problem-solving skills and the ability to debug performance and reliability issues in distributed systems
  • Clear and effective communication skills, with experience collaborating across engineering, product, and infrastructure teams
Job Responsibility
Job Responsibility
  • Design, build, and operate core platform services and APIs used to deploy and serve production workloads at scale
  • Own service reliability end-to-end, driving improvements in availability, scalability, performance, and operational excellence
  • Lead efforts to optimize backend services for throughput, latency, and cost efficiency across distributed infrastructure
  • Design and manage Kubernetes-based workloads, including GitOps deployment pipelines, environment configuration, and resource utilization optimization
  • Own and improve critical parts of the service lifecycle, including packaging, versioning, testing strategies, validation, and deployment automation
  • Implement and evolve observability practices (metrics, logging, tracing, alerting) to improve visibility and operational resilience of backend services and pipelines
  • Partner closely with product, infrastructure, security, and data teams to design scalable platform capabilities that enable new product features
  • Contribute to technical design discussions, propose architectural improvements, and mentor junior engineers through code reviews and knowledge sharing
  • Participate in and help improve operational processes, including incident response, on-call rotations, and post-incident reviews
What we offer
What we offer
  • Generous performance-based bonus plans to all eligible employees
  • Rich medical, dental, and vision coverage
  • Generous retirement contributions with 100% immediate vesting
  • Quarterly all-company wellness days
  • Country specific holidays plus a day off for your birthday
  • One-time home office stipend
  • Annual professional development budget
  • Quarterly well-being stipend
  • Considerable paid parental leave
  • Employee referral bonus program
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - AI Infrastructure (Scheduler) - CoreAI

The AI Platform organization builds the end-to-end Azure AI stack, from the infr...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Java, Scala, Rust, Go, TypeScript | OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Work on the design and development of the core AI Infrastructure distributed and in-cluster services that support large scale AI training and inferencing
  • Develop, test, and maintain control plane services written in C#, hosted on Service Fabric or Kubernetes (AKS) clusters
  • Enhance systems and applications to ensure high stability, efficiency and maintainability, low latency, tight cloud security
  • Provide operational support and DRI (on-call) responsibilities for the service
  • Develop and foster a deep understanding of the machine learning concepts, use cases, and relevant services used by our customers
  • Collaborate closely with service engineers, product managers, and internal applied research and data science teams within Microsoft to build better solutions together
  • Provide vision, expertise, and technical leadership to other team members
  • Help to grow talent in these areas
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

We are looking for an enthusiastic and inquisitive Senior Software Engineer with...
Location
Location
United Kingdom
Salary
Salary:
Not provided
admiralgroup.co.uk Logo
Admiral Group Plc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in a Senior Software Engineer role, ideally within web and mobile application development
  • Experience designing and operating micro frontend (MFE) architectures, including module federation and independently deployed pipelines
  • Expertise in React and TypeScript development, including component architecture, state management, and performance optimisation
  • Extensive experience with NestJS for backend-for-frontend (BFF) patterns and API gateway design
  • Skilled in building and maintaining CI/CD pipelines using tools such as Azure DevOps or GitHub Actions, and familiar with optimised deployment strategies
  • In-depth knowledge of testing frameworks and strategies across unit, integration, E2E, and non-functional domains
  • Experience with cloud-native environments - preferably GCP and Azure
  • Skilled in application performance optimisation techniques such as caching, code splitting, lazy loading, and real-user monitoring
  • A good understanding of web and mobile security best practices, including OWASP guidelines, secure authentication and authorisation
Job Responsibility
Job Responsibility
  • Act as a technical lead within your squad, setting high standards for engineering practices and infrastructure resilience
  • Provide mentoring and guidance to junior and mid-level engineers
  • Help shape and implement the long-term engineering technical strategy for reliability and scalability
  • Design and implement scalable and modular frontend solutions using micro frontend architecture and module federation
  • Develop applications using React, TypeScript, and NestJS, supporting robust client-server integration
  • Contribute to and lead the detailed design, engineering quality, and technical oversight of solutions delivered within the Value Stream
  • Ensure all technical solutions follow architecture governance and align with Admiral’s engineering strategy
  • Drive improvements to CI/CD pipelines, automation, testing practices, and secure delivery
  • Contribute to resolving technical constraints, blockers, and integration challenges
  • Identify and address technical debt, ensuring sustainability and maintainability
What we offer
What we offer
  • Up to £3,600 of free shares each year after one year of service
  • 33 days holiday (including bank holidays) increasing up to 38 days
  • Option to buy or sell up to an additional five days of annual leave
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Social Tech

The Social Tech team is now seeking an experienced Senior Software Engineer to j...
Location
Location
Finland , Helsinki
Salary
Salary:
Not provided
supercell.com Logo
Supercell
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong backend engineering experience with Java and production services running at scale
  • Experience with AWS and cloud-native development practices
  • Proficiency with infrastructure as code tools such as Terraform, CloudFormation or CDK
  • Experience designing and integrating backend APIs and services using REST and/or gRPC
  • Familiarity with a range of database technologies, both non-relational (e.g. DynamoDB, Redis) and relational, and solid SQL fundamentals
  • Ability to collaborate across disciplines and teams, and communicate clearly with both engineers and non-engineers
  • Being passionate and committed to tasks, and in general an autonomous person with high levels of initiative and energy
  • An open and respectful attitude towards others and their work
Job Responsibility
Job Responsibility
  • Design, implementation, deployment and maintenance of highly scalable and available backend services for in-game social features
  • Develop and evolve APIs used by game teams, clarifying concepts, use cases and requirements together with stakeholders
  • Contribute to our Social SDK client that integrates into Supercell games across multiple platforms
  • Improve best practices around reliability, performance, and operability of our social services
  • Periodically offer round-the-clock, first-line support to production environments, as part of a rotating on-call duty
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer

The Senior/Principal Software Engineer provides architectural depth, delivery ex...
Location
Location
United States
Salary
Salary:
138568.00 - 221709.00 USD / Year
onecallcm.com Logo
One Call
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years building enterprise .NET applications in C# (.NET Framework + .NET Core)
  • Experience modernizing large legacy .NET codebases (service extraction, modularization, domain consolidation)
  • Familiarity with Azure cloud services, logging, monitoring, and observability patterns
  • Experience in healthcare, workers’ compensation, claims processing, or regulated industries
  • Experience with distributed queues, messaging patterns, event-driven architecture
  • Experience maintaining VB.NET codebases
  • Deep experience with ASP.NET MVC, Web API, WCF, Web Forms, WinForms
  • Strong proficiency in SQL Server (T-SQL, performance tuning, SSIS, SSRS)
  • Strong front-end fundamentals in JavaScript, TypeScript, HTML, CSS/SASS
  • Familiarity with jQuery, Knockout, and Kendo UI
Job Responsibility
Job Responsibility
  • Own and drive architecture and design discussions across multiple applications and services
  • Provide pragmatic, hands-on guidance to teams working across .NET, SQL, and mixed front-end stacks
  • Evaluate legacy architectures and propose modernization patterns (service boundaries, APIs, refactors, consolidation)
  • Facilitate technical decision-making with crisp rationales, tradeoff analysis, and clear documentation
  • Champion engineering excellence: code quality, testing, CI/CD maturity, observability, and maintainability
  • Unblock teams quickly by diagnosing issues across the entire stack (app, API, data, infrastructure)
  • Collaborate with Product, QA, Design, and other engineering teams to ensure predictable delivery
  • Translate complex requirements into executable technical plans, work breakdowns, and sequencing
  • Identify risks early and recommend options that balance delivery velocity with long-term stability
  • Contribute high-quality code in .NET (.NET Framework, .NET Core), C#, and VB.NET where necessary
What we offer
What we offer
  • Remote Work: We are a remote-first company, and almost all positions receive the flexibility of working from home
  • Generous Time Off: Besides 8 company holidays and 2 personal days every year, all colleagues receive a minimum of 18 days of paid time off
  • Comprehensive Benefits Package: Including medical, dental, vision, and pet insurance
  • 401(k) matching program
  • and company-paid life insurance and short and long-term disability coverage
  • Supportive Services: We offer a Colleague Assistance Program that provides free counseling and financial services, and our One Call Foundation, a non-profit arm of our company, provides colleagues financial assistance during times of unexpected hardships
  • Fulltime
Read More
Arrow Right

Senior AI Infrastructure Engineer

Together AI is building the AI Acceleration Cloud, an end-to-end platform for th...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
together.ai Logo
Together AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional software development experience and proficiency in at least one backend programming language (Golang desired)
  • 5+ years experience writing high-performance, well-tested, production quality code
  • Demonstrated experience with building and operating high-performance and/or globally distributed micro-service architectures across one or more cloud providers (AWS, Azure, GCP)
  • Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
  • Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
  • Experience with infrastructure automation tools (Terraform, Ansible), monitoring/observability stacks (Prometheus, Grafana), and CI/CD pipelines (GitHub Actions, ArgoCD)
Job Responsibility
Job Responsibility
  • Design, build, and maintain performant, secure, and highly-available backend services/operators that run in our data centers and automate hardware management, such as Infiniband partitioning, in-DC parallel storage provisioning, and VM provisioning
  • Design and build out the IaaS software layer for a new GB200 data center with thousands of GPUs
  • Work on a global multi-exabyte high-performance object store, serving massive datasets for pretraining
  • Build advanced observability stacks for our customers with automated node lifecycle management for fault-tolerant distributed pretraining
  • Perform architecture and research work for decentralized AI workloads
  • Work on the core, open-source Together AI platform
  • Create services, tools, and developer documentation
  • Create testing frameworks for robustness and fault-tolerance
  • Fulltime
Read More
Arrow Right

Infrastructure Engineer - Network Security

The Network Security team ensures that Campbell’s business operations including ...
Location
Location
United States , Camden
Salary
Salary:
131400.00 - 188900.00 USD / Year
campbells.com Logo
THE VAIL CORPORATION
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum education required, with specialization as appropriate: Bachelors Degree or equivalent work experience in Information Technology or Information Security
  • 6+ of experience in IT or Information Security
  • 3+ Years of IT Systems Management (Plan/Build/Run)
  • 3+ years of Firewall policy management (Deployment/Operations) for one or more of the leading NGFW companies (Palo Alto, Fortinet, Checkpoint)
  • Previous experience working in outsourced IT environments
  • Ability to translate business needs into implementation plans and can articulate cost implications of options
  • Extensive knowledge & understanding of NGFWs, SSL VPN, NAC & RBAC, Privileged access (PAM) & SASE solutions
  • Vendor knowledge and past implementation of Cisco, Aruba & Fortinet
  • Extensive experience with Firewall & SSL VPN based policy management
  • both with direct implementation and guiding principles with ‘zero-trust’ approach
Job Responsibility
Job Responsibility
  • Develop, document, communicate, and enforce a network technology standards policy which is delivers value, is manageable and scalable
  • Conduct analysis of security requirements and controls to identify gaps and provides recommendations of industry best practices, trends, and technology products
  • Conduct research and make recommendations on network products, services, protocols, and standards in support of network procurement and digital development efforts
  • Lead efforts on Network infrastructure transition following ‘DevSecOps’ principles & framework in alignment with business application and related Enterprise Architectural standards
  • Help build strategic plans by leveraging leading-edge scientific and technological knowledge to drive business strategies as well as enhance the value proposition of IT solutions across cost, stability and security frameworks
  • Participating and enabling successful Business projects that have network security dependencies
  • Executing and ensure the successful delivery of IT Network and Network security tech
  • Assist with the design and implementation of short- and long-term strategic plans to ensure network services meet existing and future business requirements
  • Works closely with other groups, including System Administrators, AppOps, Infosec, Incident response & Vulnerability management teams, to ensure corporate compliance & improvements across network infrastructure
  • Provide support for Infosec related project initiatives and CSIRT event responses
What we offer
What we offer
  • Benefits begin on day one and include medical, dental, short and long-term disability, AD&D, and life insurance (for individual, families, and domestic partners)
  • Employees are eligible for our matching 401(k) plan and can enroll on the first day of employment with immediate vesting
  • Campbell’s offers unlimited sick time along with paid time off and holiday pay
  • If in WHQ – free access to the fitness center
  • Access to on-site day care (operated by Bright Horizons) and company store
  • Giving back to the communities where our employees work and live is very important to Campbell’s
  • Our “Campbell’s Cares” program matches employee donations and/or volunteer activity up to $1,500 annually
  • Campbell’s has a variety of Employee Resource Groups (ERGs) to support employees
  • competitive health, dental, 401k and wellness benefits beginning on the first day of employment
  • Fulltime
Read More
Arrow Right