CrawlJobs Logo
Cohere Logo Cohere · IT - Software Development

Software Engineer, Internal Infrastructure

Canada; United States, Toronto · Job Posted February 20, 2026
Apply Position
Job Link Share

Job Description

The internal infrastructure team is responsible for building world-class infrastructure and tools used to train, evaluate and serve Cohere's foundational models. By joining our team, you will work in close collaboration with AI researchers to support their AI workload needs on the cutting edge, with a strong focus on stability, scalability, and observability. You will be responsible for building and operating Kubernetes GPU superclusters across multiple clouds. Your work will directly accelerate the development of industry-leading AI models that power Cohere's platform North.

Job Responsibility

  • Build and operate Kubernetes compute superclusters across multiple clouds
  • Partner with cloud providers to optimize infrastructure costs, performance, and reliability for AI workloads
  • Work closely with research teams to understand their infrastructure needs and identify ways to improve stability, performance, and efficiency of novel model training techniques
  • Design and build resilient, scalable systems for training AI models, focusing on creating intuitive user interfaces that empower researchers to self-serve to troubleshoot and resolve problems
  • Encourage software best practices across our company and participate in team processes such as knowledge sharing, reviews, and on-call

Requirements

  • Have deep experience running Kubernetes clusters at scale and/or scaling and troubleshooting Cloud Native infrastructure, including Infrastructure as Code
  • Have strong programming skills in Go or Python
  • Prefer contributing to Open Source solutions rather than building solutions from the ground up
  • Are self-directed and adaptable, and excel at identifying and solving key problems
  • Draw motivation from building systems that help others be more productive
  • See mentorship, knowledge transfer, and review as essential prerequisites for a healthy team
  • Have excellent communication skills and thrive in fast-paced environments

Nice to have

  • You've previously worked with ML training infrastructure and GPU workloads and have familiarity with RDMA networking
  • You have expertise to support and troubleshoot low level Linux systems
  • You have experience collaborating with research teams or machine learning engineers

What we offer

  • An open and inclusive culture and work environment
  • Work closely with a team on the cutting edge of AI research
  • Weekly lunch stipend, in-office lunches & snacks
  • Full health and dental benefits, including a separate budget to take care of your mental health
  • 100% Parental Leave top-up for up to 6 months
  • Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
  • Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
  • 6 weeks of vacation (30 working days!)
Cohere - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer, Internal Infrastructure

8 matching positions

Software Engineer, Internal Infrastructure

The internal infrastructure team is responsible for building world-class infrast...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
cohere.com Logo
Cohere
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep experience running Kubernetes clusters at scale and/or scaling and troubleshooting Cloud Native infrastructure, including Infrastructure as Code
  • Strong programming skills in Go or Python
  • Prefer contributing to Open Source solutions rather than building solutions from the ground up
  • Self-directed and adaptable, and excel at identifying and solving key problems
  • Draw motivation from building systems that help others be more productive
  • See mentorship, knowledge transfer, and review as essential prerequisites for a healthy team
  • Have excellent communication skills and thrive in fast-paced environments
Job Responsibility
Job Responsibility
  • Build and operate Kubernetes compute superclusters across multiple clouds
  • Partner with cloud providers to optimize infrastructure costs, performance, and reliability for AI workloads
  • Work closely with research teams to understand their infrastructure needs and identify ways to improve stability, performance, and efficiency of novel model training techniques
  • Design and build resilient, scalable systems for training AI models, focusing on creating intuitive user interfaces that empower researchers to self-serve to troubleshoot and resolve problems
  • Encourage software best practices across our company and participate in team processes such as knowledge sharing, reviews, and on-call
What we offer
What we offer
  • An open and inclusive culture and work environment
  • Work closely with a team on the cutting edge of AI research
  • Weekly lunch stipend, in-office lunches & snacks
  • Full health and dental benefits, including a separate budget to take care of your mental health
  • 100% Parental Leave top-up for up to 6 months
  • Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
  • Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
  • 6 weeks of vacation (30 working days!)
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Infrastructure / Efficiency / Productivity

Roku is seeking a world class engineer to be a true force multiplier by owning t...
Location
Location
United Kingdom , Cambridge
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's in Computer Science or Computer Engineering, or equivalent experience
  • Prior experience at Staff, Principal, or Architect level
  • Ownership in platform/infrastructure, developer productivity, CI/CD, build systems, or workflow automation, including work spanning globally distributed teams and systems
  • Strong, hands-on knowledge of: Git (workflows, branching strategies, release management), Jenkins (CI/CD pipeline design, scaling, reliability), Docker containers (reproducible build/test execution), Build systems (BitBake/Yocto preferred), Jira (workflow design/automation, cross-team visibility), Test management systems (e.g., TestRail or equivalent)
  • Demonstrated experience delivering automation at scale, including building platforms/components used by multiple teams
  • Strong systems thinking across security, reliability, performance, and cost tradeoffs
  • Excellent written communication (architecture docs, decision records, operating procedures)
  • Experience building AI-assisted developer tooling (e.g., CI insights, test intelligence, code review automation, release risk scoring, incident copilots)
  • Experience implementing evaluation/monitoring for AI systems (quality metrics, drift, offline test sets, human feedback loops)
  • Extensive experience with software development on embedded Linux, multi-process architectures and IPC mechanisms
Job Responsibility
Job Responsibility
  • Define and lead an AI-first automation roadmap for Engineering Infrastructure and Enterprise Tooling
  • Architect and ship AI/LLM-enabled workflow automation across the SDLC
  • Establish policies and guardrails for AI usage in internal tools
  • Set technical direction and standards for globally used developer tools, including build systems
  • Architect and evolve CI/CD and build/test pipelines using Jenkins, Docker, and build systems
  • Own and scale test and quality workflows leveraging test management systems
  • Drive Jira workflow design and automation
  • Design and implement automation spanning Engineering, Product, Marketing, and Partners
  • Embed secure-by-default controls into pipelines and tooling
  • Improve build/test performance and reliability
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • Local benefits may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Time off in accordance with local leave policies
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Infrastructure and Efficiency

Roku is seeking a world class engineer to be a true force multiplier by owning t...
Location
Location
United Kingdom , Manchester
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's in Computer Science or Computer Engineering, or equivalent experience
  • Prior experience at Staff, Principal, or Architect level
  • Ownership in platform/infrastructure, developer productivity, CI/CD, build systems, or workflow automation, including work spanning globally distributed teams and systems
  • Strong, hands-on knowledge of: Git (workflows, branching strategies, release management)
  • Jenkins (CI/CD pipeline design, scaling, reliability)
  • Docker containers (reproducible build/test execution)
  • Build systems (BitBake/Yocto preferred)
  • Jira (workflow design/automation, cross-team visibility)
  • Test management systems (e.g., TestRail or equivalent)
  • Demonstrated experience delivering automation at scale, including building platforms/components used by multiple teams
Job Responsibility
Job Responsibility
  • Define and lead an AI-first automation roadmap for Engineering Infrastructure and Enterprise Tooling
  • Architect and ship AI/LLM-enabled workflow automation across the SDLC
  • Establish policies and guardrails for AI usage in internal tools
  • Set technical direction and standards for the globally used developer tools
  • Architect and evolve, CI/CD and build/test pipelines using Jenkins, Docker, and build systems
  • Own and scale test and quality workflows leveraging test management systems
  • Drive Jira workflow design and automation
  • Design and implement automation spanning Engineering, Product, Marketing, and Partners
  • Replace manual coordination with durable automation and integrations
  • Embed secure-by-default controls into pipelines and tooling
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • Statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Employees are supported in taking time off, in accordance with local leave policies and other personal needs
  • Fulltime
Read More
Arrow Right

Software Engineer - Internal Platform Team

Join our Dev Enablement team: build tools, solve problems, and grow your skills ...
Location
Location
New Zealand , Hamilton
Salary
Salary:
Not provided
gallagher.com Logo
Gallagher Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Enjoy problem-solving and can break down complex challenges into actionable steps
  • Thrive in a collaborative environment and can follow guidance while thinking independently
  • Motivated to grow, experiment, and learn rather than needing experience with a long list of technologies
Job Responsibility
Job Responsibility
  • Develop and maintain internal tools and services that help other development teams deliver efficiently
  • Provide guidance, support, and solutions to help developers solve technical challenges
  • Collaborate with your squad and across teams in a flexible, agile environment
  • Take ownership of your learning and contribute ideas for improving team practices, infrastructure, and processes
What we offer
What we offer
  • Competitive salary and bonuses
  • Hybrid flexibility (3-4 days office / 1-2 days home)
  • KiwiSaver on-top and Life and Disability insurance
  • Mentorship and professional development opportunities
  • A supportive team culture with team-building events, lunches and a fun environment
  • Fulltime
Read More
Arrow Right

Infrastructure Software Engineer, Enterprise GenAI

Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform that ...
Location
Location
United States , San Francisco; New York
Salary
Salary:
216200.00 - 270250.00 USD / Year
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of full-time engineering experience, post-graduation
  • Experience scaling products at hyper growth startups
  • Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies
  • Proficient in Python or Javascript/Typescript, and SQL
  • Experience with Kubernetes
  • Experience with major cloud providers (AWS, Azure, GCP)
  • Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences
Job Responsibility
Job Responsibility
  • Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers
  • Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
  • Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs
  • Deliver experiments at a high velocity and level of quality to engage our customers
  • Work across the entire product lifecycle from conceptualization through production
  • Be able, and willing, to multi-task and learn new technologies quickly
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO
  • commuter stipend
  • equity grant
  • Fulltime
Read More
Arrow Right

Staff Backend Software Engineer, Internal Tools

We are looking for a versatile Backend Software Engineer to own the design, deve...
Location
Location
United States , San Jose
Salary
Salary:
172800.00 - 237600.00 USD / Year
archer.com Logo
Archer Aviation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of professional backend engineering experience
  • Strong proficiency in at least one backend programming language (Python, Go, Java, Node.js, or similar)
  • Extensive experience with cloud platforms (AWS, GCP, or Azure) and cloud-native architecture
  • Solid understanding of DevOps principles with hands-on experience in: CI/CD tools (TeamCity, Jenkins, GitLab CI, GitHub Actions, CircleCI, etc.)
  • Containerization and orchestration (Docker, Kubernetes, Prefect/Airflow)
  • Infrastructure as Code (Terraform, CloudFormation, Ansible, etc.)
  • Proficiency with relational and NoSQL databases
  • Experience with RESTful API design and microservices architecture
  • Strong understanding of software engineering best practices including version control, testing, and code review
  • Proven ability to work effectively with cross-functional teams and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable backend systems and APIs for internal tools supporting engineering, manufacturing, supply chain, and business operations
  • Build automation tools and workflows that streamline cross-functional processes
  • Implement robust data pipelines and integration systems connecting various internal platforms
  • Ensure code quality through comprehensive testing, code reviews, and adherence to engineering best practices
  • Design and manage cloud infrastructure with a focus on scalability, reliability, and security
  • Monitor system performance, troubleshoot issues, and optimize for efficiency
  • Establish infrastructure as code practices and maintain version-controlled configurations
  • Partner with multidisciplinary stakeholders including engineers, operations teams, program managers, and executives to understand requirements and deliver solutions
  • Translate business needs into technical specifications and architectural designs
  • Fulltime
Read More
Arrow Right

Software Engineer, Infrastructure Reliability

You’ll be at the heart of scaling and hardening the infrastructure that powers s...
Location
Location
United States , San Francisco
Salary
Salary:
255000.00 - 385000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of relevant industry experience
  • 2+ years leading large scale, complex projects or teams as an engineer or tech lead
  • A passion for distributed systems at scale with a focus on reliability, scalability, security, and continuous improvement
  • Proven experience as an reliability engineer, production engineer, or a similar role in a fast-paced, rapidly scaling company
  • Strong proficiency in cloud infrastructure (like AWS, GCP, Azure) and IaC tools such as Terraform
  • Proficiency in programming / scripting languages
  • Experience with containerization technologies and container orchestration platforms like Kubernetes
  • Experience with observability tools such as Datadog, Prometheus, Grafana, Splunk and ELK stack
  • Experience with microservices architecture and service mesh technologies
  • Knowledge of security best practices in cloud environments
Job Responsibility
Job Responsibility
  • Design, build, and operate reliable and performant systems used across engineering
  • Identify and fix performance bottlenecks and inefficiencies, ensuring our infrastructure can scale to the next order of magnitude
  • Dig deep to resolve complex issues
  • Continuously improve automation to reduce manual work
  • Improve internal tooling and our developer experience
  • Contribute to incident response, postmortems, and the development of best practices around system reliability and scalability
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Software Engineer, Internal Applications - Enterprise

OpenAI’s Applications Engineering team engineers, owns, and evolves OpenAI’s cor...
Location
Location
United States , San Francisco
Salary
Salary:
230000.00 - 325000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in a modern programming language, ideally Python
  • Strong knowledge of and experience with cloud platforms (Azure, AWS, GCP) and infrastructure management
  • Deep knowledge and experience managing corporate infrastructure at scale with Infrastructure-as-Code (IaC) practices & GitOps workflows (Terraform, Ansible, Chef, etc.) as well as cloud automation best practices
  • Experience integrating corporate infrastructure with CI/CD pipelines and DevOps workflows
  • Proven track record of developing and maintaining internal tools to streamline corporate technology and business processes
  • Demonstrated experience developing internal automation solutions, such as Slack bots and integrations
  • Strong understanding of role-based access controls (RBAC) and security principles
  • Experience working with enterprise technology services and optimizing workflows at scale
  • Excellent stakeholder management skills and ability to work cross-functionally with IT, security, and business teams
  • Clear and concise communication skills to explain technical concepts to both technical and non-technical audiences
Job Responsibility
Job Responsibility
  • Design, build, implement, and maintain secure, scalable, and performant workforce technology infrastructure, automation workflows, and bespoke tooling that improves the OpenAI employee experience
  • Deliver critical IT efficiencies and automation through both bespoke software development and first-party tooling to enhance technology service delivery
  • Employ modern Infrastructure-as-Code (IaC) methodologies, developing GitOps-driven solutions to manage technology workflows at scale
  • Build and maintain CI/CD pipelines for corporate infrastructure, deploying to progressively tested environments across multiple clouds (Azure, AWS, GCP)
  • Create scalable internal tools and dashboards to optimize workflows and improve visibility into engineering operations
  • Design and manage internal integrations, including Slack bots and workflow automation solutions
  • Support IAM processes by automating access provisioning and lifecycle management for internal applications
  • Collaborate with the IAM team to manage cloud-based identity and access controls, ensuring compliance with security policies and standards for internal applications
  • Collaborate with security teams to align technology automation initiatives with Zero Trust principles and compliance frameworks
  • Implement role-based access controls (RBAC) and mitigate security risks through automated policies
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right