Staff Infrastructure Software Engineer, Enterprise AI Job at Scale (New York)

Staff Software Engineer, Full-Stack - Enterprise Gen AI

Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform provi...

Location

United States , New York; San Francisco; Seattle

Salary:

248400.00 - 310500.00 USD / Year

Scale

Expiration Date

Until further notice

Requirements

5+ years of experience developing frontend or fullstack applications in a modern tech stack
Strong proficiency in Next.js, React, TypeScript, and Tailwind, with an eye for building polished, user-friendly interfaces
Experience working on high-visibility, customer-facing applications and making trade-offs between speed and quality in fast-paced environments
A passion for AI and experience working on interactive AI applications, agent-based systems, or data-rich web platforms
Familiarity with backend technologies such as FastAPI, PostgreSQL, GraphQL, and cloud infrastructure like AWS, Azure, or GCP
A track record of collaborating cross-functionally with design, product, and ML teams to bring AI-powered applications to life

Job Responsibility

Build and enhance user-facing AI applications for major enterprise customers, including high-profile media and Fortune 500 companies
Develop and refine features for Scale’s GenAI Platform, empowering businesses to build, deploy, and manage AI-driven agents
Design, build, and optimize polished, high-performance UIs using Next.js, React, TypeScript, and Tailwind
Work closely with product managers, designers, and AI/ML teams to create seamless, intuitive, and impactful user experiences
Integrate frontend applications with backend services, working with APIs, authentication systems, and cloud-based infrastructure
Ship features at a rapid pace while maintaining a high level of code quality, performance, and accessibility

What we offer

Comprehensive health, dental and vision coverage
retirement benefits
a learning and development stipend
generous PTO
commuter stipend
equity
Stock Options

Fulltime

Staff Software Engineer, Enterprise

At Docker, we make app development easier so developers can focus on what matter...

Location

United States , Seattle

Salary:

195400.00 - 275600.00 USD / Year

Docker

Expiration Date

Until further notice

Requirements

8+ years of software engineering experience with deep specialization in building enterprise SaaS platforms or wide breadth across multiple relevant domains
Expert-level proficiency in backend development (Go, Python, Java, or similar) with strong opinions on when to use what
Extensive experience designing, building, and operating large-scale distributed systems
Deep understanding of API design, service architecture, and system integration patterns
Strong knowledge of databases, caching, and data pipeline architectures
Experience with cloud platforms (AWS, GCP, or Azure) and container/orchestration technologies
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
Proven track record of leading complex technical initiatives from conception through delivery
Ability to make sound architectural decisions that account for scale, reliability, security, and maintainability
Experience defining technical standards and driving adoption across teams

Job Responsibility

Define the technical architecture for Docker's unified enterprise governance platform, ensuring it scales to support thousands of enterprise customers
Design the Unified Internal Access Control Endpoint that will serve as the single source of truth for permissions, settings, and policies across all Docker products
Architect systems that balance immediate customer needs with long-term platform extensibility
Identify gaps in existing processes and systems, recommend solutions, and drive implementation
Own end-to-end delivery of major platform components such as the Enterprise Command Center, group management/RBAC systems, or high-volume audit logging infrastructure
Lead technical design for SIEM/API integrations that enable enterprises to ingest Docker telemetry into their existing security infrastructure
Solve complex problems creatively and efficiently, often navigating ambiguity and competing priorities
Make technical decisions that balance customer impact, engineering velocity, and operational sustainability
Mentor engineers across the organization, helping them grow their technical skills and judgment
Set technical standards and best practices that raise the bar for the entire platform organization

What we offer

Freedom & flexibility
fit your work around your life
Designated quarterly Whaleness Days plus end of year Whaleness break
Home office setup
we want you comfortable while you work
16 weeks of paid Parental leave
Technology stipend equivalent to $100 net/month
PTO plan that encourages you to take time to do the things you enjoy
Training stipend for conferences, courses and classes
Equity

Fulltime

Senior Software Engineer, Infrastructure / Efficiency / Productivity

Roku is seeking a world class engineer to be a true force multiplier by owning t...

Location

United Kingdom , Cambridge

Salary:

Not provided

Roku

Expiration Date

Until further notice

Requirements

Bachelor's in Computer Science or Computer Engineering, or equivalent experience
Prior experience at Staff, Principal, or Architect level
Ownership in platform/infrastructure, developer productivity, CI/CD, build systems, or workflow automation, including work spanning globally distributed teams and systems
Strong, hands-on knowledge of: Git (workflows, branching strategies, release management), Jenkins (CI/CD pipeline design, scaling, reliability), Docker containers (reproducible build/test execution), Build systems (BitBake/Yocto preferred), Jira (workflow design/automation, cross-team visibility), Test management systems (e.g., TestRail or equivalent)
Demonstrated experience delivering automation at scale, including building platforms/components used by multiple teams
Strong systems thinking across security, reliability, performance, and cost tradeoffs
Excellent written communication (architecture docs, decision records, operating procedures)
Experience building AI-assisted developer tooling (e.g., CI insights, test intelligence, code review automation, release risk scoring, incident copilots)
Experience implementing evaluation/monitoring for AI systems (quality metrics, drift, offline test sets, human feedback loops)
Extensive experience with software development on embedded Linux, multi-process architectures and IPC mechanisms

Job Responsibility

Define and lead an AI-first automation roadmap for Engineering Infrastructure and Enterprise Tooling
Architect and ship AI/LLM-enabled workflow automation across the SDLC
Establish policies and guardrails for AI usage in internal tools
Set technical direction and standards for globally used developer tools, including build systems
Architect and evolve CI/CD and build/test pipelines using Jenkins, Docker, and build systems
Own and scale test and quality workflows leveraging test management systems
Drive Jira workflow design and automation
Design and implement automation spanning Engineering, Product, Marketing, and Partners
Embed secure-by-default controls into pipelines and tooling
Improve build/test performance and reliability

What we offer

Global access to mental health and financial wellness support and resources
Local benefits may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
Time off in accordance with local leave policies

Fulltime

Senior Software Engineer, Infrastructure and Efficiency

Roku is seeking a world class engineer to be a true force multiplier by owning t...

Location

United Kingdom , Manchester

Salary:

Not provided

Roku

Expiration Date

Until further notice

Requirements

Bachelor's in Computer Science or Computer Engineering, or equivalent experience
Prior experience at Staff, Principal, or Architect level
Ownership in platform/infrastructure, developer productivity, CI/CD, build systems, or workflow automation, including work spanning globally distributed teams and systems
Strong, hands-on knowledge of: Git (workflows, branching strategies, release management)
Jenkins (CI/CD pipeline design, scaling, reliability)
Docker containers (reproducible build/test execution)
Build systems (BitBake/Yocto preferred)
Jira (workflow design/automation, cross-team visibility)
Test management systems (e.g., TestRail or equivalent)
Demonstrated experience delivering automation at scale, including building platforms/components used by multiple teams

Job Responsibility

Define and lead an AI-first automation roadmap for Engineering Infrastructure and Enterprise Tooling
Architect and ship AI/LLM-enabled workflow automation across the SDLC
Establish policies and guardrails for AI usage in internal tools
Set technical direction and standards for the globally used developer tools
Architect and evolve, CI/CD and build/test pipelines using Jenkins, Docker, and build systems
Own and scale test and quality workflows leveraging test management systems
Drive Jira workflow design and automation
Design and implement automation spanning Engineering, Product, Marketing, and Partners
Replace manual coordination with durable automation and integrations
Embed secure-by-default controls into pipelines and tooling

What we offer

Global access to mental health and financial wellness support and resources
Statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
Employees are supported in taking time off, in accordance with local leave policies and other personal needs

Fulltime

Staff Software Engineer

Staff Software Engineer Salary: £130K – £140K + Equity Location: London in offic...

Location

United Kingdom , London

Salary:

130000.00 - 140000.00 GBP / Year

Data Idols

Expiration Date

Until further notice

Requirements

Strong expertise in Python and modern backend frameworks
Deep knowledge of relational databases, particularly PostgreSQL
Strong understanding of RESTful API design and microservices patterns
Experience working with cloud platforms and containerised environments (Docker, Kubernetes)

Job Responsibility

Designing and evolving the backend services that support large-scale data processing, AI model deployment, and secure enterprise workflows
Ensuring complex AI functionality is delivered reliably, performs under load, and meets strict security and compliance expectations
Collaborating closely with machine learning engineers, product managers, and infrastructure specialists to turn advanced AI capabilities into production-ready systems
Influencing architectural decisions, guiding technical standards, and helping shape how backend engineering is done as the platform scales

What we offer

Equity

Fulltime

Staff Software Engineer

At NetApp, we have a history of helping customers turn challenges into business ...

Location

India , Bengaluru

Salary:

Not provided

NetApp

Expiration Date

Until further notice

Requirements

Proficiency in Python, Go Lang, Java and REST APIs to create AI-augmented workflows for data classification and engineering
Cloud Native Infrastructure: Depth in microservices-based SaaS architectures and cloud storage platforms (AWS)
AI/ML & GenAI: Hands-on experience with frameworks like PyTorch, and Hugging Face
ability to build next-generation data solutions for AI workloads
Problem-Solving: Proven ability to resolve critical system issues and optimize performance for massive enterprise workloads
Act as a functional expert for complex domains, such as Storage As a Service, CloudOps, or AI-driven data infrastructure
Lead high-impact, cross-team projects that influence the product roadmap and long-term strategy
Design scalable, optimized solution architectures and guide the development of next-generation data services
Serve as a 'coach and culture bearer,' providing technical guidance and peer reviews to help grow junior engineers (IC1–IC4)
Work across organizational boundaries to align technical capabilities with business goals and customer needs

Job Responsibility

Own Every Moment at NetApp
collaborate with passionate teams, tackle real-world challenges, and see your impact in how customers transform and grow
As a Staff Software Engineer in the Keystone organization, you will be a technical leader and a force multiplier
you will set the technical vision for critical components of our platform
design elegant, scalable, and resilient solutions to our most complex architectural challenges
influence and mentor engineers across the organization
thrive on solving ambiguous problems, driving technical excellence, and building systems that operate at a massive scale

What we offer

Volunteer time off - 40 hours of paid volunteer time each year
Well-being - Employee Assistance Program, fitness, and mental health resources to help employees be their best
Time away - Paid time off for vacation and to recharge

Staff Software Engineer - AI/ML Infra

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Pl...

Location

United States , Chevy Chase; New York City; Palo Alto

Salary:

115000.00 USD / Year

Geico

Expiration Date

Until further notice

Requirements

Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
3+ years of hands-on experience with machine learning infrastructure and deployment at scale
2+ years of experience working with Large Language Models and transformer architectures
Proficient in Python
strong skills in Go, Rust, or Java preferred
Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)

Job Responsibility

Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
Design, implement, and maintain feature stores for ML model training and inference pipelines
Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases

What we offer

Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
Financial benefits including market-competitive compensation
a 401K savings plan vested from day one that offers a 6% match
performance and recognition-based incentives
and tuition assistance
Access to additional benefits like mental healthcare as well as fertility and adoption assistance
Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year

Fulltime

Staff Software Engineer - AI/ML Platform

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Pl...

Location

United States , Chevy Chase; New York City; Palo Alto

Salary:

115000.00 USD / Year

Geico

Expiration Date

Until further notice

Requirements

Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
3+ years of hands-on experience with machine learning infrastructure and deployment at scale
2+ years of experience working with Large Language Models and transformer architectures
Proficient in Python
strong skills in Go, Rust, or Java preferred
Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)

Job Responsibility

Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
Design, implement, and maintain feature stores for ML model training and inference pipelines
Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases

What we offer

Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
Financial benefits including market-competitive compensation
a 401K savings plan vested from day one that offers a 6% match
performance and recognition-based incentives
and tuition assistance
Access to additional benefits like mental healthcare as well as fertility and adoption assistance
Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year

Fulltime

Select Country

Staff Infrastructure Software Engineer, Enterprise AI

Job Description

Job Responsibility

Requirements

Nice to have

What we offer

Looking for more opportunities?