Software Engineer, Infrastructure Jobs

Fireworks AI

Location:
United States, New York ▼
San Mateo
Redwood City

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

140000.00 - 150000.00 USD / Year

Save Job

Apply Position

Job Description:

As a Software Engineer on our Infrastructure team, you will help design and build the core systems that power Fireworks AI’s generative AI platform. You will work on projects that support distributed AI workloads across multiple cloud environments, building tools and services that keep our platform fast, reliable, and scalable. This is an exciting opportunity for a new graduate who wants to grow as a software engineer and work hands-on with infrastructure, distributed systems, and large-scale machine learning platforms.

Job Responsibility:

Contribute to the design and development of scalable backend infrastructure that supports distributed training, inference, and data pipelines
Build and maintain core backend services such as job schedulers, autoscalers, resource managers, and model serving systems
Support performance optimization, cost efficiency, and reliability improvements across compute, storage, and networking layers
Collaborate with ML, DevOps, and product teams to translate research and product needs into infrastructure solutions
Learn and apply modern cloud technologies including Kubernetes, Ray, Kubeflow, and MLFlow
Participate in code reviews, technical discussions, and continuous integration and deployment processes

Requirements:

Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
Strong programming skills in Python, C++, or a similar language
Solid understanding of computer systems concepts such as networking, storage, and distributed computing
Familiarity with cloud platforms like AWS, GCP, or Azure, and containerization tools like Docker or Kubernetes
Knowledge and interest in cloud infrastructure, distributed systems, and machine learning

Nice to have:

2+ years of relevant industry experience through internships, co-ops, or full-time employment
Experience with ML frameworks such as PyTorch, TensorFlow, Vertex AI, or SageMaker
Exposure to infrastructure-as-code and CI/CD tools such as Terraform, ArgoCD, or GitHub Actions
Contributions to open-source infrastructure or ML projects
Strong problem-solving skills and curiosity to learn new technologies

What we offer:

Meaningful equity in a fast-growing startup
Competitive salary and comprehensive benefits package

Additional Information:

Job Posted:
December 08, 2025

Employment Type:

Fulltime

Work Type:

Hybrid work

View All Jobs In This Company

Job Link Share:

Software Engineer, Infrastructure