Senior+ Software Engineer - Cloud Availability Platform Engineering (Observability) Job at Crusoe (San Francisco)

Senior+ Software Engineer - Cloud Availability Platform Engineering (Observability)

Crusoe

Location:
United States , San Francisco

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

166000.00 - 201000.00 USD / Year

Save Job

Apply Position

Job Description:

We are looking for a highly skilled engineer with deep expertise in building and operating observability platforms at scale. You will design, develop, and run Crusoe’s next-generation observability stack, enabling engineers to understand the internal state of distributed systems through metrics, logs, and traces. Your work will ensure reliability, performance, and actionable insights across Crusoe’s global infrastructure and cloud platform.

Job Responsibility:

Designing and operating scalable observability systems (metrics, logging, tracing) across multi-datacenter Kubernetes environments
Architecting end-to-end telemetry pipelines, including ingestion, storage, querying, and visualization
Extending monitoring and alerting with Prometheus, Alertmanager, Thanos/Cortex, Grafana, and OpenTelemetry
Building scalable log collection and processing pipelines with Fluent Bit, Vector, Loki, or ELK/Opensearch stacks
Implementing distributed tracing platforms (Tempo, Jaeger, OpenTelemetry) and integrating with service meshes, load balancers, and APIs
Defining and driving adoption of SLOs, SLIs, and error budgets across services and teams
Automating provisioning and scaling of observability infrastructure with Kubernetes, Terraform, and custom tooling (Go, Python)
Ensuring reliability and cost efficiency of telemetry pipelines while supporting high-volume workloads (AI/ML, HPC clusters, GPU infrastructure)
Embedding security best practices into observability platforms, including RBAC, TLS, secret management, and multi-tenant access controls
Partnering with engineering teams to embed observability into applications, services, and infrastructure
Mentoring engineers and shaping Crusoe’s observability strategy and technical roadmap

Requirements:

7+ years of experience in infrastructure or platform engineering, with a focus on observability and monitoring systems
Deep expertise with metrics systems (Prometheus, Thanos, Mimir, Cortex), logging pipelines (Fluent Bit, Vector, Loki, ELK/Opensearch), and tracing platforms (Jaeger, Tempo, OpenTelemetry)
Strong programming skills in Go or Python for automation, operators, and custom integrations
Experience running observability platforms on Kubernetes and operating them at scale across multi-datacenter environments
Proven ability to design, optimize, and scale telemetry pipelines handling high cardinality and high throughput data
Solid understanding of distributed systems, performance engineering, and debugging complex workloads
Strong collaboration skills and the ability to influence engineering teams to adopt observability best practices

Nice to have:

Contributions to open source observability projects (Prometheus, OpenTelemetry, Grafana, Loki, etc.)
Experience supporting AI/ML or GPU-heavy environments with high observability demands
Knowledge of event-driven or streaming systems (Kafka, NATS, Pulsar) used in telemetry pipelines
Experience implementing cost optimization strategies for large-scale observability platforms
Background in incident response, chaos engineering, and reliability practices

What we offer:

Restricted Stock Units in a fast growing, well-funded technology company
Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
Employer contributions to HSA accounts
Paid Parental Leave
Paid life insurance, short-term and long-term disability
Teladoc
401(k) with a 100% match up to 4% of salary
Generous paid time off and holiday schedule
Cell phone reimbursement
Tuition reimbursement
Subscription to the Calm app
MetLife Legal
Company paid commuter benefit
$300 per month

Additional Information:

Job Posted:
February 21, 2026

Employment Type:

Fulltime

Work Type:

On-site work

Crusoe - All Job Offers

Job Link Share: