Staff Site Reliability Engineer, Managed AI

• Design and operate reliable managed AI services with a focus on serving and scaling LLM workloads
• Build automation and reliability tooling to support distributed AI pipelines and inference services
• Define, measure, and improve SLIs/SLOs across AI workloads to ensure performance and reliability targets are met
• Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters
• Automate observability by building telemetry and performance tuning strategies for latency-sensitive AI services
• Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling
• Contribute to the architecture of next-generation distributed systems purpose-built for AI-first environments

• Strong software engineering background — experience building production-grade systems beyond scripting or Bash
• Demonstrated experience in distributed systems design and implementation
• Hands-on work with large language models (LLMs) or AI/ML infrastructure
• SRE mindset and experience (whether or not under the SRE title) including: Defining and measuring SLIs/SLOs
• Building monitoring and observability systems
• Driving performance and reliability improvements
• Designing fault-tolerant systems and automated testing strategies
• Proficiency in at least one modern programming language (Python, Go, Java, C++)
• Familiarity with Kubernetes or container orchestration platforms
• Strong collaboration and communication skills
• Ability to thrive in a fast-paced, mission-driven environment

Experience scaling inference or training workloads for LLMs

• Restricted Stock Units in a fast growing, well-funded technology company
• Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
• Employer contributions to HSA accounts
• Paid Parental Leave
• Paid life insurance, short-term and long-term disability
• Teladoc
• 401(k) with a 100% match up to 4% of salary
• Generous paid time off and holiday schedule
• Cell phone reimbursement
• Tuition reimbursement
• Subscription to the Calm app
• MetLife Legal
• Company paid commuter benefit
• $300 per month