Staff Software Engineer, AI Runtime Jobs

Apollo GraphQL

Location:
United States

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

185000.00 - 215000.00 USD / Year

Save Job

Apply Position

Job Description:

We’re seeking a Staff Software Engineer to help power the future of agentic AI workflows. You’ll take our MCP Server to the next level, turning it into an enterprise-grade service that lets diverse tools and systems be exposed effortlessly to AI agents. Looking ahead, you’ll also help architect the MCP Gateway—a new layer that will route requests across tools, enforce policies, and provide the runtime foundation for scalable multi-agent systems. Along the way, you’ll tackle challenges in scalability, performance, and developer experience to ensure our platform feels seamless, powerful, and enterprise-ready.

Job Responsibility:

Architect and scale an enterprise AI/MCP Server and Gateway that powers multi-agent workflows across Apollo, including routing, orchestration, and integration boundaries
Design and implement robust server infrastructure to ensure reliability, performance, and security at scale
Build and maintain tools for agent discovery, communication, and coordination
Define deployment strategies and runtime optimizations to maximize efficiency and minimize operational overhead
Develop frameworks and patterns that enable seamless multi-agent collaboration and AI-driven orchestration
Integrate observability, logging, and monitoring for full visibility into server and agent behavior
Explore and implement AI-enhanced developer workflows to optimize orchestration and agent interactions
Collaborate with teams across Apollo to ensure the MCP Server meets evolving product and developer needs

Requirements:

Expertise in agent-to-tool orchestration, routing, and coordination in scalable, fault-tolerant systems
Deep expertise in Rust programming language
Strong background in distributed systems, server architecture, and high-performance backend development
Proven experience with protocol design, message routing, and server-side orchestration frameworks
Experience building and maintaining robust runtime infrastructure that supports AI-driven workflows and enables reliable agent-to-tool interactions
Proven experience with protocol design, message routing, and building server-side frameworks that enable scalable, reliable multi-tool agent workflows
Hands-on experience with observability, monitoring, and debugging frameworks for complex systems
Passion for clean, maintainable code, high system reliability, and scalable architecture
Experience in strategic system design, making architectural trade-offs, and planning for long-term scalability and maintainability
Strong technical leadership and mentorship, including guiding junior engineers and driving engineering best practices across teams
Ability to influence cross-team architecture decisions and align engineering efforts with product and business objectives
Production ownership experience: leading incident response, debugging, and performance optimization in high-impact backend systems

Nice to have:

Exposure to AI/ML-enabled developer tooling or autonomous system orchestration
Familiarity with cloud-native architectures, containerization, or orchestration frameworks
Experience with performance optimization and cost-efficient scaling of high-throughput distributed systems

What we offer:

Offers Equity
Choice of 3 Anthem Blue Cross medical plans (California residents can also choose from an additional 2 Kaiser medical plans)
Dental and Vision benefits are provided by Sun Life Financial

Additional Information:

Job Posted:
December 06, 2025

Employment Type:

Fulltime

Work Type:

Remote work

View All Jobs In This Company

Job Link Share:

Staff Software Engineer, AI Runtime