CrawlJobs Logo

Staff Software Engineer, AI Runtime

apollographql.com Logo

Apollo GraphQL

Location Icon

Location:
United States

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

185000.00 - 215000.00 USD / Year

Job Description:

We’re seeking a Staff Software Engineer to help power the future of agentic AI workflows. You’ll take our MCP Server to the next level, turning it into an enterprise-grade service that lets diverse tools and systems be exposed effortlessly to AI agents. Looking ahead, you’ll also help architect the MCP Gateway—a new layer that will route requests across tools, enforce policies, and provide the runtime foundation for scalable multi-agent systems. Along the way, you’ll tackle challenges in scalability, performance, and developer experience to ensure our platform feels seamless, powerful, and enterprise-ready.

Job Responsibility:

  • Architect and scale an enterprise AI/MCP Server and Gateway that powers multi-agent workflows across Apollo, including routing, orchestration, and integration boundaries
  • Design and implement robust server infrastructure to ensure reliability, performance, and security at scale
  • Build and maintain tools for agent discovery, communication, and coordination
  • Define deployment strategies and runtime optimizations to maximize efficiency and minimize operational overhead
  • Develop frameworks and patterns that enable seamless multi-agent collaboration and AI-driven orchestration
  • Integrate observability, logging, and monitoring for full visibility into server and agent behavior
  • Explore and implement AI-enhanced developer workflows to optimize orchestration and agent interactions
  • Collaborate with teams across Apollo to ensure the MCP Server meets evolving product and developer needs

Requirements:

  • Expertise in agent-to-tool orchestration, routing, and coordination in scalable, fault-tolerant systems
  • Deep expertise in Rust programming language
  • Strong background in distributed systems, server architecture, and high-performance backend development
  • Proven experience with protocol design, message routing, and server-side orchestration frameworks
  • Experience building and maintaining robust runtime infrastructure that supports AI-driven workflows and enables reliable agent-to-tool interactions
  • Proven experience with protocol design, message routing, and building server-side frameworks that enable scalable, reliable multi-tool agent workflows
  • Hands-on experience with observability, monitoring, and debugging frameworks for complex systems
  • Passion for clean, maintainable code, high system reliability, and scalable architecture
  • Experience in strategic system design, making architectural trade-offs, and planning for long-term scalability and maintainability
  • Strong technical leadership and mentorship, including guiding junior engineers and driving engineering best practices across teams
  • Ability to influence cross-team architecture decisions and align engineering efforts with product and business objectives
  • Production ownership experience: leading incident response, debugging, and performance optimization in high-impact backend systems

Nice to have:

  • Exposure to AI/ML-enabled developer tooling or autonomous system orchestration
  • Familiarity with cloud-native architectures, containerization, or orchestration frameworks
  • Experience with performance optimization and cost-efficient scaling of high-throughput distributed systems
What we offer:
  • Offers Equity
  • Choice of 3 Anthem Blue Cross medical plans (California residents can also choose from an additional 2 Kaiser medical plans)
  • Dental and Vision benefits are provided by Sun Life Financial

Additional Information:

Job Posted:
December 06, 2025

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Staff Software Engineer, AI Runtime

Staff AI Developer Productivity Engineer

This is a staff-level, hands-on role at the intersection of Developer Productivi...
Location
Location
United Kingdom , London OR Chester
Salary
Salary:
Not provided
equalsplc.com Logo
Equals Group PLC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years in software engineering with a track record of building internal developer tooling/DevEx (CLI/IDE plugins, bots, internal services or web apps)
  • Strong proficiency in TypeScript/Node.js, C#/.NET and front-end experience with React/Next.js
  • Hands-on LLM integration: prompting, tool/function calling, retrieval (embeddings/vector stores) and basic evaluation of quality
  • Solid understanding of CI/CD, test strategy and code-quality tooling
  • able to design fast inner loops and reliable pipelines
  • Product mindset: discovery interviews, hypothesis-driven experiments, before/after evaluation and clear business cases
  • Excellent communication and influence skills
  • comfortable enabling teams via docs, workshops and remote office hours
  • A role model for our values: Make it happen
  • Succeed together
Job Responsibility
Job Responsibility
  • AI-first discovery roadmap - Interview engineers, analyse telemetry and prioritise the highest-leverage opportunities across coding, review, testing, releases and knowledge flows. Set baselines and target deltas and maintain a transparent backlog/roadmap grounded in measurable outcomes
  • Ship internal tools - Build and maintain AI-augmented dev tools across IDE/CLI, GitHub, Slack, Notion, Retool and internal web apps that reduce manual effort and cycle time
  • Agentic flows across the SDLC - Design structured, agentic workflows (including MCP and tool-use with human-in-the-loop gates) to improve code authoring/review, test creation/selection and the release, incident response and onboarding processes
  • Frontier scouting & evaluation - Continuously experiment with cutting-edge AI models, frameworks and runtimes
  • run short, hypothesis-driven pilots with clear success criteria and developer-fit assessments
  • productionise successful approaches
  • Automation pipelines - Implement LLM-assisted and AST-based code-mod workflows for migrations, boilerplate generation, test creation and docs updates
  • Enablement & change management - Drive adoption with playbooks, golden prompts, demos, office hours and a champions network across build teams
  • measure usage and satisfaction and iterate
What we offer
What we offer
  • 25 days holiday per year + your birthday off
  • Opportunities for progression, development and learning new skills - £250 towards the cost of learning & development
  • Free onsite Nuffield Health gym & pool (London) and discounted gym membership elsewhere
  • GetActive with Aviva - Health and Wellbeing discounts on services and products
  • Interbank currency rates on travel money and international transfers
  • Bupa Private Healthcare
  • Free Eye Test and £50 up to the cost of glasses
  • EAP Service - Mental Health Services
  • Life Assurance Policy - x3 annual salary
  • Contributory pension scheme
Read More
Arrow Right

Staff Product Security Engineer

We’re looking for a Staff Product Security Engineer to lead the design and imple...
Location
Location
United States
Salary
Salary:
184000.00 - 252000.00 USD / Year
alpha-sense.com Logo
AlphaSense
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in product, application, or cloud security engineering
  • Deep understanding of secure SDLC, threat modeling, and secure architecture design
  • Proven expertise with AWS cloud security concepts and best practices
  • Strong experience with container security, orchestration, and runtime protection
  • Proficiency in Python, Java, and/or JavaScript for security automation, code review, and tooling
  • Experience securing AI/ML pipelines, data workflows, or model-serving infrastructure
  • Familiarity with DevSecOps and continuous integration/deployment environments
Job Responsibility
Job Responsibility
  • Embed robust security practices throughout the software and AI development lifecycle (SDLC)
  • Lead secure design reviews, threat modeling, and risk assessments for AI-driven products, APIs, and backend services
  • Partner with engineering and product teams to ensure security, privacy, and compliance by design
  • Build and maintain security automation and governance frameworks that integrate seamlessly into development workflows
  • Architect and enforce security controls for AI/ML systems, including model training, data pipelines, and inference environments
  • Identify and mitigate AI-specific attack vectors such as data poisoning, model inversion, prompt injection, and model theft
  • Collaborate with governance and compliance teams to align with ethical AI principles and frameworks like NIST AI RMF and the EU AI Act
  • Implement model provenance, integrity, and auditability controls to ensure responsible and secure AI operations
  • Partner with DevOps and SRE teams to secure service meshes, container networking, and secrets management
  • Drive software supply chain security, including artifact integrity, dependency management, and vulnerability reduction
What we offer
What we offer
  • Competitive compensation, benefits, and career growth opportunities
  • Opportunity to shape and drive product security strategy
  • Collaborative and security-minded engineering culture
  • Work on cutting-edge security challenges in a fast-growing company
  • Performance-based bonus, equity, and a generous benefits program
  • Fulltime
Read More
Arrow Right

Staff Infrastructure Software Engineer - AI Platform

We are currently seeking a Staff Software Engineer to join the AI Platform team ...
Location
Location
United Kingdom , Edinburgh
Salary
Salary:
Not provided
addepar.com Logo
Addepar
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience as a Software/Backend Engineer, with a track record of taking on increasing responsibility
  • Experience across the full product lifecycle: designing, implementing, shipping, scaling, operationalizing, and maintaining technology/SaaS products
  • Exceptional Programming skills and fundamentals in Python/Go/Java, with a proven track record of building large scale production systems
  • Proficient experience with diverse compute environments including microservices (K8s), Databricks and serverless architectures (e.g. AWS Lambda)
  • Demonstrable experience leading initiatives with infrastructure-as-code tools such as Terraform in complex, multi-account environments
  • Proficient experience with comprehensive monitoring and alerting stacks (e.g. Prometheus/Grafana/Sentry/cloud-native tools), with a focus on observability strategy
  • Excellent interpersonal and communication skills to effectively collaborate with multi-functional teams, articulate complex technical concepts, and influence outcomes
Job Responsibility
Job Responsibility
  • Design and build the production runtime for LLM-based agents and products, creating the services and infrastructure that serve autonomous agents
  • Develop deep application-level knowledge to proactively inform and influence requirements, constraints and best practices for implementing composable, complex AI systems
  • Lead the design, implementation, and automation of production infrastructure on a variety of cloud environments (Kubernetes/Databricks), to enable us to ship and scale AI features instantly
  • Evangelize and promote disciplined, best engineering practices to enforce strong production hygiene and culture
  • Initiate and lead collaborations with cross-functional teams to identify and resolve complex application or infrastructure issues, serving as a technical subject matter expert
  • Architect, build, and maintain advanced, automated CI/CD pipelines e.g. using Jenkins, ArgoCD, AWS CodeBuild/Pipeline, GitHub Actions, or similar, establishing best practices for deployment strategies (e.g., blue/green, canary)
  • Develop systems and best practices monitoring, alerting, and troubleshooting of our probabilistic and AI-driven systems and broader software stack
Read More
Arrow Right

Staff Infrastructure Software Engineer - AI Platform

We are currently seeking a Staff Software Engineer to join the AI Platform team ...
Location
Location
Canada
Salary
Salary:
Not provided
addepar.com Logo
Addepar
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience as a Software/Backend Engineer, with a track record of taking on increasing responsibility
  • Experience across the full product lifecycle: designing, implementing, shipping, scaling, operationalizing, and maintaining technology/SaaS products
  • Exceptional Programming skills and fundamentals in Python/Go/Java, with a proven track record of building large scale production systems
  • Proficient experience with diverse compute environments including microservices (K8s), Databricks and serverless architectures (e.g. AWS Lambda)
  • Demonstrable experience leading initiatives with infrastructure-as-code tools such as Terraform in complex, multi-account environments
  • Proficient experience with comprehensive monitoring and alerting stacks (e.g. Prometheus/Grafana/Sentry/cloud-native tools), with a focus on observability strategy
  • Excellent interpersonal and communication skills to effectively collaborate with multi-functional teams, articulate complex technical concepts, and influence outcomes
  • Applicants must have legal authorization to work in the country where this role is based on the first day of employment
Job Responsibility
Job Responsibility
  • Design and build the production runtime for LLM-based agents and products, creating the services and infrastructure that serve autonomous agents
  • Develop deep application-level knowledge to proactively inform and influence requirements, constraints and best practices for implementing composable, complex AI systems
  • Lead the design, implementation, and automation of production infrastructure on a variety of cloud environments (Kubernetes/Databricks), to enable us to ship and scale AI features instantly
  • Evangelize and promote disciplined, best engineering practices to enforce strong production hygiene and culture
  • Initiate and lead collaborations with cross-functional teams to identify and resolve complex application or infrastructure issues, serving as a technical subject matter expert
  • Architect, build, and maintain advanced, automated CI/CD pipelines e.g. using Jenkins, ArgoCD, AWS CodeBuild/Pipeline, GitHub Actions, or similar, establishing best practices for deployment strategies (e.g., blue/green, canary)
  • Develop systems and best practices monitoring, alerting, and troubleshooting of our probabilistic and AI-driven systems and broader software stack
Read More
Arrow Right
New

Patient Support & Experience Lead

You’ll lead our Support Associates and Medical Support Associates, owning the en...
Location
Location
Canada , Toronto
Salary
Salary:
Not provided
eucalyptus.health Logo
Eucalyptus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-5+ years of experience in customer support, or customer service — ideally in a fast-paced or regulated environment (e.g. healthtech, consumer startups, or logistics)
  • Team leadership experience — you’ve managed or mentored others before and are excited to grow into a larger people management role
  • Fluency in English — you’ve got excellent written and verbal communication skills to explain complex issues in a simple way
  • Strong analytical and problem-solving skills — you own the ability to quickly diagnose issues and implement solutions that are data-driven
  • you should be highly adept at modelling solutions in Excel / Google sheets
  • Highly organised and adaptable — you’re proactive, detail-oriented, and able to manage shifting priorities
  • Empathetic and patient-first mindset — you’re passionate about helping people and improving their experience at every step
Job Responsibility
Job Responsibility
  • Lead our Support Associates and Medical Support Associates, owning the end-to-end patient support experience across onboarding, treatment, and ongoing care
  • Design and optimise operational workflows: Improve coordination between support, clinical, and pharmacy teams to drive faster, more effective patient outcomes. Identify bottlenecks and implement scalable processes
  • Act as the escalation point for critical issues: Lead resolution of high-impact patient issues and implement long-term solutions to prevent recurrence
  • Drive performance through data: Build dashboards, conduct root-cause analyses, and make data-backed recommendations that improve quality and efficiency
  • Support cross-functional expansion projects: Partner with product, ops, and growth to successfully and efficiently scale our Canada business
What we offer
What we offer
  • Access a professional development budget and 3 days of professional development leave
  • Private medical insurance (Silver plan) and private pension (0% coverage)
  • 20 days of annual leave, 10 days of sick leave, and flexibility designed to support sustainable work
  • Fulltime
Read More
Arrow Right
New

Midday Supervisor

Silloth Primary School has a vacancy for a Relief Mid-day Supervisor starting as...
Location
Location
United Kingdom , Silloth
Salary
Salary:
24796.00 GBP / Year
Eden View Care and Response
Expiration Date
January 29, 2026
Flip Icon
Requirements
Requirements
  • Enhanced DBS check
  • references received and followed-up
  • experience working with children
  • Parttime
!
Read More
Arrow Right
New

Business continuity senior specialist

We are seeking a Business Continuity Specialist to support the implementation an...
Location
Location
Romania , Bucuresti
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in Business Continuity Management (minimum 3 years)
  • Strong stakeholder management and influencing skills
  • Ability to analyse complex information and communicate clearly and effectively
  • Commercial awareness and sound judgement in risk-based decision-making
  • Telecom industry experience is preferred
Job Responsibility
Job Responsibility
  • Deliver Business Continuity Management activities as part of a collaborative team
  • Provide subject matter expertise in BCM to ensure a robust BCMS framework
  • Support Group entities in embedding BCM into daily operations and decision-making processes
  • Monitor and review BCMS compliance, identifying opportunities for continuous improvement
  • Prepare and deliver regular reports on compliance status and BCM activity progress
What we offer
What we offer
  • Hybrid way of working: 2 days from office per week (8 per month)
  • Medical and dental services
  • Life and hospitalization insurance
  • Dedicated employee phone subscription
  • Take control of your benefits and choose any of the following options: meal tickets / private pension / vacation vouchers / cultural vouchers - within the budget
  • Special discounts for gyms and retailers
  • Annual Company Bonus
  • Ongoing Education
  • You get to work with tried and trusted web-technology
  • We let you write your own story by planning vacations: go for a trip, experience new things, have fun and enjoy your 23 days off
  • Fulltime
Read More
Arrow Right
New

Clerk to the Governing Body

Silloth Primary School has an exciting opportunity for a Clerk To The Governing ...
Location
Location
United Kingdom , Silloth
Salary
Salary:
12.85 GBP / Hour
Eden View Care and Response
Expiration Date
January 29, 2026
Flip Icon
Requirements
Requirements
  • Assist with agenda planning
  • Attend and minute committee meetings and full governor meetings
  • Liaise regularly with the Chair of Governors & the Head Teacher
  • Be flexible and reliable
  • Be available to work during the school day and some evenings
  • Subject to an Enhanced DBS check
  • Parttime
!
Read More
Arrow Right