CrawlJobs Logo

Senior Software Engineer, AI Runtime

apollographql.com Logo

Apollo GraphQL

Location Icon

Location:
United States

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

157000.00 - 198900.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

We’re seeking a Senior Software Engineer to help power the future of agentic AI workflows. You’ll take our MCP Server to the next level, turning it into an enterprise-grade service that lets diverse tools and systems be exposed effortlessly to AI agents. Looking ahead, you’ll also help architect the MCP Gateway—a new layer that will route requests across tools, enforce policies, and provide the runtime foundation for scalable multi-agent systems. Along the way, you’ll tackle challenges in scalability, performance, and developer experience to ensure our platform feels seamless, powerful, and enterprise-ready.

Job Responsibility:

  • Scale an enterprise AI/MCP Server and Gateway that powers multi-agent workflows across Apollo, including routing, orchestration, and integration boundaries
  • Implement robust server infrastructure to ensure reliability, performance, and security at scale
  • Build and maintain tools for agent discovery, communication, and coordination
  • Define deployment strategies and runtime optimizations to maximize efficiency and minimize operational overhead
  • Develop frameworks and patterns that enable seamless multi-agent collaboration and AI-driven orchestration
  • Integrate observability, logging, and monitoring for full visibility into server and agent behavior
  • Explore and implement AI-enhanced developer workflows to optimize orchestration and agent interactions
  • Collaborate with teams within our org to ensure the MCP Server meets evolving product and developer needs

Requirements:

  • Expertise in agent-to-tool orchestration, routing, and coordination in scalable, fault-tolerant systems
  • Deep expertise in Rust programming language
  • Strong background in distributed systems, server architecture, and high-performance backend development
  • Proven experience with protocol design, message routing, and server-side orchestration frameworks
  • Experience building and maintaining robust runtime infrastructure that supports AI-driven workflows and enables reliable agent-to-tool interactions
  • Proven experience with protocol design, message routing, and building server-side frameworks that enable scalable, reliable multi-tool agent workflows
  • Hands-on experience with observability, monitoring, and debugging frameworks for complex systems
  • Passion for clean, maintainable code, high system reliability, and scalable architecture
  • Experience in strategic system design, making architectural trade-offs, and planning for long-term scalability and maintainability
  • Strong technical leadership and mentorship, including guiding junior engineers and driving engineering best practices across teams
  • Ability to influence cross-team architecture decisions and align engineering efforts with product and business objectives
  • Production ownership experience: leading incident response, debugging, and performance optimization in high-impact backend systems

Nice to have:

  • Exposure to AI/ML-enabled developer tooling or autonomous system orchestration
  • Familiarity with cloud-native architectures, containerization, or orchestration frameworks
  • Experience with performance optimization and cost-efficient scaling of high-throughput distributed systems

Additional Information:

Job Posted:
December 06, 2025

Work Type:
Remote work
Icon
Apollo GraphQL - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Software Engineer, AI Runtime

Senior Solution Engineer

JFrog is expanding in APAC, and we are looking for a strong Senior Solution Engi...
Location
Location
Singapore
Salary
Salary:
Not provided
jfrog.com Logo
JFrog
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in pre-sales, solutions engineering, DevOps consulting, or platform engineering
  • Hands-on knowledge of Docker, Kubernetes, Git, Jenkins/GitHub/GitLab, cloud-native architectures
  • Strong communication and customer-facing skills
  • Based in Singapore and open to travel across SEA and Korea
Job Responsibility
Job Responsibility
  • Lead technical discovery, demos, and POCs for customers in SEA + Korea
  • Architect CI/CD, DevSecOps, and software supply chain solutions using the JFrog Platform
  • Work closely with sales, product, R&D, and channel partners
  • Represent JFrog at regional events, workshops, and customer sessions
  • Support enterprise adoption of Artifactory, Xray, Curation, Advanced Security, AI Catalog, Runtime, and more
Read More
Arrow Right

Senior Software Developer

Our client is looking for a Senior Software Developer for a 5 month contract in ...
Location
Location
Canada , North York
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
January 29, 2026
Flip Icon
Requirements
Requirements
  • 7+ years hands-on Java development in an enterprise environment, including Spring Boot, REST API design, integration patterns, and production support / incident management
  • Strong SQL and data handling expertise: capable of analyzing schemas, building optimized queries, integrating APIs with data stores, and enforcing data quality in service logic
  • Proven experience supporting applications in production: triaging defects, analyzing incident root cause, applying hotfixes, improving resiliency and performance
  • Ability to consume and operationalize AI services: call LLM endpoints, handle prompt/response patterns, enforce guardrails, and log usage safely
  • Practical understanding of core ML / LLM concepts (supervised vs unsupervised learning, prompt engineering, retrieval, drift) sufficient to collaborate with data/AI teams and ship AI-enabled features
  • Comfort working in a secure, governed environment (privacy, PII protection, access control, auditability)
  • Strong Java and Spring Boot experience building enterprise services at scale (API design, dependency management, error handling, observability, performance tuning)
  • Advanced SQL fluency (Oracle, MySQL, PostgreSQL) — complex joins, window functions, data validation, and query optimization
  • Working knowledge of data modeling, ETL/ELT pipelines, and API-driven data integration
  • Hands-on experience with Git, automated testing, secure coding practices, code reviews, and CI/CD pipelines
Job Responsibility
Job Responsibility
  • Design, build, and maintain secure, scalable Java services and APIs using Spring Boot
  • Translate technical requirements into production-grade application code, integration logic, and robust data access layers
  • Write clean, testable Java (unit, integration, regression), contribute to CI/CD pipelines, and support automated deployments
  • Design, build, and optimize data workflows – including SQL queries, ETL logic, and caching for reliability, integrity, and performance in production
  • Collaborate with data engineers and analysts to ensure service-layer alignment with enterprise data models and reporting needs
  • Diagnose and resolve production issues (performance, defects, incidents)
  • participate in on-call / support rotations as needed
  • Review code, enforce engineering standards, document solutions, and mentor intermediate developers
  • Collaborate with architects, QA, product owners, and business SMEs in an iterative / Agile delivery model to plan, scope, and land increments
  • Apply AI/ML capabilities (LLMs, retrieval-augmented generation, classic ML models) to enhance existing Java services where appropriate
What we offer
What we offer
  • Earn a competitive rate within the industry
  • Potential for extension
  • Fulltime
Read More
Arrow Right

Principal Engineer

The Principal AI/ML Operations Engineer leads the architecture, automation, and ...
Location
Location
United States , Pleasanton, California
Salary
Salary:
251000.00 - 314500.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field
  • 10+ years in ML infrastructure, DevOps, and software system architecture
  • 4+ years in leading MLOps or AI Ops platforms
  • Strong programming skills in languages such as Python, Java, or Scala
  • Expertise in ML frameworks (TensorFlow, PyTorch, scikit-learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow)
  • Proven experience operating production pipelines for ML and LLM-based systems across cloud ecosystems (GCP, AWS, Azure)
  • Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management
  • Strong competencies in CI/CD, IaC, and DevSecOps pipelines integrating testing, compliance, and deployment automation
  • Hands-on with observability stacks (Prometheus, Grafana, Newrelic) for model and agent performance tracking
  • Understanding of governance frameworks for Responsible AI, auditability, and cost metering across training and inference workloads
Job Responsibility
Job Responsibility
  • Define enterprise-level standards and reference architectures for ML-Ops and AIOps systems
  • Partner with data science, security, and product teams to set evaluation and governance standards (Guardrails, Bias, Drift, Latency SLAs)
  • Mentor senior engineers and drive design reviews for ML pipelines, model registries, and agentic runtime environments
  • Lead incident response and reliability strategies for ML/AI systems
  • Lead the deployment of AI models and systems in various environments
  • Collaborate with development teams to integrate AI solutions into existing workflows and applications
  • Ensure seamless integration with different platforms and technologies
  • Define and manage MCP Registry for agentic component onboarding, lifecycle versioning, and dependency governance
  • Build CI/CD pipelines automating LLM agent deployment, policy validation, and prompt evaluation of workflows
  • Develop and operationalize experimentation frameworks for agent evaluations, scenario regression, and performance analytics
What we offer
What we offer
  • short-term and long-term incentive programs
  • robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, SDK (Client Runtime)

We have an opening to hire a Senior Software Engineer - SDK (Client Runtime). Ou...
Location
Location
United States
Salary
Salary:
168000.00 - 210000.00 USD / Year
temporal.io Logo
Temporal
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 10 years experience post graduation writing scalable software
  • BS or MS in Computer Science (or a closely-related degree), or equivalent work experience writing production-grade software
  • Fluency in multiple programming languages, and an affinity for learning new ones
  • Deep experience with concurrent programming
  • Deep experience with distributed systems
  • Experience designing APIs and writing documentation for publicly-available libraries or modules
  • A methodical, detail-oriented approach to your work
  • Strong technical communication skills—written and verbal—in English
  • A deep sense of ownership and personal accountability
  • A proactive approach to managing your work
Job Responsibility
Job Responsibility
  • Take end-to-end ownership of new features
  • Design and build Temporal SDKs used by customers
  • Tightly integrate Temporal SDKs with their respective languages
  • Develop features that provide a foundation for the reliable execution of the current wave of agentic AI systems
  • Work directly with our community to debug issues
  • Write publicly-readable technical documentation
  • Go the extra mile to support a customer in need
  • Travel to meet your coworkers for a week once or twice a year
  • Attend the occasional developer conference
What we offer
What we offer
  • Unlimited PTO, 12 Holidays + 2 Floating Holidays
  • 100% Premiums Coverage for Medical, Dental, and Vision
  • AD&D, LT & ST Disability, and Life Insurance
  • Empower 401K Plan
  • Additional Perks for Learning & Development, Lifestyle Spending, In-Home Office Setup, Professional Memberships, WFH Meals, Internet Stipend
  • $3,600 / Year Work from Home Meals
  • $1,500 / Year Career Development & Learning
  • $1,200 / Year Lifestyle Spending Account
  • $1,000 / Year In-Home Office Setup
  • $500 / Year Professional Memberships
  • Fulltime
Read More
Arrow Right

Senior Cybersecurity Engineer - AI

The Cybersecurity Engineer will help ensure that our software, systems and infra...
Location
Location
United States , Frisco
Salary
Salary:
103400.00 - 186400.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree, Computer Science, or Information Technology (required)
  • 4-7 years’ Experience in info security technology or related field
  • 2+ years of experience working with Generative AI models, AI APIs ( such as OpenAI, Hugging Face, or similar), and AI / ML integration in software development
  • Led rollouts and production hardening for AI Security platforms such as Reco (AI‑SPM/SaaS discovery), Knostic (NTK policies), S1/Prompt Security (endpoint guardrails), or equivalent tools
  • Implemented SSO/MFA, SCIM, RBAC and Need‑to‑Know models for AI workflows
  • partnered with Data Protection on Varonis classification and lineage
  • Experience with incident handling for Security breaches
  • 2-4 years’ Technical Project Management
  • Experience with high level design architecture, security technologies, Networking, web services and SOA
  • Understanding of encryption, obfuscation, tokenization technologies
Job Responsibility
Job Responsibility
  • Lead AI use‑case intake & security reviews
  • document decisions, compensating controls, and audit evidence
  • Perform and guide threat modeling for AI/data/agent workflows
  • translate findings into technical requirements for gateways, guardrails, and NTK enforcement
  • Define, publish, and maintain AI security standards/guardrails (prompt/log retention, purpose‑binding, kill‑switch, secrets handling, retention/expiration)
  • Engineer identity & access controls (SSO/MFA, SCIM, RBAC) that enforce Need‑to‑Know
  • coordinate with Data Protection on Data Security Posture Management and permission awareness
  • Operationalize runtime protections: deploy/monitor AI and Data Security frameworks, AI discovery & policy enforcement
  • integrate Prompt Security and cloud and SaaS posture signals (e.g., Wiz)
  • Leads security, compliance, and risk assessments on projects throughout project lifecycle
What we offer
What we offer
  • competitive base salary and compensation package
  • annual stock grant
  • employee stock purchase plan
  • 401(k)
  • access to free, year-round money coaches
  • annual bonus or periodic sales incentive or bonus
  • medical, dental and vision insurance
  • flexible spending account
  • employee stock grants
  • employee stock purchase plan
  • Fulltime
Read More
Arrow Right
New

Principal Software Engineer, CoreAI

Join Microsoft’s AI Core team building high performance runtime systems that ser...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in systems programming with strong expertise in C++
  • Proven experience building, deploying, and operating scalable cloud services
  • Strong debugging skills and experience using performance profiling and diagnostic tools
  • Hands-on experience with distributed systems, Kubernetes, and containerized workloads
  • Experience with largescale LLM inferencing infrastructure, including CUDA
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Design and implement high performance microservices and runtime components in C++
  • Optimize AI inferencing systems for latency, throughput, cost, and reliability at large scale
  • Debug and resolve complex production issues related to performance, scaling, and service reliability
  • Collaborate with cross-functional partners to integrate model inference pipelines into scalable infrastructure
  • Contribute to state-of-the-art multimodal inferencing systems supporting text, speech, and vision workloads
  • Drive systems level innovations for realtime and batch inferencing efficiency
  • Participate in code reviews and provide technical mentorship to senior and peer engineers
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Open Source Nexus SDK

As a Senior Software Engineer, Open Source Nexus SDK, you will build and evolve ...
Location
Location
United States
Salary
Salary:
185000.00 - 225000.00 USD / Year
temporal.io Logo
Temporal
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 6 years of experience in a production environment as an 'Arranger' and/or 'Builder/Enhancer' of highly scalable distributed systems
  • Solid computer science fundamentals in distributed systems concepts including multi-threading and concurrency
  • Experience writing concurrent code in production with languages like Go, Java, Python, Typescript, .NET or other applicable languages with skill level as 'high end of Intermediate' and/or 'Advanced' or 'Expert' levels
  • Experience designing APIs, SDK libraries or working with Open Source Systems
Job Responsibility
Job Responsibility
  • Take end-to-end ownership of new features, working with others in the Nexus and OSS teams to deliver exceptional reliability and a great developer experience
  • Design and build Nexus interfaces for the Temporal SDKs used by customers to work with Temporal in their programming language of choice
  • Tightly integrate Temporal SDKs with their respective languages, making best use of type systems and language runtimes, to execute application code in a durable, deterministic way
  • Develop features that provide a foundation for the reliable execution of the current wave of agentic AI systems
  • Work directly with our community to debug issues that need expert attention, and get feedback on Temporal SDK features and APIs
  • Write publicly-readable technical documentation describing Temporal concepts and APIs
  • Travel to meet your coworkers for a week once or twice a year
What we offer
What we offer
  • Unlimited PTO, 12 Holidays + 2 Floating Holidays
  • 100% Premiums Coverage for Medical, Dental, and Vision
  • AD&D, LT & ST Disability, and Life Insurance (Standard & Supplemental Available)
  • Empower 401K Plan
  • Additional Perks for Learning & Development, Lifestyle Spending, In-Home Office Setup, Professional Memberships, WFH Meals, Internet Stipend and more
  • $3,600 / Year Work from Home Meals
  • $1,500 / Year Career Development & Learning
  • $1,200 / Year Lifestyle Spending Account
  • $1,000 / Year In-Home Office Setup (In addition to Temporal issued equipment)
  • $500 / Year Professional Memberships
  • Fulltime
Read More
Arrow Right
New

Dental Nurse

We’re delighted to be recruiting an experienced, qualified Dental Nurse to join ...
Location
Location
United Kingdom , Nottingham
Salary
Salary:
Not provided
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Current GDC registration is required
  • A reliable team player with a positive, professional approach
  • Patient-focused with good communication skills
  • Comfortable working in a busy practice environment
Job Responsibility
Job Responsibility
  • Working closely with the clinical team and supporting a positive, well-run patient experience, including reception cover when needed
What we offer
What we offer
  • GDC, indemnity, and CPD fully funded
  • On-site parking for easy commuting
  • Paid day off for your birthday
  • Option to purchase up to an additional week of annual leave
  • Career development opportunities, including funded postgraduate courses
  • Contributory pension scheme
  • Uniform provided
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Poland Jobs Ireland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy