CrawlJobs Logo

Software Engineer, AI Gateway

vercel.com Logo

Vercel

Location Icon

Location:
United States , San Francisco ▼

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

196000.00 - 294000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.

Job Responsibility:

  • Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability
  • Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests
  • Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges
  • Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools
  • Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights

Requirements:

  • At least 5+ years of relevant experience
  • Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
  • Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
  • Experience contributing to or participating in open source projects
  • Excellent communication skills and the ability to work effectively in a collaborative team environment
What we offer:
  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills
  • Flexible Time Off
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed

Additional Information:

Job Posted:
February 14, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Vercel - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer, AI Gateway

Senior Software Engineer, AI Runtime

We’re seeking a Senior Software Engineer to help power the future of agentic AI ...
Location
Location
United States
Salary
Salary:
157000.00 - 198900.00 USD / Year
apollographql.com Logo
Apollo GraphQL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expertise in agent-to-tool orchestration, routing, and coordination in scalable, fault-tolerant systems
  • Deep expertise in Rust programming language
  • Strong background in distributed systems, server architecture, and high-performance backend development
  • Proven experience with protocol design, message routing, and server-side orchestration frameworks
  • Experience building and maintaining robust runtime infrastructure that supports AI-driven workflows and enables reliable agent-to-tool interactions
  • Proven experience with protocol design, message routing, and building server-side frameworks that enable scalable, reliable multi-tool agent workflows
  • Hands-on experience with observability, monitoring, and debugging frameworks for complex systems
  • Passion for clean, maintainable code, high system reliability, and scalable architecture
  • Experience in strategic system design, making architectural trade-offs, and planning for long-term scalability and maintainability
  • Strong technical leadership and mentorship, including guiding junior engineers and driving engineering best practices across teams
Job Responsibility
Job Responsibility
  • Scale an enterprise AI/MCP Server and Gateway that powers multi-agent workflows across Apollo, including routing, orchestration, and integration boundaries
  • Implement robust server infrastructure to ensure reliability, performance, and security at scale
  • Build and maintain tools for agent discovery, communication, and coordination
  • Define deployment strategies and runtime optimizations to maximize efficiency and minimize operational overhead
  • Develop frameworks and patterns that enable seamless multi-agent collaboration and AI-driven orchestration
  • Integrate observability, logging, and monitoring for full visibility into server and agent behavior
  • Explore and implement AI-enhanced developer workflows to optimize orchestration and agent interactions
  • Collaborate with teams within our org to ensure the MCP Server meets evolving product and developer needs
Read More
Arrow Right

Staff Software Engineer, AI Runtime

We’re seeking a Staff Software Engineer to help power the future of agentic AI w...
Location
Location
United States
Salary
Salary:
185000.00 - 215000.00 USD / Year
apollographql.com Logo
Apollo GraphQL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expertise in agent-to-tool orchestration, routing, and coordination in scalable, fault-tolerant systems
  • Deep expertise in Rust programming language
  • Strong background in distributed systems, server architecture, and high-performance backend development
  • Proven experience with protocol design, message routing, and server-side orchestration frameworks
  • Experience building and maintaining robust runtime infrastructure that supports AI-driven workflows and enables reliable agent-to-tool interactions
  • Proven experience with protocol design, message routing, and building server-side frameworks that enable scalable, reliable multi-tool agent workflows
  • Hands-on experience with observability, monitoring, and debugging frameworks for complex systems
  • Passion for clean, maintainable code, high system reliability, and scalable architecture
  • Experience in strategic system design, making architectural trade-offs, and planning for long-term scalability and maintainability
  • Strong technical leadership and mentorship, including guiding junior engineers and driving engineering best practices across teams
Job Responsibility
Job Responsibility
  • Architect and scale an enterprise AI/MCP Server and Gateway that powers multi-agent workflows across Apollo, including routing, orchestration, and integration boundaries
  • Design and implement robust server infrastructure to ensure reliability, performance, and security at scale
  • Build and maintain tools for agent discovery, communication, and coordination
  • Define deployment strategies and runtime optimizations to maximize efficiency and minimize operational overhead
  • Develop frameworks and patterns that enable seamless multi-agent collaboration and AI-driven orchestration
  • Integrate observability, logging, and monitoring for full visibility into server and agent behavior
  • Explore and implement AI-enhanced developer workflows to optimize orchestration and agent interactions
  • Collaborate with teams across Apollo to ensure the MCP Server meets evolving product and developer needs
What we offer
What we offer
  • Offers Equity
  • Choice of 3 Anthem Blue Cross medical plans (California residents can also choose from an additional 2 Kaiser medical plans)
  • Dental and Vision benefits are provided by Sun Life Financial
  • Fulltime
Read More
Arrow Right

Senior AI Product Engineer

As a one person team to start, you are both a product lead and the technical SME...
Location
Location
Australia , Melbourne
Salary
Salary:
Not provided
frankieone.com Logo
FrankieOne
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Recent experience in building AI applications with end to end ownership
  • 10 plus years experience in engineering teams in an Agile environment using JS based frameworks like React
  • 5 plus years developing & supporting Full Stack TS-based SaaS applications production in AWS/Cloud ecosystem
  • Experience in HTML5, ES6, CSS3/Sass, javascript, typescript, React, React Native for Web (optional), npm and other front-end technologies to deliver enterprise grade frontend applications
  • Experience in depth of back-end oriented technologies such as nodejs, typescript for managing BFF
  • Knowledge and experience in tracking technological developments especially AI with vendor offerings and ability to quickly evaluate their value proposition e.g AWS Bedrock
  • Experience in architecting & building enterprise grade AI applications with Data and AI governance, AI gateways, context management (RAG), inference/prompt management, tools/functions (MCP, A2A), memory & fine-tuning
  • Experience in capturing business requirements from stakeholders to documenting, architect and building AI applications for both internal and external users
  • Experience in designing web applications based on AWS well architectured principles, 12 factor web application principles, cloud based software architecture patterns (pub-sub, saga, circuit breaker etc)
  • Experience in designing reactjs based frontend and backend in nodejs or golang
Job Responsibility
Job Responsibility
  • Inspire others
  • Design with quality
  • Collaborate
  • Be proactive
  • Be an advocate for FrankieOne, for our product, and our values
Read More
Arrow Right

Staff Software Engineer

We are seeking a Staff Software Engineer to lead the technical vision and execut...
Location
Location
Argentina , Buenos Aires
Salary
Salary:
Not provided
gofundme.com Logo
GoFundMe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional software engineering experience
  • strong full-stack capabilities
  • solid foundation in modern JavaScript/TypeScript development
  • deep experience with frontend and application development, particularly in frameworks such as Angular, React/Next.js
  • strong track record of designing and building APIs, webhooks, and event-driven features
  • experienced with AWS services (Lambda, SQS/SNS, CloudWatch, API Gateway, etc.)
  • skilled at diagnosing and preventing performance and scalability issues using tools such as New Relic, BugSnag
  • take pride in mentoring and supporting other engineers
Job Responsibility
Job Responsibility
  • Define and drive the technical roadmap for the new GoFundMe Pro Live ticketing and events platform
  • lead the design and implementation of core system components, including front-end architecture, APIs, event-driven flows (Kafka/SQS/SNS equivalents), webhooks, and cross-application connectivity
  • champion modern, AI-assisted development tools (e.g., GitHub Copilot, Cursor)
  • mentor and elevate engineers through design reviews, pair programming, technical coaching
  • enhance system reliability and operational excellence by participating in the on-call rotation and leading incident investigation
  • collaborate closely with cross-functional partners—Product, Design, QA, and other engineering teams
What we offer
What we offer
  • Make an Impact: Be part of a mission-driven organization
  • Innovative Environment: Work with a diverse, passionate, and talented team
  • Collaborative Team: Join a fun and collaborative team
  • Competitive Benefits: Enjoy competitive pay and comprehensive healthcare benefits
  • Holistic Support: Enjoy financial assistance for things like hybrid work, family planning, along with generous parental leave, flexible time-off policies, and mental health and wellness resources
  • Growth Opportunities: Participate in learning, development, and recognition programs
  • Commitment to DEI: Contribute to diversity, equity, and inclusion through ongoing initiatives and employee resource groups
  • Community Engagement: Make a difference through our volunteering program
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

We are looking for a passionate back-end Software Engineer who is deeply driven ...
Location
Location
United States
Salary
Salary:
Not provided
cyware.com Logo
Cyware
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • US Citizenship is a requirement of this position in accordance with 8 U.S.C 1324b(a)(2)(C)
  • Bachelor’s degree or higher, in Computer Science, Engineering, IT or a related discipline
  • 5+ years of practical experience in building Django applications is a huge plus
  • Knowledge in Python, with the ability to build efficient REST API using Django REST Framework
  • Experience with AI/ML integrations: building and consuming REST / gRPC services that use LLMs (OpenAI, local models, etc.)
  • Hands-on experience designing and implementing RAG pipelines (vector stores, embeddings, document indexing, retrieval strategies)
  • Experience with Go (GoLang) for building high-performance microservices or backend components is a strong plus
  • Knowledge of scheduling framework or event-driven programming in Django
  • The ability to naturally follow good development practices like test automation, CI/CD, source version control, GitHub, etc.
  • Experience with applications that have scaled
Job Responsibility
Job Responsibility
  • Develop features from proposal to polished end result
  • Manage and review code contributed by the rest of the team and work with them to get it ready for production
  • Take initiative in improving the software in small or large ways to address pain points in your own experience as a developer
  • Keep code easy to maintain and keep it easy for others to contribute
  • Work with multi-disciplinary teams to maintain and support production and operations of Cyware Products
What we offer
What we offer
  • We offer a comprehensive benefits package including time off, paid holidays, retirement plans, insurance coverage and much more
  • We’ll invest in your career
  • We offer competitive compensation packages
  • Fulltime
Read More
Arrow Right

Engineering Manager - AI Tools (Security)

As an Engineering Manager working on internal AI tooling, you will be responsibl...
Location
Location
United States , San Francisco
Salary
Salary:
200000.00 - 250000.00 USD / Year
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Prior experience leading or managing software engineering teams, including mentorship, career development, and performance feedback
  • Proven ability to translate business and security goals into execution plans, aligning roadmap, timelines, and engineering capacity
  • Bachelor’s degree in Computer Science, Information Security, or a related field
  • 8+ years of experience as a Software Engineer
  • Experience with production code bases
  • Experience with at least one scripting language (e.g. Python) and one systems programming language (eg. Golang, C/C++)
  • Experience with modern cloud infrastructure, including data pipelines, serverless workloads, and Kubernetes
  • Proven experience working autonomously on projects - delivering them to a high quality and on time
  • Excellent communication and interpersonal skills, with the ability to work effectively with both technical and non-technical stakeholders
  • Ability to dive deep to find the best solution to a problem
Job Responsibility
Job Responsibility
  • Manage and lead a team of engineers, providing technical direction, setting clear goals, and ensuring high-quality, timely delivery of AI-powered security tooling
  • Own team execution and delivery, including planning, prioritization, resourcing, and performance management while balancing hands-on technical leadership
  • Lead the development of AI tools and applications, from inception to implementation
  • Support incident response efforts by building ad-hoc tools for threat hunting, remediation and scanners
  • Build, monitor, and maintain underlying infrastructure, including Kubernetes clusters, serverless workloads, and ETL pipelines
  • Sit with engineers to identify opportunities for automation and tooling development
  • Partner with product engineering teams to drive security outcomes - such as automation for patching, and development of gateways and other services to decrease risk
  • Mentor and help grow other Software Engineers in the team
What we offer
What we offer
  • Offers Equity
  • Offers Bonus
  • medical, dental, and vision insurance
  • a 401(k) plan
  • short-term and long-term disability
  • basic life insurance
  • well-being benefits
  • 20 paid days of vacation
  • 12 paid days of company holidays
  • Fulltime
Read More
Arrow Right

Engineering Manager, AI Gateway

We are looking for an Engineering Manager for our AI Gateway team, focused on bu...
Location
Location
United States , San Francisco
Salary
Salary:
232000.00 - 319000.00 USD / Year
vercel.com Logo
Vercel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of Engineering Management experience, with a track record of leading and scaling backend or infrastructure engineering teams
  • 5+ years of hands-on software engineering experience, with a strong foundation in backend development, APIs, and distributed systems
  • Experience with AI/ML integrations, API gateways, or high-throughput services — particularly concepts like rate limiting, caching, and intelligent failover
  • Strong proficiency in JavaScript/TypeScript
  • experience with the Vercel AI SDK or similar AI developer tooling is a plus
  • Familiarity with cloud-based and serverless architectures, particularly within the Vercel ecosystem
  • A genuine passion for developer experience and a deep appreciation for what it takes to build reliable, production-grade infrastructure
  • Experience contributing to or engaging with open-source communities is a plus
Job Responsibility
Job Responsibility
  • Lead and grow a high-performing team of engineers working on the AI Gateway platform, fostering a culture of technical excellence, ownership, and collaboration
  • Drive the architecture and execution of core platform capabilities, including unified API endpoints, intelligent rate limit management, automatic failover mechanisms, and provider-agnostic authentication
  • Partner cross-functionally with product, AI research, and infrastructure teams to define roadmap priorities and deliver high-impact features that improve reliability and developer experience
  • Ensure production-ready reliability for AI workloads at scale, maintaining low-latency performance and high availability across providers and regions
  • Champion developer experience — gathering feedback from internal and external developers to continuously improve the Gateway's usability, observability, and analytics capabilities
  • Engage with the open-source community and align the team's work with Vercel's broader ecosystem, including AI SDK and related projects
  • Recruit, mentor, and develop engineers on the team, supporting their growth through regular feedback, career development conversations, and a healthy team culture
What we offer
What we offer
  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills
  • Flexible Time Off
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed
  • Fulltime
Read More
Arrow Right

Generative AI Engineer

At ResMed, we’re shaping the future of digital health and medical technology — a...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
resmed.com Logo
ResMed
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of software engineering, with hands-on experience developing and deploying generative AI solutions
  • Relevant Engineering or Science degrees (Software, Computer)
  • Proficiency in .NET, AWS serverless (Lambda, API Gateway), data analytics (Glue, Athena), and AI frameworks (PyTorch, Hugging Face)
  • Familiarity with multi-agent systems, model fine-tuning, and building data flywheels
  • Strong product sense, ability to engage stakeholders directly, and communication skills that make complex concepts clear
  • Ability to design AI systems that are not just powerful but practical, measurable, and safe
Job Responsibility
Job Responsibility
  • Build Next-Gen AI Workflows: Design and deploy Generative AI solutions that eliminate repetitive work, boost efficiency, and free teams to focus on what matters most
  • Modernize Systems: Bring cutting-edge AI into ResMed’s tech stack — from fine-tuning LLMs with data flywheels to integrating with MCP servers
  • Spot High-Value AI Opportunities: Identify the projects where AI will deliver the most impact, balancing customer needs, cost, and scalability
  • Partner with Experts: Work side-by-side with engineers, QA teams, and regulatory specialists to translate business needs into technical solutions
  • Engineer for Scale: Optimize AWS serverless infrastructure and analytics pipelines to keep workflows secure, scalable, and cost-effective
  • Innovate & Iterate: Take ownership of projects end-to-end, adapt quickly based on feedback, and help teammates succeed along the way
  • Fulltime
Read More
Arrow Right
Remote jobs Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog Salaries About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy