CrawlJobs Logo
Vercel Logo Vercel · IT - Software Development

Software Engineer, AI Gateway

United States, San Francisco 196000.00 - 294000.00 USD / Year · Job Posted February 14, 2026
Apply Position
Job Link Share

Job Description

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.

Job Responsibility

  • Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability
  • Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests
  • Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges
  • Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools
  • Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights

Requirements

  • At least 5+ years of relevant experience
  • Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
  • Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
  • Experience contributing to or participating in open source projects
  • Excellent communication skills and the ability to work effectively in a collaborative team environment

What we offer

  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills
  • Flexible Time Off
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed
Vercel - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer, AI Gateway

8 matching positions

Senior Software Engineer - AI Tools

As a Senior Software Engineer working on internal AI tooling, you will be respon...
Location
Location
United States; Australia , San Francisco; Melbourne; Sydney
Salary
Salary:
150000.00 - 220000.00 USD / Year
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Security, or a related field
  • 8+ years of experience as a Software Engineer
  • Experience with production code bases
  • Experience with at least one scripting language (e.g. Python) and one systems programming language (eg. Golang, C/C++)
  • Experience with modern cloud infrastructure, including data pipelines, serverless workloads, and Kubernetes
  • Proven experience working autonomously on projects - delivering them to a high quality and on time
  • Excellent communication and interpersonal skills, with the ability to work effectively with both technical and non-technical stakeholders
  • Ability to dive deep to find the best solution to a problem
  • Obsessive curiosity and a willingness to ask questions, gather context, and learn
Job Responsibility
Job Responsibility
  • Lead the development of AI tools and applications, from inception to implementation
  • Support incident response efforts by building ad-hoc tools for threat hunting, remediation and scanners
  • Build, monitor, and maintain underlying infrastructure, including Kubernetes clusters, serverless workloads, and ETL pipelines
  • Sit with engineers to identify opportunities for automation and tooling development
  • Partner with product engineering teams to drive security outcomes - such as automation for patching, and development of gateways and other services to decrease risk
  • Mentor and help grow other Software Engineers in the team
What we offer
What we offer
  • Offers Equity
  • Offers Bonus
  • medical, dental, and vision insurance
  • a 401(k) plan
  • short-term and long-term disability
  • basic life insurance
  • well-being benefits
  • 20 paid days of vacation
  • 12 paid days of company holidays
  • Fulltime
Read More
Arrow Right

Staff Software Engineer AI

GoodLeap’s Consumer Solutions Business Unit is redefining how homeowners manage ...
Location
Location
United States , Roseville; Austin; Lehi; Plano; San Francisco; San Mateo; West Palm Beach; Bentonville; Dallas; Irvine
Salary
Salary:
173000.00 - 200000.00 USD / Year
goodleap.com Logo
GoodLeap
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in backend development
  • At least 2+ years working with AI/ML solutions or LLM
  • Experience working with vector databases, embeddings, and semantic search
  • Familiarity with MLOps, CI/CD for AI pipelines, and AI observability tools
  • Strong experience in Node.js, TypeScript, GraphQL, and REST APIs
  • Deep familiarity with AWS architecture — especially Lambda, ECS, S3, DynamoDB, API Gateway, and Step Functions
  • Experience building and integrating LLM features (e.g., via OpenAI, Claude, Vertex AI, or similar), including prompt design, vector storage, and retrieval strategies
  • Fluency in system design principles, scalability, reliability, fault-tolerance
  • Ability to drive clarity and make architectural tradeoffs, balancing idealism with pragmatism
  • Strong communication and collaboration skills, able to work effectively across product and engineering orgs
Job Responsibility
Job Responsibility
  • Design and lead backend architecture that supports AI/ML-powered features across mobile and API surfaces
  • Own end-to-end technical strategy for embedding LLMs, embedding stores, and personalized content delivery
  • Partner with product and design to scope features, validate feasibility, and ensure execution aligns with business impact
  • Build tools and services to help other team members experiment and ship AI-enhanced features responsibly and efficiently
  • Influence engineering standards and promote excellence in observability, performance, and security
  • Mentor engineers across teams, helping them level up in areas of backend architecture, AI integration, and delivery quality
  • Collaborate with cross-functional partners across QA, Mobile, Data Science, Product, and Marketing
What we offer
What we offer
  • May be eligible for a bonus
  • Opportunities for growth and advancement within the company
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - AI-Powered Microservices

We are seeking an innovative and experienced Senior Software Engineer to join ou...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-7 years of professional experience in software development, with a significant focus on building and deploying microservices
  • Strong command of one or more backend programming languages such as Python, Java, C#, or Go
  • Proven experience with microservices architecture, including service discovery, API gateways, and inter-service communication
  • Hands-on experience with a major cloud platform (e.g., Azure, AWS, or GCP), including containerization (Docker) and orchestration (Kubernetes)
  • Solid experience in designing, building, and consuming RESTful or gRPC APIs
  • Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Design, build, and maintain efficient, reusable, and reliable microservices using modern best practices
  • Utilize AI-powered development tools, specifically Microsoft Copilot, to accelerate the software development lifecycle, from coding and testing to documentation
  • Develop and manage robust API integrations with a variety of Large Language Models (LLMs) to embed advanced AI capabilities into our applications
  • Collaborate with architects and product managers to design scalable and resilient systems that meet business and technical requirements
  • Write clean, scalable, and thoroughly tested code
  • Champion best practices in software development and mentor junior engineers
  • Work closely with cross-functional teams, including data science, product, and operations, to deliver high-quality, integrated solutions
  • Stay current with the latest advancements in AI, microservices, and cloud technologies, and actively look for opportunities to incorporate them into our platform
  • Fulltime
Read More
Arrow Right

Software Engineer — AI-Enabled Product Autonomy

Help us to increase the number of successful products in the world! You'll join ...
Location
Location
Salary
Salary:
Not provided
posthog.com Logo
PostHog
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Professional experience with Python and TypeScript
  • Backend-focused builder
  • Experience in scale-up environments from unicorn to decacorn growth
  • Love solving hard problems
  • Believe in engineering-led decision-making
  • Excited about AI-enabled autonomy
Job Responsibility
Job Responsibility
  • Scale the language model gateway to handle 10K–100K requests/second
  • Build and optimize coding sandboxes for AI agents
  • Contribute to the AI-first product development loop from analysis to auto-merge
  • Fulltime
Read More
Arrow Right
New

Principal Software Engineer

We are developing Manufacturing and Engineering AI tools that help employees gai...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 13-17 years of engineering experience building or platforming cloud services or developer platforms, with 3+ years leading engineering teams or technical programs
  • Proven experience designing and operating cloud-native platforms using Kubernetes, containers, microservices, and related distributed system patterns
  • Hands-on experience with LLM serving or adjacent model-serving patterns, including inference endpoints, routing, scaling, batching, and latency/cost optimization
  • Practical knowledge of API gateway patterns, authentication and authorization, and secure integrations
  • Familiarity with cost attribution and FinOps concepts for cloud and AI workloads
  • Strong track record partnering with product managers and senior technical stakeholders to deliver platform capabilities and roadmaps
  • Excellent communication skills with the ability to explain technical tradeoffs clearly to both technical and non-technical audiences
  • Experience with observability and SRE practices, including metrics, tracing, logging, incident management, and production support
  • Master's / Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Define the technical vision and reference architecture for AI platforms supporting chatbots, agents, orchestration, and related enterprise services
  • Translate product and business requirements into scalable platform capabilities, including agent hosting, model access, AI gateways, observability, and operational tooling
  • Drive platform decisions around LLM serving, model endpoints, caching, batching, latency-versus-cost tradeoffs, and multi-model support
  • Lead architecture for manufacturing integrations and industrial data connectivity, including patterns for SCADA, Data Historian, MES, ERP, LIMS, APIs, event streams, and document-based knowledge sources
  • Own platform reliability, scalability, and cost by defining SLIs/SLOs, capacity planning, cost attribution, and FinOps practices
  • Collaborate with Product Owners, Principal Engineers, and stakeholders to define roadmap, acceptance criteria, and delivery milestones
  • Lead and mentor engineers delivering platform services, integrations, CI/CD for agents and models, and marketplace/catalog capabilities
  • Establish standards for security, compliance, and model governance, including data handling, access controls, logging, auditability, and traceability
  • Be hands-on when needed to prototype architectures, review designs, troubleshoot production incidents, and participate in code and design reviews
What we offer
What we offer
  • In addition to the base salary, Amgen offers competitive and comprehensive Total Rewards Plans that are aligned with local industry standards
  • Fulltime
Read More
Arrow Right

Sr. Software Engineer

We are looking for an experienced Sr. Software Engineer to join our team and pla...
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of software engineering experience, supported by a high school diploma or equivalent
  • Advanced expertise in JavaScript or TypeScript with Node.js, along with strong development experience in C# and .NET technologies
  • Proven background building distributed systems and scalable enterprise applications using modern architectural and design principles
  • Strong experience with relational databases, including Entity Framework or EF Core, database design, and platforms such as SQL Server or PostgreSQL
  • Hands-on knowledge of cloud-native development and deployment, including AWS services such as Lambda, S3, API Gateway, CloudFront, and EventBridge
  • Working familiarity with modern front-end technologies, including React, Angular, or AngularJS, as well as web platform concepts and browser behavior
  • Experience with authentication and security standards such as OpenID Connect and OAuth2, plus strong troubleshooting skills across full-stack environments
  • Proficiency with Git, CI/CD pipelines, and AI-assisted engineering tools such as GitHub Copilot, Cursor, Claude, or comparable platforms
Job Responsibility
Job Responsibility
  • Design, develop, and support complex software features and platform capabilities that improve product performance, reliability, and scalability
  • Define technical approaches for new applications, shared services, and system enhancements while aligning solutions with broader architectural standards
  • Contribute hands-on code and provide technical leadership through constructive reviews, mentoring, and engineering best practices
  • Strengthen product quality by implementing automated testing strategies and validating software behavior throughout the development lifecycle
  • Apply secure development principles to protect applications, data, and integrations across front-end and back-end environments
  • Investigate production issues, identify root causes, and deliver timely fixes across application, database, and infrastructure layers
  • Use AI-driven tools to accelerate solution design, coding, debugging, testing, and code review while helping the team adopt effective usage patterns
  • Collaborate with stakeholders to understand business priorities, user expectations, and functional requirements in order to shape practical technical solutions
  • Support software delivery from initial development through deployment, monitoring, and ongoing operational improvement using source control and CI/CD practices
  • Recommend and implement improvements to engineering workflows, tools, and development standards that increase team effectiveness and delivery consistency
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • enrollment in company 401(k) plan
Read More
Arrow Right

Senior AI Engineer

We're looking for a Senior AI Engineer to help us build the next generation of A...
Location
Location
Netherlands; Germany; Romania; United Kingdom; Spain; Italy; Poland , Amsterdam; Berlin; Hannover; Iași; London; Madrid; Milano; München; Warsaw
Salary
Salary:
Not provided
awin.com Logo
Awin Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional software engineering experience, with a track record of shipping production systems
  • Strong Python and backend system design
  • Real, hands-on experience building and running production LLM-based systems not just prototypes
  • Deep experience with agent-based architectures using frameworks such as LangGraph, the Deep Agents or equivalents with multi-step reasoning, tool use, sub-agent orchestration, state and streaming
  • Strong working knowledge of retrieval and context construction (RAG, embeddings, chunking, ranking) and good judgement about when to use those patterns inside an agentic system
  • A solid track record of evaluating and debugging AI systems: structured evals, regression tests and tracing or observability with tools such as LangSmith or similar
  • Familiarity with emerging agent orchestration standards (MCP or similar)
  • Experience with vector databases and hybrid retrieval
  • A clear understanding of LLM failure modes like prompt injection, content safety, context leakage and how to mitigate them in real systems
  • Strong fundamentals in distributed systems, API design and cloud-native architectures on AWS (ECS, Lambda, S3, API Gateway)
Job Responsibility
Job Responsibility
  • Design, build and operate customer-facing AI features end-to-end, from conversational experiences to intelligent automation
  • Architect agent-based systems: multi-step reasoning, tool execution, sub-agent orchestration, state management and streaming, structured outputs, persistent memory and human-in-the-loop approval flows
  • Decide how the system grounds, retrieves and constructs context
  • Pick the right pattern (retrieval, structured tools, agentic flows) for each problem and be able to defend the choice
  • Treat prompt and context engineering as first-class engineering work
  • Own AI quality
  • Build evaluation datasets, regression tests for prompts and agents and the debugging discipline needed to get to root cause across model outputs, retrieval and tool calls
  • Make AI production-ready: observability, tracing, reliability, cost, latency and the safety controls that protect against hallucination, prompt injection and context leakage
  • Make and explain the trade-offs between accuracy, latency, cost and safety within engineering and product partners
  • Partner within Product Trio to shape what we build, not just how we build it
What we offer
What we offer
  • Flexi-Week and Work-Life Balance: We prioritise your mental health and wellbeing, offering you a flexible four-day Flexi-Week at full pay and with no reduction to your annual holiday allowance. We also offer a variety of different paid special leaves
  • Remote Working Allowance: You will receive a monthly allowance to cover part of your running costs. In addition, we will support you in setting up your remote workspace appropriately
  • Flexi-Office: We offer an international culture and flexibility through our Flexi-Office and hybrid/remote work possibilities to work across Awin regions
  • Meal Vouchers: You will be supported with a certain net sum to spend it on a variety of lunches
  • Health & Wellbeing: The insurance covers several types of health, vision and / or dental treatments for you and for up to one additional family member
  • Remote Working Furniture Package: After 3 months of employment, you will be eligible for a furniture package, which should enable you to set up a proper workplace at your remote working location
  • Appreciation: Thank and reward colleagues by sending them a voucher through our peer-to-peer program
  • Fulltime
Read More
Arrow Right

Senior Generative AI Engineer

At Codvo, we are committed to building scalable, future-ready data platforms tha...
Location
Location
India
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of overall professional experience in software or machine learning engineering
  • Bachelor's degree in Computer Science, Machine Learning, or a related technical field
  • 2+ years of relevant, hands-on experience with Generative AI, including: Building, optimizing, and deploying RAG (Retrieval-Augmented Generation) pipelines
  • In-depth experience with agentic frameworks (e.g., LangChain, LlamaIndex)
  • Experience with vector databases (e.g., Pinecone, Qdrant, pgvector)
  • Expert-level proficiency in Python and object-oriented design
  • Demonstrated experience with core AWS services for compute and deployment (e.g., EKS, ECS, Lambda, API Gateway)
  • Strong understanding of API development (REST) and building microservices
  • Fulltime
Read More
Arrow Right