This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Hands‑on GenAI Engineer working on canonical LLM APIs—designing OpenAI‑compatible endpoints (/generate, /search, /ingest, embeddings), operating AI Gateway Hybrid with OAuth/mTLS hardening, and evolving SDKs for LangGraph/ADK with trace/eval hooks. Owns versioning, deprecation, rate limiting, and developer onboarding.
Job Responsibility
Design and maintain canonical LLM APIs (OpenAI‑compatible chat/generate, search, ingest, embeddings, responses, interactions) with multi‑model backends, consistent across on‑prem and cloud
Operate Gateway for LLM traffic (SSE/streaming), set TPS and payload SLOs, and coordinate capacity allocations with enterprise gateway owners
Implement authN/Z patterns: OAuth2 client credentials and user‑context flows
enforce mTLS and device/tls‑bound tokens to eliminate key sharing
Define versioning & deprecation policy
publish change notices and maintain compatibility matrices for SDKs and proxies
Build developer onboarding paths
Integrate Open telemetry (tracing/evals) into gateway and APIs
propagate correlation IDs and tags for spaces/projects
Evolve SDKs to standardize auth, observability, signal endpoints, and registry updates for LangGraph/ADK
Implement rate limiting, quotas, and abuse protection at gateway/API levels
coordinate product creation and throttle settings
Publish OpenAPI specs, SDK examples, and reference integrations
ensure parity across environments and models introduced by platform comms
Run performance & soak tests (streaming, batch, embeddings)
set promotion gates tied to latency/error SLOs
Coordinate change windows for gateway upgrades and author impact comms/SOPs
Enforce retirement of direct model endpoints—route all model access through APIs/gateway
guide exception handling
Explore AI gateway options for MCP/agent traffic (research & POC) and align with enterprise standards before adoption
Provide executive updates on API adoption, reliability, and roadmap (batch APIs, async patterns) tied to enterprise goals
Requirements
AI Gateways like KONG, Portkey, SSE/streaming, quota/rate limits