Lead Software Engineer - Gen AI

• Lead complex technology initiatives including those that are companywide with broad impact
• Act as a key participant in developing standards and companywide best practices for engineering complex and large scale technology solutions for technology engineering disciplines
• Design, code, test, debug, and document for projects and programs
• Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented technical factors
• Make decisions in developing standard and companywide best practices for engineering and technology solutions requiring understanding of industry best practices and new technologies, influencing and leading technology team to meet deliverables and drive new initiatives
• Collaborate and consult with key technical experts, senior technology team, and external industry groups to resolve complex technical issues and achieve goals
• Lead projects, teams, or serve as a peer mentor

5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education

• Design and maintain canonical LLM APIs (OpenAI‑compatible chat/generate, search, ingest, embeddings, responses, interactions) with multi‑model backends, consistent across on‑prem and cloud.
• Operate Gateway for LLM traffic (SSE/streaming), set TPS and payload SLOs, and coordinate capacity allocations with enterprise gateway owners.
• Implement authN/Z patterns: OAuth2 client credentials and user‑context flows
• enforce mTLS and device/tls‑bound tokens to eliminate key sharing.
• Define versioning & deprecation policy
• publish change notices and maintain compatibility matrices for SDKs and proxies.
• Build developer onboarding paths (APIGEE consumer groups, CASE requests, key lifecycle) and user guides
• enforce “LLM access via app + gateway only”.
• Lead PCF→OCP API cutovers
• validate proxies, LB configs, and automated tests prior to switching.
• Implement rate limiting, quotas, and abuse protection at gateway/API levels, coordinate product creation and throttle settings.
• Publish OpenAPI specs, SDK examples, and reference integrations
• ensure parity across environments and models introduced by platform comms.
• Run performance & soak tests (streaming, batch, embeddings)
• set promotion gates tied to latency/error SLOs.
• Coordinate change windows for gateway upgrades and author impact comms/SOPs.
• Enforce retirement of direct model endpoints—route all model access through Tachyon APIs/gateway, guide exception handling.
• Explore AI gateway options for MCP/agent traffic (research & POC) and align with enterprise standards before adoption.
• Provide executive updates on API adoption, reliability, and roadmap (batch APIs, async patterns) tied to enterprise goals.