CrawlJobs Logo

Senior AI API & Gateway Engineer (Python)

nttdata.com Logo

NTT DATA

Location Icon

Location:
India , Bangalore

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are seeking a specialized Senior AI API & Gateway Engineer to design, build, and operate the critical API infrastructure that powers our Generative AI initiatives. In this role, you will own the API lifecycle for canonical LLM endpoints across both on-premise and cloud environments. You will be the primary steward of our AI Gateway operations, ensuring highly performant, secure, and observable integrations between our applications and underlying foundation models using modern Python frameworks.

Job Responsibility:

  • LLM API Architecture: Design, implement, and maintain canonical LLM APIs supporting complex GenAI capabilities including chat, text generation, semantic search, and data ingestion
  • AI Gateway Operations: Operate and optimize the enterprise AI Gateway. Manage advanced traffic patterns including token streaming, rate limiting, quota management, and capacity planning to guarantee stringent Service Level Objectives (SLOs)
  • Agent Framework Integration: Build and orchestrate intelligent agent workflows utilizing frameworks such as LangGraph and ADK
  • API Lifecycle & Asynchronous Patterns: Own the end-to-end API lifecycle, including versioning, deprecation strategies, and compatibility matrices. Implement batch processing and asynchronous API patterns with automated promotion gates
  • Enterprise Security & Auth: Design and enforce robust security protocols for AI access, implementing enterprise-grade authentication mechanisms including OAuth2, mTLS, and secure token binding
  • Observability & Telemetry: Establish comprehensive LLM observability frameworks across projects and workspaces to monitor token usage, latency, and API health

Requirements:

  • Advanced proficiency in Python backend development
  • Deep experience in API Design and Lifecycle Management, specifically tailored for AI/LLM use cases
  • Proven experience managing AI Gateways (e.g., Kong, Apigee, or custom Envoy proxies) dealing with high-throughput, streaming endpoints
  • Hands-on experience with modern agent orchestration frameworks (LangGraph, ADK)
  • Strong background in implementing strict enterprise authentication (OAuth2, mTLS)
  • Familiarity with building robust, asynchronous, and batch-processing architectures

Additional Information:

Job Posted:
May 16, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
NTT DATA - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior AI API & Gateway Engineer (Python)

Senior Software Engineer

We are looking for a passionate back-end Software Engineer who is deeply driven ...
Location
Location
United States
Salary
Salary:
Not provided
cyware.com Logo
Cyware
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • US Citizenship is a requirement of this position in accordance with 8 U.S.C 1324b(a)(2)(C)
  • Bachelor’s degree or higher, in Computer Science, Engineering, IT or a related discipline
  • 5+ years of practical experience in building Django applications is a huge plus
  • Knowledge in Python, with the ability to build efficient REST API using Django REST Framework
  • Experience with AI/ML integrations: building and consuming REST / gRPC services that use LLMs (OpenAI, local models, etc.)
  • Hands-on experience designing and implementing RAG pipelines (vector stores, embeddings, document indexing, retrieval strategies)
  • Experience with Go (GoLang) for building high-performance microservices or backend components is a strong plus
  • Knowledge of scheduling framework or event-driven programming in Django
  • The ability to naturally follow good development practices like test automation, CI/CD, source version control, GitHub, etc.
  • Experience with applications that have scaled
Job Responsibility
Job Responsibility
  • Develop features from proposal to polished end result
  • Manage and review code contributed by the rest of the team and work with them to get it ready for production
  • Take initiative in improving the software in small or large ways to address pain points in your own experience as a developer
  • Keep code easy to maintain and keep it easy for others to contribute
  • Work with multi-disciplinary teams to maintain and support production and operations of Cyware Products
What we offer
What we offer
  • We offer a comprehensive benefits package including time off, paid holidays, retirement plans, insurance coverage and much more
  • We’ll invest in your career
  • We offer competitive compensation packages
  • Fulltime
Read More
Arrow Right
New

Senior AI API & Gateway Engineer (Python)

We are seeking a specialized Senior AI API & Gateway Engineer to design, build, ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced proficiency in Python backend development
  • Deep experience in API Design and Lifecycle Management, specifically tailored for AI/LLM use cases
  • Proven experience managing AI Gateways (e.g., Kong, Apigee, or custom Envoy proxies) dealing with high-throughput, streaming endpoints
  • Hands-on experience with modern agent orchestration frameworks (LangGraph, ADK)
  • Strong background in implementing strict enterprise authentication (OAuth2, mTLS)
  • Familiarity with building robust, asynchronous, and batch-processing architectures
Job Responsibility
Job Responsibility
  • Design, implement, and maintain canonical LLM APIs supporting complex GenAI capabilities including chat, text generation, semantic search, and data ingestion
  • Operate and optimize the enterprise AI Gateway
  • Manage advanced traffic patterns including token streaming, rate limiting, quota management, and capacity planning to guarantee stringent Service Level Objectives (SLOs)
  • Build and orchestrate intelligent agent workflows utilizing frameworks such as LangGraph and ADK
  • Own the end-to-end API lifecycle, including versioning, deprecation strategies, and compatibility matrices
  • Implement batch processing and asynchronous API patterns with automated promotion gates
  • Design and enforce robust security protocols for AI access, implementing enterprise-grade authentication mechanisms including OAuth2, mTLS, and secure token binding
  • Establish comprehensive LLM observability frameworks across projects and workspaces to monitor token usage, latency, and API health
  • Fulltime
Read More
Arrow Right

Software Development Senior Specialist

The Senior Software Development Specialist will lead the design and development ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong expertise in Python (8+ years preferred)
  • Hands-on experience with LLMs and agent frameworks
  • Deep understanding of Prompt engineering, RAG architecture, Vector databases (Pinecone, FAISS, Weaviate, Azure AI Search), API integrations
  • Experience with AWS and Azure cloud services
  • Strong knowledge of REST APIs, microservices, and event-driven architecture
  • Experience with Git, CI/CD, Docker, Kubernetes
  • Experience deploying AI systems in production environments
  • Familiarity with AI governance, model evaluation, and monitoring
  • Experience integrating enterprise data sources (SharePoint, SAP, CRM, etc.)
Job Responsibility
Job Responsibility
  • Design and implement agent-based AI systems using frameworks such as LangChain, LangGraph, AutoGen, CrewAI, Semantic Kernel, or similar
  • Develop multi-agent orchestration systems with memory, planning, and tool usage capabilities
  • Integrate LLMs (OpenAI, Azure OpenAI, Anthropic, open-source models) into enterprise workflows
  • Implement RAG (Retrieval-Augmented Generation) pipelines using vector databases
  • Build secure, production-grade prompt engineering frameworks
  • Develop scalable backend services using Python (FastAPI, Flask, Django)
  • Build AI microservices and APIs for enterprise integration
  • Implement async processing, workflow automation, and event-driven systems
  • Ensure high-quality code with unit tests, CI/CD integration, and best practices
  • Design and deploy AI solutions on AWS: SageMaker, Bedrock, Lambda, ECS/EKS, API Gateway, DynamoDB / RDS
Read More
Arrow Right

Senior AI Engineer

We're looking for a Senior AI Engineer to help us build the next generation of A...
Location
Location
Netherlands; Germany; Romania; United Kingdom; Spain; Italy; Poland , Amsterdam; Berlin; Hannover; Iași; London; Madrid; Milano; München; Warsaw
Salary
Salary:
Not provided
awin.com Logo
Awin Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional software engineering experience, with a track record of shipping production systems
  • Strong Python and backend system design
  • Real, hands-on experience building and running production LLM-based systems not just prototypes
  • Deep experience with agent-based architectures using frameworks such as LangGraph, the Deep Agents or equivalents with multi-step reasoning, tool use, sub-agent orchestration, state and streaming
  • Strong working knowledge of retrieval and context construction (RAG, embeddings, chunking, ranking) and good judgement about when to use those patterns inside an agentic system
  • A solid track record of evaluating and debugging AI systems: structured evals, regression tests and tracing or observability with tools such as LangSmith or similar
  • Familiarity with emerging agent orchestration standards (MCP or similar)
  • Experience with vector databases and hybrid retrieval
  • A clear understanding of LLM failure modes like prompt injection, content safety, context leakage and how to mitigate them in real systems
  • Strong fundamentals in distributed systems, API design and cloud-native architectures on AWS (ECS, Lambda, S3, API Gateway)
Job Responsibility
Job Responsibility
  • Design, build and operate customer-facing AI features end-to-end, from conversational experiences to intelligent automation
  • Architect agent-based systems: multi-step reasoning, tool execution, sub-agent orchestration, state management and streaming, structured outputs, persistent memory and human-in-the-loop approval flows
  • Decide how the system grounds, retrieves and constructs context
  • Pick the right pattern (retrieval, structured tools, agentic flows) for each problem and be able to defend the choice
  • Treat prompt and context engineering as first-class engineering work
  • Own AI quality
  • Build evaluation datasets, regression tests for prompts and agents and the debugging discipline needed to get to root cause across model outputs, retrieval and tool calls
  • Make AI production-ready: observability, tracing, reliability, cost, latency and the safety controls that protect against hallucination, prompt injection and context leakage
  • Make and explain the trade-offs between accuracy, latency, cost and safety within engineering and product partners
  • Partner within Product Trio to shape what we build, not just how we build it
What we offer
What we offer
  • Flexi-Week and Work-Life Balance: We prioritise your mental health and wellbeing, offering you a flexible four-day Flexi-Week at full pay and with no reduction to your annual holiday allowance. We also offer a variety of different paid special leaves
  • Remote Working Allowance: You will receive a monthly allowance to cover part of your running costs. In addition, we will support you in setting up your remote workspace appropriately
  • Flexi-Office: We offer an international culture and flexibility through our Flexi-Office and hybrid/remote work possibilities to work across Awin regions
  • Meal Vouchers: You will be supported with a certain net sum to spend it on a variety of lunches
  • Health & Wellbeing: The insurance covers several types of health, vision and / or dental treatments for you and for up to one additional family member
  • Remote Working Furniture Package: After 3 months of employment, you will be eligible for a furniture package, which should enable you to set up a proper workplace at your remote working location
  • Appreciation: Thank and reward colleagues by sending them a voucher through our peer-to-peer program
  • Fulltime
Read More
Arrow Right

Senior Staff Data Engineer - Agentic AI

As a Senior Staff Data Engineer – Agentic AI, you will operate as a senior indiv...
Location
Location
India , Bengaluru Urban; CHENNAI
Salary
Salary:
Not provided
americanexpress.com Logo
Amex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience building large-scale distributed systems
  • Strong experience with LLM systems, agentic workflows or advanced ML infrastructure
  • Proven ownership of complex, cross-cutting agentic systems spanning multiple teams or products
  • Strong engineering fundamentals across backend systems, APIs, data pipelines, and cloud infrastructure
  • Deep experience across the agentic AI stack, including planning, tool use, memory, and evaluation
  • Fluency with AI-assisted and agentic development workflows
  • Comfort operating in ambiguous problem spaces and translating them into shipped, reliable autonomous systems
  • Ability to influence technical direction and align teams without formal authority
  • Experience in workflow engines, async processing, queues, and streaming systems
Job Responsibility
Job Responsibility
  • Drive technical direction for agentic AI initiatives, influencing architecture patterns, autonomy boundaries, and system design
  • Design, build, and operate production-grade agentic AI systems used across multiple products
  • Own and evolve shared agentic AI capabilities, including: Agent frameworks and orchestration layers, Planning, tool use, and memory strategies, Retrieval and grounding (RAG) pipelines, LLM infrastructure, inference, and model gateways, Evaluation, observability, and safety tooling for autonomous systems
  • Lead technical design reviews and help teams navigate tradeoffs involving autonomy, safety, reliability, scalability, and cost
  • Partner across teams to deliver complex, cross-cutting agentic AI initiatives from concept to production
  • Evaluate emerging models, techniques, and agentic patterns and translate them into practical, enterprise-ready improvements
  • Mentor senior engineers and raise the technical bar for agentic AI development through example and influence
What we offer
What we offer
  • Competitive base salaries
  • Bonus incentives
  • Support for financial-well-being and retirement
  • Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
  • Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
  • Generous paid parental leave policies (depending on your location)
  • Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
  • Free and confidential counseling support through our Healthy Minds program
  • Career development and training opportunities
  • Fulltime
Read More
Arrow Right

Staff Data Engineer - Agentic AI

As a Staff Data Engineer – Agentic AI, you will operate as a senior individual c...
Location
Location
India , Bengaluru Urban; CHENNAI
Salary
Salary:
Not provided
americanexpress.com Logo
Amex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience building large-scale distributed systems
  • Strong experience with LLM systems, agentic workflows or advanced ML infrastructure
  • Proven ownership of complex, cross-cutting agentic systems spanning multiple teams or products
  • Strong engineering fundamentals across backend systems, APIs, data pipelines, and cloud infrastructure
  • Deep experience across the agentic AI stack, including planning, tool use, memory, and evaluation
  • Fluency with AI-assisted and agentic development workflows
  • Comfort operating in ambiguous problem spaces and translating them into shipped, reliable autonomous systems
  • Ability to influence technical direction and align teams without formal authority
  • Experience in workflow engines, async processing, queues, and streaming systems
Job Responsibility
Job Responsibility
  • Drive technical direction for agentic AI initiatives, influencing architecture patterns, autonomy boundaries, and system design
  • Design, build, and operate production-grade agentic AI systems used across multiple products
  • Own and evolve shared agentic AI capabilities, including Agent frameworks and orchestration layers, Planning, tool use, and memory strategies, Retrieval and grounding (RAG) pipelines, LLM infrastructure, inference, and model gateways, Evaluation, observability, and safety tooling for autonomous systems
  • Lead technical design reviews and help teams navigate tradeoffs involving autonomy, safety, reliability, scalability, and cost
  • Partner across teams to deliver complex, cross-cutting agentic AI initiatives from concept to production
  • Evaluate emerging models, techniques, and agentic patterns and translate them into practical, enterprise-ready improvements
  • Mentor senior engineers and raise the technical bar for agentic AI development through example and influence
What we offer
What we offer
  • Competitive base salaries
  • Bonus incentives
  • Support for financial-well-being and retirement
  • Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
  • Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
  • Generous paid parental leave policies (depending on your location)
  • Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
  • Free and confidential counseling support through our Healthy Minds program
  • Career development and training opportunities
Read More
Arrow Right
New

Java Engineering Manager, Cloud Native & AI Development - Senior Vice President

Own and drive end-to-end migration of legacy Mainframe workloads (COBOL, JCL, CI...
Location
Location
India , Pune, Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related technical discipline
  • 13–18+ years of progressive software engineering experience, with at least 5-8 years in a senior technical leadership role (Tech Lead, Staff Engineer, principle)
  • Demonstrated experience leading or significantly contributing to at least one large-scale Mainframe modernization or legacy platform migration programme
  • Prior experience in financial services, banking, or a similarly regulated industry strongly preferred
  • Java 17/21 (Expert), Python, COBOL / JCL (reading & assessment level)
  • Spring Boot, Spring Cloud, Spring Security, Spring Data JPA, Project Reactor / WebFlux
  • OpenShift, Kubernetes, Docker, Helm
  • Tekton, Harness, Jenkins, Git (Bitbucket / GitHub), Artifactory, SonarQube
  • Oracle, MongoDB, PostgreSQL, MS SQL Server, Redis, DB2/z
  • Apache Kafka, IBM MQ
Job Responsibility
Job Responsibility
  • Mainframe Modernisation & Platform Transformation
  • Technology Operating Cost Reduction
  • Hands-On Engineering & Technical Leadership
  • Generative AI & Agentic Development
  • People Leadership & Stakeholder Management
  • Fulltime
Read More
Arrow Right

Apps Dev Tech Sr Lead Analyst Java SVP

Apps Dev Tech Sr Lead Analyst Java SVP at Citi. Own and drive end-to-end migrati...
Location
Location
India , Chennai, Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related technical discipline
  • 12–16 years of progressive software engineering experience, with at least 5 years in a senior technical leadership role (Tech Lead, Staff Engineer, principle)
  • Demonstrated experience leading or significantly contributing to at least one large-scale Mainframe modernisation or legacy platform migration programme
  • Prior experience in financial services, banking, or a similarly regulated industry strongly preferred
  • Java 17/21 (Expert), Python, COBOL / JCL (reading & assessment level)
  • Spring Boot, Spring Cloud, Spring Security, Spring Data JPA, Project Reactor / WebFlux
  • OpenShift, Kubernetes, Docker, Helm
  • Tekton, Harness, Jenkins, Git (Bitbucket / GitHub), Artifactory, SonarQube
  • Oracle, MongoDB, PostgreSQL, MS SQL Server, Redis, DB2/z
  • Apache Kafka, IBM MQ
Job Responsibility
Job Responsibility
  • Own and drive end-to-end migration of legacy Mainframe workloads (COBOL, JCL, CICS, IMS, DB2/z) to modern Java-based microservices deployed on enterprise container platforms (OpenShift / Kubernetes)
  • Conduct application assessments to identify migration candidates, define target-state architectures, and produce sequenced migration roadmaps with risk registers and rollback plans
  • Establish reusable migration patterns, tooling, and runbooks to accelerate successive migration waves
  • Leverage AI-assisted code translation tools (e.g., autonomous AI coding agents such as Devin) to automate COBOL-to-Java conversion at scale, with human-in-the-loop review gates
  • Validate functional parity post-migration through automated testing strategies (unit, integration, regression, performance)
  • Identify and quantify cost-reduction opportunities across MIPS consumption, software licensing, infrastructure footprint, and operational overhead
  • Build and maintain a technology cost model
  • track savings realisation against committed targets on a monthly cadence
  • Drive rationalisation of redundant systems, decommission end-of-life platforms, and consolidate tooling to reduce Total Cost of Ownership (TCO)
  • Partner with Finance and Vendor Management to renegotiate contracts and optimise spend through right-sizing, reserved capacity, and FinOps practices
  • Fulltime
Read More
Arrow Right