CrawlJobs Logo
NTT DATA Logo NTT DATA · IT - Software Development

Senior AI API & Gateway Engineer (Python)

India, Bangalore Employment contract · Job Posted May 16, 2026
Apply Position
Job Link Share

Job Description

We are seeking a specialized Senior AI API & Gateway Engineer to design, build, and operate the critical API infrastructure that powers our Generative AI initiatives. In this role, you will own the API lifecycle for canonical LLM endpoints across both on-premise and cloud environments. You will be the primary steward of our AI Gateway operations, ensuring highly performant, secure, and observable integrations between our applications and underlying foundation models using modern Python frameworks.

Job Responsibility

  • LLM API Architecture: Design, implement, and maintain canonical LLM APIs supporting complex GenAI capabilities including chat, text generation, semantic search, and data ingestion
  • AI Gateway Operations: Operate and optimize the enterprise AI Gateway. Manage advanced traffic patterns including token streaming, rate limiting, quota management, and capacity planning to guarantee stringent Service Level Objectives (SLOs)
  • Agent Framework Integration: Build and orchestrate intelligent agent workflows utilizing frameworks such as LangGraph and ADK
  • API Lifecycle & Asynchronous Patterns: Own the end-to-end API lifecycle, including versioning, deprecation strategies, and compatibility matrices. Implement batch processing and asynchronous API patterns with automated promotion gates
  • Enterprise Security & Auth: Design and enforce robust security protocols for AI access, implementing enterprise-grade authentication mechanisms including OAuth2, mTLS, and secure token binding
  • Observability & Telemetry: Establish comprehensive LLM observability frameworks across projects and workspaces to monitor token usage, latency, and API health

Requirements

  • Advanced proficiency in Python backend development
  • Deep experience in API Design and Lifecycle Management, specifically tailored for AI/LLM use cases
  • Proven experience managing AI Gateways (e.g., Kong, Apigee, or custom Envoy proxies) dealing with high-throughput, streaming endpoints
  • Hands-on experience with modern agent orchestration frameworks (LangGraph, ADK)
  • Strong background in implementing strict enterprise authentication (OAuth2, mTLS)
  • Familiarity with building robust, asynchronous, and batch-processing architectures
NTT DATA - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior AI API & Gateway Engineer (Python)

8 matching positions

Senior AI API & Gateway Engineer (Python)

We are seeking a specialized Senior AI API & Gateway Engineer to design, build, ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced proficiency in Python backend development
  • Deep experience in API Design and Lifecycle Management, specifically tailored for AI/LLM use cases
  • Proven experience managing AI Gateways (e.g., Kong, Apigee, or custom Envoy proxies) dealing with high-throughput, streaming endpoints
  • Hands-on experience with modern agent orchestration frameworks (LangGraph, ADK)
  • Strong background in implementing strict enterprise authentication (OAuth2, mTLS)
  • Familiarity with building robust, asynchronous, and batch-processing architectures
Job Responsibility
Job Responsibility
  • Design, implement, and maintain canonical LLM APIs supporting complex GenAI capabilities including chat, text generation, semantic search, and data ingestion
  • Operate and optimize the enterprise AI Gateway
  • Manage advanced traffic patterns including token streaming, rate limiting, quota management, and capacity planning to guarantee stringent Service Level Objectives (SLOs)
  • Build and orchestrate intelligent agent workflows utilizing frameworks such as LangGraph and ADK
  • Own the end-to-end API lifecycle, including versioning, deprecation strategies, and compatibility matrices
  • Implement batch processing and asynchronous API patterns with automated promotion gates
  • Design and enforce robust security protocols for AI access, implementing enterprise-grade authentication mechanisms including OAuth2, mTLS, and secure token binding
  • Establish comprehensive LLM observability frameworks across projects and workspaces to monitor token usage, latency, and API health
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

We're looking for a Senior AI Engineer to help us build the next generation of A...
Location
Location
Netherlands; Germany; Romania; United Kingdom; Spain; Italy; Poland , Amsterdam; Berlin; Hannover; Iași; London; Madrid; Milano; München; Warsaw
Salary
Salary:
Not provided
awin.com Logo
Awin Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional software engineering experience, with a track record of shipping production systems
  • Strong Python and backend system design
  • Real, hands-on experience building and running production LLM-based systems not just prototypes
  • Deep experience with agent-based architectures using frameworks such as LangGraph, the Deep Agents or equivalents with multi-step reasoning, tool use, sub-agent orchestration, state and streaming
  • Strong working knowledge of retrieval and context construction (RAG, embeddings, chunking, ranking) and good judgement about when to use those patterns inside an agentic system
  • A solid track record of evaluating and debugging AI systems: structured evals, regression tests and tracing or observability with tools such as LangSmith or similar
  • Familiarity with emerging agent orchestration standards (MCP or similar)
  • Experience with vector databases and hybrid retrieval
  • A clear understanding of LLM failure modes like prompt injection, content safety, context leakage and how to mitigate them in real systems
  • Strong fundamentals in distributed systems, API design and cloud-native architectures on AWS (ECS, Lambda, S3, API Gateway)
Job Responsibility
Job Responsibility
  • Design, build and operate customer-facing AI features end-to-end, from conversational experiences to intelligent automation
  • Architect agent-based systems: multi-step reasoning, tool execution, sub-agent orchestration, state management and streaming, structured outputs, persistent memory and human-in-the-loop approval flows
  • Decide how the system grounds, retrieves and constructs context
  • Pick the right pattern (retrieval, structured tools, agentic flows) for each problem and be able to defend the choice
  • Treat prompt and context engineering as first-class engineering work
  • Own AI quality
  • Build evaluation datasets, regression tests for prompts and agents and the debugging discipline needed to get to root cause across model outputs, retrieval and tool calls
  • Make AI production-ready: observability, tracing, reliability, cost, latency and the safety controls that protect against hallucination, prompt injection and context leakage
  • Make and explain the trade-offs between accuracy, latency, cost and safety within engineering and product partners
  • Partner within Product Trio to shape what we build, not just how we build it
What we offer
What we offer
  • Flexi-Week and Work-Life Balance: We prioritise your mental health and wellbeing, offering you a flexible four-day Flexi-Week at full pay and with no reduction to your annual holiday allowance. We also offer a variety of different paid special leaves
  • Remote Working Allowance: You will receive a monthly allowance to cover part of your running costs. In addition, we will support you in setting up your remote workspace appropriately
  • Flexi-Office: We offer an international culture and flexibility through our Flexi-Office and hybrid/remote work possibilities to work across Awin regions
  • Meal Vouchers: You will be supported with a certain net sum to spend it on a variety of lunches
  • Health & Wellbeing: The insurance covers several types of health, vision and / or dental treatments for you and for up to one additional family member
  • Remote Working Furniture Package: After 3 months of employment, you will be eligible for a furniture package, which should enable you to set up a proper workplace at your remote working location
  • Appreciation: Thank and reward colleagues by sending them a voucher through our peer-to-peer program
  • Fulltime
Read More
Arrow Right

Senior AI Engineer – GIS Solutions

We are seeking a highly skilled GIS & BI Solution Architect with deep expertise ...
Location
Location
India
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–10+ years GIS experience, 3–5 years in design/architecture roles
  • 3+ years Power BI development and deployment
  • Strong stakeholder engagement and executive presentation skills
  • Proven ability to lead cross-functional teams and mentor others
  • Bachelor's/Master's in GIS, Geography, CS, Data Analytics
  • Preferred: GISP, ESRI certifications, Power BI Data Analyst Associate
  • Oil & gas industry experience highly desirable
Job Responsibility
Job Responsibility
  • Architect and deploy ESRI-based GIS solutions (ArcGIS Enterprise, ArcGIS Pro, ArcGIS Online, Portal for ArcGIS)
  • Integrate GIS data with Power BI for geospatial analytics and executive dashboards
  • Design and optimize spatial databases (PostgreSQL/PostGIS, SQL Server Spatial, Oracle Spatial)
  • Develop ETL pipelines using Python (GeoPandas, ArcPy, FME) and Power Query
  • Build web mapping applications using JavaScript (Leaflet, OpenLayers, ArcGIS JS API)
  • Implement REST APIs and Power BI REST API for automation and data integration
  • Lead BI architecture and reporting strategy aligned with land and lease performance metrics
  • Manage Power BI Service including workspace governance, gateway configuration, and RLS
  • Collaborate with stakeholders to translate business needs into technical solutions
  • Drive cloud-based deployments (AWS, Azure, GCP) for scalable GIS and BI systems
  • Fulltime
Read More
Arrow Right
New

Senior Cloud AI Engineer

At Teradata, we believe that people thrive when empowered with better informatio...
Location
Location
India , Bengaluru; Hyderabad; Pune
Salary
Salary:
Not provided
teradata.com Logo
Teradata
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or equivalent from a recognized institution
  • 4+ years of experience in infrastructure, networking, devops or cloud technologies
  • Hands-on expertise with public cloud providers such as AWS, Azure, or GCP, cloud APIs and SDKs, or infrastructure components such as VPC/VNet, API gateways, storage or compute
  • Experience with virtualization/container orchestration technologies like Kubernetes, Istio or Docker
  • Advanced proficiency in automation tools like Terraform and Helm
  • Experience with configuration management tools like Chef or Puppet
  • Strong proficiency in languages like Python, Go, or Bash for services development and scripting
  • Familiarity with CI/CD pipelines and tools such as Jenkins, GitHub Actions or ArgoCD
  • Good understanding of design principles, distributed system patterns
  • Familiarity with security, compliance, IAM and observability
Job Responsibility
Job Responsibility
  • Design, develop, and maintain high quality cloud native or on-prem infrastructure with an emphasis on scalability, availability, resiliency, and performance
  • Design and review large-scale distributed systems supporting multi cloud deployments
  • Use IaC and automation tools such as Terraform to ensure infrastructure changes are reliable, repeatable, and version controlled
  • Develop self-service platforms and tools that improve developer productivity and streamline deployment lifecycles
  • Collaborate with cross-functional engineers and product partners to shape the product and enable consistent delivery of end to end features
  • Build and integrate robust RESTful APIs, ensuring security, data consistency, and maintainability
  • Work with SQL and/or NoSQL databases to implement efficient data models and service access patterns
  • Implement comprehensive monitoring, logging, and alerting systems
  • Apply and experiment with AI/ML technologies, including agentic AI and large language models (LLMs)
  • Use AI powered engineering tools to improve development quality, speed, and productivity
What we offer
What we offer
  • people-first culture
  • flexible working model
  • focus on wellbeing
  • Diversity, Equity, and Inclusion
  • Fulltime
Read More
Arrow Right

Senior Generative AI Engineer

At Codvo, we are committed to building scalable, future-ready data platforms tha...
Location
Location
India
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of overall professional experience in software or machine learning engineering
  • Bachelor's degree in Computer Science, Machine Learning, or a related technical field
  • 2+ years of relevant, hands-on experience with Generative AI, including: Building, optimizing, and deploying RAG (Retrieval-Augmented Generation) pipelines
  • In-depth experience with agentic frameworks (e.g., LangChain, LlamaIndex)
  • Experience with vector databases (e.g., Pinecone, Qdrant, pgvector)
  • Expert-level proficiency in Python and object-oriented design
  • Demonstrated experience with core AWS services for compute and deployment (e.g., EKS, ECS, Lambda, API Gateway)
  • Strong understanding of API development (REST) and building microservices
  • Fulltime
Read More
Arrow Right
New

Senior Workday AI & Integrations Engineer

We are seeking an innovative, forward-thinking Senior Workday AI & Integrations ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience building complex integrations
  • Mastery of Workday Studio, EIBs, CCWs, and Workday Security Groups is required
  • Proven experience prompt engineering, fine-tuning, or orchestrating Google Gemini (Flash/Pro) models within corporate software applications
  • Strong proficiency in Python (Asyncio, Pydantic, or frameworks used for ML/AI pipelines) and experience with API middleware or iPaaS solutions (MuleSoft, Boomi, or cloud native integration tools)
  • Advanced mastery of XML, XSLT, XPath, and JSON data transformations
  • Active or past Workday Studio Certification
  • Experience building custom apps on Workday Extend or using Workday Orchestrate
  • Familiarity with Google Cloud Platform (GCP) architecture, specifically Vertex AI
Job Responsibility
Job Responsibility
  • Design and deploy custom AI agents and agentic apps using Workday Build and Google Gemini LLMs to automate complex internal HR workflows
  • Implement semantic search, Retrieval-Augmented Generation (RAG) pipelines, and intelligent data extraction over unstructured HR data
  • Utilize Workday’s Developer Agent and modern AI-native developer tools to rapidly prototype and scale process automation
  • Ensure AI implementations are deeply grounded in real enterprise data using the Model Context Protocol (MCP) and Agent-Ready Tools under strict governance
  • Architect, develop, and test end-to-end inbound and outbound integrations using Workday Studio, EIB, Core Connectors, and Document Transformation
  • Build advanced Custom Reports, Matrix Reports, and complex Calculated Fields to securely pipe data to downstream vendors
  • Develop robust, versioned web service integrations using REST, SOAP, and GraphQL APIs
  • Write clean, optimized XML, XSLT, and JSON transformations to manage large-scale data sets
  • Enforce dual-authorization guardrails using Agent Gateway protocols to ensure AI agents operate safely
  • Partner closely with the HR Security team to align all integration and AI-driven workflows with enterprise data privacy, GDPR, and internal compliance protocols
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - AI-Powered Microservices

We are seeking an innovative and experienced Senior Software Engineer to join ou...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-7 years of professional experience in software development, with a significant focus on building and deploying microservices
  • Strong command of one or more backend programming languages such as Python, Java, C#, or Go
  • Proven experience with microservices architecture, including service discovery, API gateways, and inter-service communication
  • Hands-on experience with a major cloud platform (e.g., Azure, AWS, or GCP), including containerization (Docker) and orchestration (Kubernetes)
  • Solid experience in designing, building, and consuming RESTful or gRPC APIs
  • Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Design, build, and maintain efficient, reusable, and reliable microservices using modern best practices
  • Utilize AI-powered development tools, specifically Microsoft Copilot, to accelerate the software development lifecycle, from coding and testing to documentation
  • Develop and manage robust API integrations with a variety of Large Language Models (LLMs) to embed advanced AI capabilities into our applications
  • Collaborate with architects and product managers to design scalable and resilient systems that meet business and technical requirements
  • Write clean, scalable, and thoroughly tested code
  • Champion best practices in software development and mentor junior engineers
  • Work closely with cross-functional teams, including data science, product, and operations, to deliver high-quality, integrated solutions
  • Stay current with the latest advancements in AI, microservices, and cloud technologies, and actively look for opportunities to incorporate them into our platform
  • Fulltime
Read More
Arrow Right

Senior Full Stack Engineer (Enterprise AI Project)

At Codvo, we are committed to building scalable, future-ready data platforms tha...
Location
Location
India
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of overall professional experience in software engineering
  • 3+ years of relevant, hands-on experience in a Full Stack role
  • Bachelor's degree in Computer Science or a related technical field
  • Expert-level proficiency in modern frontend development for web and mobile, using frameworks like React, React Native
  • Experience building real-time conversational UIs (chatbots, assistants) and working with technologies like WebSockets
  • Strong proficiency in backend development using Python, Node.js to build and deploy production-grade RESTful APIs and microservices
  • Demonstrated experience with core AWS services for compute and deployment (e.g., EKS, ECS, Lambda, S3, RDS, API Gateway)
  • Experience with both SQL (e.g., PostgreSQL) and NoSQL databases
  • Fulltime
Read More
Arrow Right