CrawlJobs Logo
NTT DATA Logo NTT DATA · IT - Software Development

Ai/Llm Platform Engineer

India, Bangalore · Job Posted May 27, 2026
Apply Position
Job Link Share

Job Description

We are looking for a highly skilled AI/LLM Platform Engineer with expertise in Python, LLM APIs, and enterprise AI platform development. The role involves designing, building, and scaling LLM-powered services with strong focus on observability, governance, and performance. The ideal candidate will have hands-on experience with AI gateways, agent frameworks, and cloud AI platforms such as Azure and GCP Vertex AI.

Job Responsibility

  • Design and develop LLM APIs (chat, generate, search, ingest)
  • Manage end-to-end API lifecycle including deployment and monitoring
  • Implement and operate AI Gateway capabilities (streaming, rate limits, quotas)
  • Build telemetry and observability frameworks using OpenTelemetry and tracing
  • Develop SDKs using LangGraph / ADK frameworks
  • Create and manage agent-based workflows
  • Implement batch and async API patterns with promotion gates
  • Ensure AI safety and governance through guardrails and content safety tools
  • Collaborate with cross-functional teams to integrate AI solutions at scale
  • Optimize performance, reliability, and scalability of AI platforms

Requirements

  • Strong programming skills in Python
  • Hands-on experience in LLM API design and implementation
  • Experience with API lifecycle management
  • Knowledge of AI Gateway operations (streaming, throttling, quotas)
  • Experience in Telemetry & Observability (OpenTelemetry, trace propagation)
  • Hands-on experience with SDK development (LangGraph / ADK)
  • Strong understanding of distributed systems and microservices architecture

Nice to have

  • Experience with Agent Frameworks (LangGraph / ADK)
  • Knowledge of LLM observability (spaces/projects)
  • Familiarity with batch & async API patterns
  • Experience with AI safety tools (Model Armor, Azure Content Safety, Guardrails)
  • Exposure to AI coding assistants (GitHub Copilot, Devin, Cursor)
  • Hands-on experience with GCP Vertex AI and Microsoft Azure environments
  • Understanding of LLMOps / MLOps practices
NTT DATA - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Ai/Llm Platform Engineer

8 matching positions

Platform Engineer (ai/llm Infrastructure)

We are currently seeking a Platform Engineer (AI/LLM Infrastructure) to join our...
Location
Location
United States , Santa Clara
Salary
Salary:
130000.00 - 170000.00 USD / Year
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in Platform Engineering, SRE, or Infrastructure Engineering
  • 3+ years of experience delivering and leading infrastructure for AI/LLM-based production systems
  • 3+ years of experience with Terraform and GitOps (ArgoCD/Flux)
  • 3+ years of experience with Azure (Key Vault, Monitor, DevOps Pipelines)
  • 3+ years of Experience with CI/CD and container registry management
Job Responsibility
Job Responsibility
  • Lead the design, implementation, and operation of scalable infrastructure platforms supporting AI/LLM-based solutions for enterprise clients
  • Act as a hands-on technical lead (player-coach), contributing to development while guiding a team of engineers
  • Own end-to-end infrastructure architecture below the application layer, including compute, container orchestration, CI/CD, observability, and security
  • Partner directly with clients and stakeholders to design, present, and deliver robust AI infrastructure solutions
  • Architect and manage production-grade Kubernetes environments (AKS/EKS), including cluster operations and RBAC
  • Design and operationalize RAG pipelines, including ingestion, chunking, embedding workflows, and vector database management
  • Lead GPU infrastructure provisioning and optimization (NVIDIA A100/H100 or similar)
  • Drive Infrastructure-as-Code adoption using Terraform and GitOps practices (ArgoCD/Flux)
  • Build and maintain CI/CD pipelines using GitHub Actions and Azure DevOps
  • Establish observability standards using Datadog, OpenTelemetry, and ELK/OpenSearch
  • Fulltime
Read More
Arrow Right

Platform Engineer

We are seeking a highly progressive Platform Engineer specializing in AI infrast...
Location
Location
Canada , Vancouver
Salary
Salary:
43.79 - 58.39 USD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
July 25, 2026
Flip Icon
Requirements
Requirements
  • 3-5 years of dedicated cloud platform engineering or SRE experience working with high-volume distributed systems natively in AWS and Azure
  • Elite proficiency with Terraform, with an emphasis on creating modular, reusable code structures and multi-environment pipelines
  • Coding proficiency in Python or Go, with a solid history of integrating with complex REST/JSON APIs
  • Strong operational working knowledge of GitLab CI/CD, Docker containerization, and cloud orchestration layers
  • Proven, hands-on exposure to AI/LLM development concepts (advanced prompting, tool/skill integration, and Retrieval-Augmented Generation [RAG])
  • Extensive experience leveraging AI and Agentic Coding tools to accelerate software delivery and maintain platform scripts
Job Responsibility
Job Responsibility
  • Build integration patterns, API mediation layers, and approval workflows supporting autonomous AI agent tool execution and runtime function calling
  • Integrate advanced distributed telemetry for agent runs (execution traces, evaluation metrics, latency logs, and token cost analytics)
  • Establish runtime safety controls for AI applications, embedding automated rollback scripts, cost control ceilings, and master kill-switches
  • Build and scale highly secure, automated multi-cloud landing zones (AWS and Azure) utilizing reusable Terraform modules
  • Construct and maintain robust GitLab CI/CD pipelines, package registries, and automated infrastructure release strategies
  • Implement strict automated infrastructure guardrails using Open Policy Agent (OPA), Conftest, or Azure Policies to guarantee security without breaking developer velocity
  • Embed least-privileged access, zero-trust network segmentation, private endpoints, KMS encryption keys, and advanced secrets management
  • Champion Site Reliability Engineering standards by managing Service Level Objectives (SLOs), calculating error budgets, configuring autoscaling matrices, and leading chaos engineering simulations
  • Apply cloud financial management protocols (structured resource tagging, budget alarms, anomaly detection, and cluster right-sizing)
  • Author clear, accessible developer guides and self-service templates that streamline the adoption of core AI platform features
What we offer
What we offer
  • Pioneering Technical Landscape
  • Elite Multi-Cloud Exposure
  • High Extensibility Indicators
  • Premier Workspace
  • Fulltime
Read More
Arrow Right

Principal Software Engineer – Platform Owner

Principal Software Engineer – Platform Owner (Hands-on). At Furhat Robotics we b...
Location
Location
Sweden , Stockholm
Salary
Salary:
Not provided
furhatrobotics.com Logo
Furhat Robotics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Are excited about AI and robotics
  • Are excited about building a reliable platform developers (specifically researchers) love to use
  • Have been a founding engineer, principal engineer, or startup CTO before
  • Have taken messy systems and made them reliable
  • Like owning things end-to-end
  • Prefer small teams over big orgs
  • Are comfortable working independently
  • Don’t need a lot of process or meetings
  • Like coding more than managing
  • Solve problems with automation and simplification, not hiring
Job Responsibility
Job Responsibility
  • Own the robot platform (Java)
  • Own the SDK (Kotlin)
  • Own internal tools (React)
  • Own APIs and backend services
  • Own cloud & DevOps (AWS/Azure)
  • Run CI/CD and releases
  • Clean up legacy and simplify architecture
  • Break roadmap into shipped features
  • Guide/mentor junior engineers and consultants
  • Hire very selectively when truly needed
What we offer
What we offer
  • Meaningful equity
  • Real ownership and autonomy
  • Flexible hours
  • Competitive option package
  • Paid vacation & parental leave
  • Monthly workout grants
  • Personal health insurance & life insurance
  • Free beverages, snacks, team ginger shots
  • Breakfast
  • Team building. Game nights, AWs, cook-offs etc.
  • Fulltime
Read More
Arrow Right

Data Engineer - Platform

The Amgen India Digital Technology & Innovation (DTI) Sr. Associate IS Data Engi...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree and 2 years of Information Systems experience Or Bachelor’s degree and 4 years of Information Systems experience
  • 3+ years of experience in developing, implementing and supporting Data and Analytics Data Lake systems, analytics/reporting and metrics/visualization tools
  • Experience using Databricks platform developing integration pipelines, SFDC APIs, REST based web services, SQL, XML, and JavaScript
  • Extensive hands-on technical and engineering experience with building REACT based UI solutions
  • Experience working in BI environments like Tableau / Power-BI etc.
  • Experience developing in an enterprise environment with numerous applications, development teams, in an AGILE framework
  • Understand AWS services, Security frameworks and AI/LLM base models
Job Responsibility
Job Responsibility
  • Function as a Digital Technology Data and Analytics Data Engineer within a Scaled Agile Framework (SAFe) product team
  • As member of Global Medical Data and Analytics Product team, ensure progress to business needs in a cost effective, compliant, reliable way
  • Use data, AI and metrics to understand trends in user behavior and product usage to influence strategy
  • Integrate data and develop integration queries, ETL pipelines in Databricks datalake environment.
  • Lead data analysis and insights user stories and utilize existing CI/CD delivery pipeline and processes - streamlining current processes with a focus on automation
  • Communicate software and system designs using Miro, Lucid Chart, or other modeling tools and software.
  • Develop Test classes and automation to validate business logic and avoid production issues
  • Work closely with other developers in PRODUCT SCRUM team including business analyst, software engineers, Validation analyst and Product Owner
  • Research AI/LLM based solutions and Drive Proof of Concepts to suit business requirements, Stay abreast of the latest trends in DevOps methodologies and emerging industry solutions
  • Participate and develop business prioritized Data and Analytics matrix and user stories using Databricks environment
Read More
Arrow Right

Data Engineer - Platform

The Amgen India Digital Technology & Innovation (DTI) Sr. Associate IS Data Engi...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree and 2 years of Information Systems experience Or Bachelor’s degree and 4 years of Information Systems experience
  • 3+ years of experience in developing, implementing and supporting Data and Analytics Data Lake systems, analytics/reporting and metrics/visualization tools
  • Experience using Databricks platform developing integration pipelines, SFDC APIs, REST based web services, SQL, XML, and JavaScript
  • Extensive hands-on technical and engineering experience with building REACT based UI solutions
  • Experience working in BI environments like Tableau / Power-BI etc.
  • Experience developing in an enterprise environment with numerous applications, development teams, in an AGILE framework
  • Understand AWS services, Security frameworks and AI/LLM base models
  • Ability to handle multiple projects simultaneously and prioritize tasks effectively
  • Excellent problem-solving skills and a passion for tackling complex challenges
  • Collaborative spirit and effective communication skills to work seamlessly in a cross-functional team
Job Responsibility
Job Responsibility
  • Function as a Digital Technology Data and Analytics Data Engineer within a Scaled Agile Framework (SAFe) product team
  • As member of Global Medical Data and Analytics Product team, ensure progress to business needs in a cost effective, compliant, reliable way
  • Use data, AI and metrics to understand trends in user behavior and product usage to influence strategy
  • Integrate data and develop integration queries, ETL pipelines in Databricks datalake environment
  • Lead data analysis and insights user stories and utilize existing CI/CD delivery pipeline and processes - streamlining current processes with a focus on automation
  • Communicate software and system designs using Miro, Lucid Chart, or other modeling tools and software
  • Develop Test classes and automation to validate business logic and avoid production issues
  • Work closely with other developers in PRODUCT SCRUM team including business analyst, software engineers, Validation analyst and Product Owner
  • Research AI/LLM based solutions and Drive Proof of Concepts to suit business requirements, Stay abreast of the latest trends in DevOps methodologies and emerging industry solutions
  • Participate and develop business prioritized Data and Analytics matrix and user stories using Databricks environment
What we offer
What we offer
  • Reasonable accommodation for individuals with disabilities
Read More
Arrow Right

Senior Software Engineer, Frontend Platform

At Vanta, our mission is to help businesses earn and prove trust. We believe tha...
Location
Location
United States
Salary
Salary:
179000.00 - 211000.00 USD / Year
vanta.com Logo
Vanta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Have experience building and maintaining software services and infrastructure platforms
  • Have a deep understanding of TypeScript and React
  • Have a deep understanding of writing and testing performant web client code
  • Have experience scaling platform systems
  • Have experience writing codemods and migration automations
  • Demonstrate empathy for the developer experience (DX) and have a strong product sense for developer tooling
  • Open to using AI to amplify their skills and strengthen their work - demonstrating curiosity, a willingness to learn, and sound judgment in applying AI responsibly to improve efficiency and impact
Job Responsibility
Job Responsibility
  • Lead complex projects with multiple stakeholders and engineers to enable our business and team to scale
  • Evolve our frontend build system: bundlers, static analysis, caching, package management, and monorepo tooling
  • Develop and scale our frontend testing strategy (unit, integration, visual regression, and E2E)
  • Maintain and evolve GraphQL tooling: code patterns, developer tooling, scalability, and reliability
  • Improve web performance and observability: set SLOs, implement monitoring and alerting, and drive remediation
  • Plan and run modernization and migration initiatives leveraging codemods and AI/LLM tooling
  • Work with talented and kind engineers to make a significant impact on our customer base, enabling them to improve their security and prove it
  • Contribute to building Vanta’s engineering culture as we grow
What we offer
What we offer
  • Offers Equity
  • medical benefits
  • 401(k) plan
  • other company perk programs
  • Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans
  • 16 weeks fully-paid Parental Leave for all new parents
  • Health & wellness stipend
  • Remote workspace, internet, and cellphone stipend
  • Commuter benefits for team members who report to the SF and NYC office
  • Family planning benefits
  • Fulltime
Read More
Arrow Right

Full Stack Software Engineer (Microsoft Power Platform / AI Automation)

We are seeking an experienced Full Stack Software Engineer to lead the design an...
Location
Location
United States , Halethorpe
Salary
Salary:
90000.00 - 125000.00 USD / Year
pipercompanies.com Logo
Piper Companies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building production-level solutions with Microsoft Copilot Studio
  • Strong experience with Power Apps, Power Automate, and Dataverse
  • Full stack development experience (e.g., APIs, databases, front-end interfaces)
  • Proficiency in at least one programming language (e.g., Python, Java, or similar)
  • Practical experience using AI/LLM tools (e.g., Claude, OpenAI, or similar) in real-world applications
  • Ability to work independently and deliver solutions with minimal guidance
  • Strong communication skills and ability to work with both technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Design, build, and deploy AI-powered automation solutions using Microsoft Copilot Studio and related tools
  • Develop and maintain Power Apps, Power Automate workflows, and Dataverse-backed applications
  • Integrate AI agents with internal systems, APIs, and operational workflows
  • Build full stack solutions including backend services and user-facing interfaces
  • Collaborate with stakeholders to translate business needs into technical solutions
  • Lead technical planning and execution for automation initiatives
  • Ensure solutions are scalable, maintainable, and production-ready
What we offer
What we offer
  • PTO
  • Paid Holidays
  • Medical
  • Dental
  • Vision
  • 401 (K)
  • Sick Leave (As required by law)
  • Fulltime
Read More
Arrow Right

Senior Test Automation Engineer

We are seeking a Senior Test Automation Engineer with 7– 8+ years of experience ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
appian.com Logo
Appian Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency: Coding experience in Java or Python.
  • Tooling: Experience with WebDriver, Selenium, PlayWright and Postman.
  • Infrastructure: Mastery of Git, Jira, CI/CD build processes, and IDE-based debugging.
  • AI Integration: Ability to integrate AI/LLM tools into the testing lifecycle (e.g., self-healing scripts, automated test case generation).
  • Platform Knowledge: Working knowledge of at least one Appian subsystem or similar low-code platform architecture.
  • Experience: Minimum of 7–8 years of relevant experience in software test engineering or full stack quality engineering.
  • Education: B.S. or M.S. degree in Computer Science, Engineering, or a related technical field.
Job Responsibility
Job Responsibility
  • AI & Innovation: Envision and implement AI-augmented testing strategies, including autonomous test generation, test execution, and intelligent defect prediction to maximize ROI.
  • Framework Architecture: Design and maintain scalable, low-fragility test frameworks (System/API/UI) that isolate coupling to the System Under Test (SUT) and integrate seamlessly into CI/CD pipelines.
  • Orchestration & Context: Manage complex test environments and data orchestration, ensuring that automated suites provide high-fidelity feedback at every stage of the development lifecycle.
  • Full-Stack Debugging: Distinguish between test artifacts and deep-seated application errors
  • narrow down defects to specific modules, functions, or integrations with precision.
  • Technical Leadership: Lead code reviews for testability, contribute to TAC (Technical Architecture Council) documents, and mentor junior engineers on automation best practices.
  • Performance: Develop and execute performance test plans using tools like Locust.
  • Strategic Execution: Break down complex features into technical stories, identify edge cases and technical risks, and surface blockers with a clear sense of priority.
What we offer
What we offer
  • Health coverage
  • Employee Assistance Program (EAP) with free mental health support
  • Life and disability insurance
  • Employee Stock Purchase Program (ESPP)
  • Retirement/pension plan
  • Wellness dollars
  • Tuition reimbursement
  • Family-forming benefits
  • Fulltime
Read More
Arrow Right