Staff AI Engineer Job at Teradata (Pune, Maharashtra)

Staff AI Engineer

Teradata

Location:
India , Pune, Maharashtra ▼
Karnataka

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

We are looking for a visionary and technically deep AI Architect to lead the design and delivery of enterprise-grade artificial intelligence solutions. This is a senior strategic role for someone who brings extensive hands-on experience across the full AI landscape — from Large Language Models (LLMs), Generative AI, and MCP servers, to machine learning pipelines, AI agent frameworks, and responsible AI governance. You will define the AI architectural vision, guide engineering teams, and ensure AI capabilities are embedded into the organization's products and platforms with scalability, security, and trustworthiness at its core.

Job Responsibility:

Define and own the enterprise AI architecture strategy, establishing standards, reference architectures, and technology roadmaps for AI/ML adoption
Architect and oversee the design of LLM-powered applications including RAG pipelines, AI agents, and agentic workflow systems
Design and govern MCP server implementations, enabling structured, context-aware interactions between LLMs and enterprise data sources
Lead the evaluation and selection of AI/ML platforms, LLM providers (OpenAI, Anthropic, Azure OpenAI, Google Gemini, open-source models), and supporting infrastructure
Architect prompt engineering frameworks, fine-tuning pipelines, and model evaluation strategies to ensure LLM output quality, accuracy, and reliability
Design AI orchestration layers using frameworks such as LangChain, LlamaIndex, AutoGen, CrewAI, or custom agentic architectures for multi-step reasoning workflows
Establish AI data pipelines for model training, embeddings generation, vector database management, and real-time inference serving
Define and enforce responsible AI practices including bias detection, explainability, hallucination mitigation, content safety guardrails, and regulatory compliance
Collaborate with engineering leads, data scientists, and product teams to embed AI capabilities into existing platforms and new product initiatives
Mentor and upskill engineering teams on AI/ML technologies, architectural patterns, and emerging developments in the AI ecosystem
Stay at the forefront of AI research and industry developments, identifying opportunities to apply new techniques and technologies to enterprise challenges

Requirements:

10+ years of experience in software engineering or technology architecture
At least 4 years focused on AI, ML, and Generative AI solutions at enterprise scale
Deep hands-on expertise with Large Language Models (LLMs) including model selection, prompt engineering, fine-tuning (LoRA, PEFT), and evaluation techniques
Proven experience designing and implementing MCP servers and structured context management strategies for LLM applications
Strong working knowledge of Generative AI frameworks and orchestration tools — LangChain, LlamaIndex, LangGraph, AutoGen, CrewAI, or equivalent agentic platforms
Hands-on experience with RAG architectures, vector databases (Pinecone, Weaviate etc), and embedding models
Proficiency in Python-based AI/ML development, including libraries such as HuggingFace Transformers, PyTorch, TensorFlow, scikit-learn, and OpenAI SDK
Experience with AI cloud platforms and services — Azure OpenAI, AWS Bedrock, Google Vertex AI, or equivalent enterprise AI infrastructure
Solid understanding of MLOps practices including model versioning, experiment tracking (MLflow, Weights & Biases), CI/CD for ML, and model monitoring in production
Familiarity with AI agent design patterns, multi-agent systems, tool-use frameworks, and autonomous workflow orchestration
Knowledge of responsible AI principles, AI safety practices, regulatory landscape (EU AI Act, GDPR), and enterprise AI governance frameworks
Strong foundation in software architecture patterns, distributed systems, API design, and cloud-native infrastructure (Docker, Kubernetes, microservices)

What we offer:

People-first culture
Flexible work model
Focus on well-being
Inclusive environment

Additional Information:

Job Posted:
March 24, 2026

Employment Type:

Fulltime

Work Type:

Hybrid work

Teradata - All Job Offers

Job Link Share: