Senior AI Engineer Jobs

Apollo.io

Location:
India

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

As a Senior AI Engineer on our AI Engineering team, you will be responsible for building and productionizing advanced AI systems powered by Large Language Models (LLMs) and intelligent agents. You'll work on critical Apollo capabilities including our AI Assistant, Autonomous AI Agents, Deep Research Agents, Conversational Assistant, Semantic Search, Search Personalization, and AI Power Automation features that directly impact millions of users' productivity.

Job Responsibility:

Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions

Requirements:

7+ years of software engineering experience with a focus on production systems
1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
Experience building multi-step AI agents, LLM chaining, and complex workflow automation
Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
Expert-level Python skills for production AI systems
Strong experience building scalable backend systems, APIs, and distributed architectures
Experience with LangChain, LlamaIndex, or other LLM application frameworks
Proven ability to integrate multiple APIs and services to create advanced AI capabilities
Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)
Experience implementing rigorous evaluation frameworks for LLM systems including accuracy, safety, and performance metrics
Understanding of experimental design for AI system optimization
Experience with production monitoring, alerting, and debugging complex AI systems
Experience building and maintaining scalable data pipelines that power AI systems

Nice to have:

Production-First Mindset
Technical Depth with Business Impact
Evaluation & Quality Excellence
Adaptability & Learning

What we offer:

Invest deeply in your growth, ensuring you have the resources, support, and autonomy to own your role and make a real impact
Collaboration is at our core—we’re all for one, meaning you’ll have a team across departments ready to help you succeed
We encourage bold ideas and courageous action, giving you the freedom to experiment, take smart risks, and drive big wins

Additional Information:

Job Posted:
December 06, 2025

Work Type:

Remote work

View All Jobs In This Company

Job Link Share:

Senior AI Engineer