Staff AI Engineer Jobs

Apollo.io

Location:
United States

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

200000.00 - 280000.00 USD / Year

Save Job

Apply Position

Job Description:

As a Staff AI Engineer on our AI Engineering team, you will be responsible for building and productionizing advanced AI systems powered by Large Language Models (LLMs) and intelligent agents. You'll work on critical Apollo capabilities including our AI Assistant, Autonomous AI Agents, Deep Research Agents, Conversational Assistant, Semantic Search, Search Personalization, and AI Power Automation features that directly impact millions of users' productivity. The mission of our AI teams is to leverage Apollo's massive scale data and cutting-edge AI to understand and predict user behaviors, personalize experiences, and optimize every stage of the customer journey through intelligent automation.

Job Responsibility:

Design and Deploy Production LLM Systems
Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
Develop and optimize prompting strategies
Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems
Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions
Build sophisticated multi-agent systems that can reason, plan, and execute complex sales workflows
Develop systems that maintain conversational context across complex multi-turn interactions
Build scalable large language model and agentic platforms
Build back-end systems necessary to support the agents

Requirements:

8+ years of software engineering experience with a focus on production systems
1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage
Experience building multi-step AI agents, LLM chaining, and complex workflow automation
Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
Expert-level Python skills for production AI systems
Strong experience building scalable backend systems, APIs, and distributed architectures
Experience with LangChain, LlamaIndex, or other LLM application frameworks
Proven ability to integrate multiple APIs and services to create advanced AI capabilities
Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)
Experience implementing rigorous evaluation frameworks for LLM systems including accuracy, safety, and performance metrics
Understanding of experimental design for AI system optimization
Experience with production monitoring, alerting, and debugging complex AI systems
Experience building and maintaining scalable data pipelines that power AI systems

Nice to have:

Experience with Search Scoring & Ranking
Experience with Entity Extraction
Experience with Lookalike & Recommendation Systems

What we offer:

equity
company bonus or sales commissions/bonuses
401(k) plan
at least 10 paid holidays per year, flex PTO, and parental leave
employee assistance program and wellbeing benefits
global travel coverage
life/AD&D/STD/LTD insurance
FSA/HSA and medical, dental, and vision benefits

Additional Information:

Job Posted:
December 06, 2025

Employment Type:

Fulltime

Work Type:

Remote work

View All Jobs In This Company

Job Link Share:

Staff AI Engineer