CrawlJobs Logo

Applied AI Engineer - Agent

United States, New York 250000.00 - 300000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

We’re hiring an Applied AI Engineer to push the boundaries of our Cofounder agent. You’ll own core backend systems and applied LLM work: advancing agent reliability and autonomy, building evaluation pipelines, and shipping techniques that measurably improve agent performance. This is a hands-on role with high ownership across research-to-production: prototyping, instrumenting, evaluating, and deploying improvements that show up directly in user outcomes.

Job Responsibility

  • Design and implement agent improvements end-to-end: prompting strategies, tool selection, action planning, memory usage, safety/guardrails, and recovery paths
  • Build robust evaluation pipelines for the agent: offline evals (golden tasks, regression suites, behavior tests), online metrics (latency, success rate, fallout modes, cost efficiency), and experimentation frameworks (A/B, canaries, guardrail thresholds)
  • Productionize applied LLM techniques: function/tool-calling orchestration, self-reflection, retrieval/RAG, multi-agent handoffs, caching/embedding strategies, and hallucination reduction
  • Improve core backend systems: reliable job orchestration, retries/backoff, idempotency, and auditability
  • scalable memory and context routing
  • data pipelines across Gmail, Slack, Notion, Linear, Google Workspace, etc.
  • observability and tracing for agent actions/outcomes
  • Partner with product and infra to define success metrics and ship fast, safe iterations
  • Write clean, well-tested code
  • document design decisions and runbooks

Requirements

  • 4+ years backend engineering experience, preferably Python
  • Hands-on LLM experience: prompt engineering, function-calling, retrieval, embeddings, evaluation design
  • you’ve shipped LLM features to production
  • Track record building evaluation harnesses and using them to drive improvements (regression suites, task success metrics, cost/runtime tradeoffs)
  • Solid distributed systems fundamentals: concurrency, reliability, performance, data modeling, lifecycle management
  • Pragmatic experimentation: hypothesis → prototype → measured improvement → rollout
  • Excellent debugging and instrumentation skills
  • you enjoy finding and fixing edge cases in the wild

Nice to have

  • Experience with agent frameworks, tool orchestration, and memory architectures
  • RAG systems in production (chunking, retrieval quality, freshness strategies)
  • Redis, Postgres/Supabase, queues (e.g., Celery/Arq/SQS), and event-driven designs
  • Observability stacks (Datadog, OpenTelemetry), and cost/latency optimization

What we offer

  • Competitive salary and meaningful equity
  • Comprehensive benefits and flexible work setup

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Applied AI Engineer - Agent

8 matching positions

Senior AI Engineer (AI Agents & Applied LLMs)

We are looking for a Senior AI Engineer to design, build, and scale intelligent ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
infogrowth.in Logo
InfoGrowth
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in software engineering, machine learning, or AI-related roles
  • Strong experience with Python (required)
  • familiarity with JavaScript/TypeScript is a plus
  • Hands-on experience with LLMs, prompt engineering, and AI frameworks (LangChain, LlamaIndex, etc.)
  • Experience building production-grade APIs and services
  • Knowledge of vector databases (Pinecone, FAISS, Weaviate, etc.)
  • Solid understanding of data structures, algorithms, and system design
  • Experience deploying AI systems on cloud platforms (AWS, GCP, or Azure)
Job Responsibility
Job Responsibility
  • Design and develop AI agents capable of reasoning, planning, and executing tasks autonomously
  • Build and deploy LLM-powered applications using models such as GPT, Claude, or open-source LLMs
  • Integrate AI systems with APIs, databases, tools, and third-party services
  • Optimize prompts, workflows, and agent architectures for accuracy, performance, and cost
  • Lead end-to-end AI projects from concept to production
  • Collaborate closely with product managers, designers, and backend teams
  • Establish best practices for AI safety, evaluation, monitoring, and governance
  • Mentor junior engineers and conduct technical reviews
  • Fulltime
Read More
Arrow Right

Applied AI Engineer

Infer is building the operating system for insurance agencies. We make AI agents...
Location
Location
India , Bengaluru
Salary
Salary:
2000000.00 - 5000000.00 INR / Year
helpcare.ai Logo
Helpcare AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • ML engineering experience shipping production systems
  • Strong Python and a working ML stack (PyTorch, Huggingface, pandas, scikit-learn)
  • Hands-on experience designing LLM-based agents: prompting, tool/function calling, multi-turn state, structured outputs
  • Hands-on experience building evals or eval frameworks for ML, LLM, or voice systems. Built LLM-as-judge eval pipelines and know their failure modes
  • Practical experience with ASR/STT comparing providers, fine-tuning, or running open models like Whisper
  • Practical experience with TTS systems (ElevenLabs or open models)
  • Comfortable working with audio data: sample rates, codecs, noise, alignment
Job Responsibility
Job Responsibility
  • Building and maintaining the eval framework that scores voice agent quality across transcription, LLM reasoning, tool use, TTS, and full-conversation outcomes
  • Design voice agent behavior: system prompts, tool use, conversation flow, error recovery, and guardrails for real-time interactions
  • Drive STT and TTS accuracy improvements by comparing providers, tuning configurations, and running rigorous A/B experiments the team can act on
  • Drive TTS quality improvements voice selection, latency vs. fidelity tradeoffs, prosody, edge cases
  • Curate and grow our evaluation datasets, including hard-case mining from production traffic
  • You'll build benchmarks we can run against any new model in days, run a red-team pipeline that probes for jailbreaks, hallucinated quotes, and compliance failures
  • Partner with backend engineers to wire eval signals into CI so regressions get caught before they ship
  • Wire eval signals into CI so regressions block merges, and build self-improvement loops where hard cases from production auto-feed the eval set and our prompts optimize themselves over time
  • Fulltime
Read More
Arrow Right

Applied Ai Engineer

Build and ship AI features end-to-end (model → system → user experience); Design...
Location
Location
China , Shanghai
Salary
Salary:
600000.00 - 1500000.00 CNY / Year
https://www.randstad.com Logo
Randstad
Expiration Date
September 02, 2026
Flip Icon
Requirements
Requirements
  • Strong foundation in machine learning and modern neural network architectures
  • Hands-on experience with training, fine-tuning, or deploying ML models
  • Ability to write clean, production-quality code
  • Comfort working across abstraction layers (model → infra → product)
  • Strong problem-solving skills in ambiguous, fast-moving environments
  • Bias toward shipping, iteration, and continuous improvement
Job Responsibility
Job Responsibility
  • Build and ship AI features end-to-end (model → system → user experience)
  • Design and iterate on prompts, tools, memory, and agent workflows
  • Turn raw model outputs into structured, reliable, and predictable behaviors
  • Debug issues across the full stack (model, orchestration, infra, UX)
  • Optimize for latency, cost, and production reliability
  • Develop lightweight evaluation frameworks to measure real-world performance
  • Work closely with product and engineering to translate ambiguous problems into working systems
  • Fulltime
Read More
Arrow Right

Head of Applied AI & Agent Factory - Managing Director

Location
Location
United States , New York
Salary
Salary:
250000.00 - 500000.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of progressive leadership experience, including senior roles building and scaling delivery organizations - consulting partnerships, Forward Deployed Engineering / solutions engineering teams, or comparable in-business technology delivery functions inside complex firms.
  • Builder-operator profile — has personally stood up and scaled delivery organizations from a small core to hundreds of practitioners, ideally inside or alongside large, regulated businesses.
  • Deep current expertise in modern AI - agentic systems, LLM-based applications, AI evaluation and certification, and the practical realities of getting AI agents adopted in production enterprise environments.
  • Strong commercial and storytelling skills - credible peer to business COOs and CEOs
  • able to co-design process redesigns and to sell the change rather than impose it.
  • Bias to action, ruthlessly outcome-focused - relentless on real adoption, usage, and business impact rather than activity metrics
  • comfortable killing projects that aren't landing.
  • Cross-functional influencer - proven ability to operate in a matrixed environment across product, platform, controls, and business stakeholders without direct authority over all of them.
  • Strong financial acumen - fluent in business cases, ROI realization, and the commercial drivers of a complex global firm.
  • Risk & Compliance awareness - understands controls, model risk, and regulatory expectations as they apply to AI agents in global banking.
Job Responsibility
Job Responsibility
  • Operate the Agent Factory: an industrialized capability for the design, build, evaluation, and certification of enterprise AI agents at Citi scale.
  • Define and continuously evolve the firm's standards, patterns, and reference implementations for enterprise agents in close partnership with the Head of Core AI Platform (who provides the agentic runtime, guardrails, and evals) and the Head of Responsible AI (who owns approval and controls).
  • Own the official enterprise agent catalog - the curated, certified set of agents that Citi formally sanctions for production use across the firm - including lifecycle management, versioning, and decommissioning.
  • Build and lead a cadre of Applied AI engineers embedded directly into business lines, partnering with business COOs and process owners to design, deliver, and scale AI agents inside real workflows.
  • Co-design agent-led process redesigns with business COOs - moving beyond point automations to the redesign of end-to-end business processes around AI agents.
  • Operate a deliberate 'delivery-to-platform' feedback loop: ensure reusable assets, patterns, and components emerging from business-specific work are fed back into the Core AI Platform and Enterprise AI Solutions portfolio rather than re-built.
  • Partner with the Head of Enterprise AI Solutions to graduate high-leverage, repeatedly built business solutions into productized, horizontal capabilities.
What we offer
What we offer
  • Medical, dental & vision coverage
  • 401(k)
  • Life, accident, and disability insurance
  • Wellness programs
  • Paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
Read More
Arrow Right

Applied AI Engineer II

Are you a customer-obsessed, AI-curious problem-solver who thrives in an inclusi...
Location
Location
United States , Redmond
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 2+ years experience in low-code application development, engineering product/technical program management, data analysis, or product development OR equivalent experience
  • Bachelor's Degree AND 5+ years experience in low-code application development, engineering product/technical program management, data analysis, or product development OR equivalent experience
  • 1+ year(s) of experience using low-code/no-code platforms (e.g., Dataverse, Power Applications)
  • 1+ year(s) of experience managing and configuring artificial intelligence solutions (e.g., chatbots)
  • 1+ year(s) of experience with programming/coding
  • Familiarity with Azure services (Azure OpenAI, Azure AI Foundry, Azure Functions, Cosmos DB, or similar cloud-native technologies)
  • Experience with CI/CD pipelines, automated testing, and production observability
  • Understanding of data structures, algorithms, and system design fundamentals
Job Responsibility
Job Responsibility
  • Translate product specifications into AI service architectures — decompose business intent into agent workflows, data source integrations, and scalable service designs
  • Build agentic AI workflows using Azure AI Foundry Agent Service and Microsoft Agent Framework, including multi-agent coordination, tool integrations, and agent lifecycle management
  • Develop and iterate on LLM-based solutions including prompt engineering, model selection, cost/token optimization, and RAG pipeline design
  • Build evaluation systems including rubrics, golden datasets, and judge agents to validate agent correctness and safety before production deployment
  • Write production-quality C# and Python with test-driven development, ensuring services meet reliability, performance, and security standards
  • Deploy services using CI/CD pipelines, feature flags, and staged rollouts with full production observability (tracing, logging, metrics)
  • Implement secure service patterns including RBAC, Managed Identities, and secrets management
  • Integrate agents with Azure data sources and cloud-native services to ground agent responses in real-time signals
  • Apply Responsible AI practices across all agent development, ensuring outputs are safe, fair, and compliant
  • Execute reliably within sprint and co-development commitments across ACES and partner engineering teams
  • Fulltime
Read More
Arrow Right

Sr. Software Engineer - Applied AI

GEICO is seeking an experienced Sr. Software Engineer to join our Unified Commun...
Location
Location
United States , Palo Alto
Salary
Salary:
80000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional software engineering or applied machine learning experience
  • 1+ years working with Generative AI or LLM-based systems in production
  • Strong experience with Python and modern AI frameworks such as LangChain, LangGraph, LangSmith, LlamaIndex, Hugging Face, and OpenAI or Anthropic APIs
  • Demonstrated experience designing, building, and operating production AI systems, including agentic workflows and intelligent automation features
  • Proven track record building scalable, resilient, secure, and maintainable systems that run reliably in production
  • Strong understanding of agent architectures, workflow orchestration, retrieval-augmented generation, vector databases, and knowledge graph integration
  • Ability to work deeply with engineers, product managers, and domain experts to co-create solutions
  • Experience mentoring engineers and helping others grow in AI, LLM, and agent-based system design
  • History of delivering measurable business outcomes with AI solutions
  • Strong competency in distributed systems, service design, performance optimization, and reliability engineering
Job Responsibility
Job Responsibility
  • Identify AI opportunities: Evaluate and prioritize opportunities to automate business processes using AI, intelligent workflows, and agent-based systems
  • Design and ship applied AI solutions: Architect, build, and deploy AI solutions for high-value workflows including automation, document intelligence, decision support, and intelligent assistants
  • Build agentic workflows: Design and implement AI agents and agentic workflows that orchestrate tools, APIs, reasoning steps, and business logic to automate complex processes at scale
  • Own production systems: Develop services that meet high standards for scalability, resilience, performance, security, and availability
  • Leverage knowledge graphs: Use knowledge graphs to enhance reasoning, entity relationships, context retrieval, and multi-step workflows
  • Partner across functions: Collaborate with product, engineering, operations, and analytics partners to co-create scalable AI solutions and translate business needs into robust technical designs
  • Mentor and upskill others: Coach engineers and scientists in AI, LLMs, and agentic workflow design through pairing, reviews, and architectural guidance
  • Drive innovation: Explore new models, frameworks, and reasoning techniques and apply them thoughtfully to real-world challenges
  • Influence architecture: Provide technical guidance on architecture, experimentation, and deployment within and across teams
  • Experiment and evaluate rigorously: Run end-to-end experimentation, including hypothesis definition, measurement, validation, and iterative improvement in production environments
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Applied AI Engineer - MCP

We are hiring a founding group of engineers to kickstart this mission. As an AI ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
appian.com Logo
Appian Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • AI Infrastructure Experience: Professional experience building and deploying production-grade GenAI systems on GCP Vertex AI or AWS Bedrock including LLM APIs, agent frameworks, and RAG pipelines
  • Python Mastery: Deep proficiency in Python and common AI/ML libraries (e.g., LangChain, LlamaIndex, OpenAI SDK, Google Cloud AI SDK)
  • Agentic Systems: Hands-on experience building multi-step, tool-calling AI agents that operate reliably in production including tool schema design, structured outputs, and failure handling
  • MCP or Tool Protocol Experience: Familiarity with Model Context Protocol (MCP) or equivalent patterns for exposing enterprise resources to AI systems as callable, permissioned tools
  • Vector & Retrieval Systems: Experience with vector databases (Pinecone, pgvector, or similar) and embedding-based retrieval at scale
  • Technical Foundation: B.S. in Computer Science, Engineering, or a related technical field
  • The Pioneer Mindset: A self-starter who is excited to be part of a "first-of-its-kind" team and thrives in environments where you are building the playbook
Job Responsibility
Job Responsibility
  • Build the AI Platform: Design, deploy, and scale GenAI infrastructure on GCP Vertex AI (preferred) or AWS Bedrock
  • Build & Operate MCP Servers: Develop and maintain Model Context Protocol (MCP) servers that expose enterprise systems (databases, APIs, internal tools) as structured, AI-consumable capabilities
  • Design the Tool Layer: Build the tool registry and invocation framework that allows agents to interact with internal systems safely and reliably including schema design, access controls, and error handling
  • Engineer Agent-to-Agent Infrastructure: Architect the communication and coordination layer that allows specialized agents to delegate tasks, share context, and compose into larger autonomous workflows
  • Own the Retrieval Layer: Architect and operate RAG systems, including vector stores, embedding pipelines, chunking strategies, and retrieval evaluation frameworks
  • Establish AI Reliability: Instrument AI systems with logging, tracing, latency monitoring, and evaluation hooks so agents can be trusted, debugged, and improved in production
What we offer
What we offer
  • health coverage
  • Employee Assistance Program (EAP) with free mental health support
  • life and disability insurance
  • Employee Stock Purchase Program (ESPP)
  • retirement/pension plan
  • wellness dollars
  • tuition reimbursement
  • family-forming benefits
  • Fulltime
Read More
Arrow Right

Staff Applied AI Engineer, Enterprise GenAI

The SGP ML team works on the front lines of this AI revolution. We interface dir...
Location
Location
United States , San Francisco, CA; Seattle, WA; New York, NY
Salary
Salary:
216000.00 - 270000.00 USD / Year
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of full-time engineering experience, post-graduation
  • A love for solving deeply complex technical problems with ambiguity using state of the art research and AI to accomplish your client's business goals
  • Strong engineering background: a Bachelor's degree in Computer Science, Mathematics, or another quantitative field or equivalent strong engineering background
  • Deep familiarity with a data-driven approach when iterating on machine learning models and how changes in datasets can influence model results
  • Experience working with cloud technology stack (eg. AWS or GCP) and developing machine learning models in a cloud environment
  • Proficiency in Python to write, test and debug code using common libraries (ie numpy, pandas)
Job Responsibility
Job Responsibility
  • Own, plan, and optimize the AI behind our Enterprise customer's deepest technical problems
  • Leverage SGP to build the most advanced AI agents across the industry including multimodal functionality, tool-calling, and more
  • Have experience gathering business requirements and translating them into technical solutions
  • Meet regularly with customer teams onsite and virtually, collaborating cross-functionally with all teams responsible for their data and ML needs
  • Push production code in multiple development environments, writing and debugging code directly in both our customer's and Scale's codebases
  • Be able and willing to multi-task and learn new technologies quickly
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO
  • commuter stipend
  • Fulltime
Read More
Arrow Right