CrawlJobs Logo

Senior AI Backend Engineer

Israel, Tel-Aviv · Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

As a core member of our AI Engineering team, you will collaborate with data scientists, ML engineers, and product managers to build scalable, production-ready infrastructure and APIs that power intelligent systems.

Job Responsibility

  • Build and maintain reliable, scalable backend services to support AI agent execution and orchestration
  • Develop AI agent systems for complex operational workflows using LangChain, LangGraph, LiteLLM, and Langfuse
  • Orchestrate a hybrid model stack that includes OpenAI and Google Gemini alongside self-hosted and fine-tuned LLMs like Gemma and Llama
  • Build and maintain integrations with clinical systems (FHIR, EMR)
  • Drive observability and reliability using OpenTelemetry, Datadog, and Langfuse
  • Design APIs (GraphQL, REST), background workers, and event-driven systems that interface with AI inference engines and agent runtimes
  • Collaborate with Data Science, ML, and engineering teams to deploy AI features and improve the performance, scalability, and reliability of backend systems
  • Participate in code reviews, knowledge sharing, and mentoring to elevate the team’s technical capabilities

Requirements

  • 6+ years of backend engineering experience
  • Strong proficiency in more than one major programming language (such as Python, Java, Go, Rust, or Kotlin)
  • Solid understanding of AI systems architecture and experience working in environments involving AI agents, LLMs, or inference pipelines
  • Proven experience in building and scaling backend APIs, microservices, and background jobs
  • Strong experience with relational and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB, Redis), including schema design, data modeling, and query optimization
  • Experience with message brokers and distributed systems (e.g., Pub/Sub, Redis Streams, RabbitMQ)
  • Highly adaptable, a strong team player, with the ability to quickly learn and apply new technologies

Nice to have

  • Strong proficiency in Python and/or Node.js/NestJS
  • Experience with clinical systems and healthcare data standards (FHIR, EMR/EHR)
  • Hands-on experience with AI agent frameworks such as LangChain, LangGraph, or LiteLLM
  • Experience orchestrating hybrid model stacks combining commercial APIs (OpenAI, Google Gemini) with self-hosted or fine-tuned LLMs
  • Familiarity with observability tools for AI systems (Langfuse, OpenTelemetry)

What we offer

Competitive compensation packages based on industry benchmarks for function, level, and geographic location

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior AI Backend Engineer

8 matching positions

Senior Backend Engineer (AI Focus)

Location
Location
Spain; Bosnia & Herzegovina; France; Italy; Kosovo; Malta; Moldova; Portugal; Romania; Serbia; UK; Ukraine
Salary
Salary:
Not provided
deel.com Logo
Deel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in backend/full-stack engineering
  • JavaScript, Node.js and PostgreSQL experience
  • Strong API integration skills
  • Hands-on experience integrating AI APIs into production systems
  • Comfort working with unstructured/messy data and ETL pipelines
Job Responsibility
Job Responsibility
  • Build backend services that bring AI capabilities to life inside our Payroll workflows
  • Collaborate with ML engineers and operations to create real-world AI-powered tools
What we offer
What we offer
  • Stock grant opportunities dependent on your role, employment status and location
  • Additional perks and benefits based on your employment status and country
  • The flexibility of remote work, including optional WeWork access
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer (AI Applications)

Plaud is building the world's most trusted AI work companion for professionals t...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
plaud.ai Logo
Plaud
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3 years of software engineering experience in AI, backend systems, or related fields
  • Strong programming fundamentals in languages such as Python, Go, or similar
  • Practical understanding of LLM applications and integrating model-based workflows into products
  • Ability to design, implement, and maintain large-scale, production-grade systems
Job Responsibility
Job Responsibility
  • Design and build AI Agent application systems that power intelligent user experiences
  • Develop and optimize retrieval systems that integrate deeply with Agent reasoning and workflows
  • Collaborate with product and cross-functional teams to deliver end-to-end AI application features
  • Continuously iterate on Agent capabilities, improving reliability, adaptability, and performance
  • Explore and prototype new forms of AI intelligence to push the boundaries of product experience
What we offer
What we offer
  • Define the next-gen paradigm for human-AI interaction
  • Gain exposure to cutting-edge AI for Pro tools and play a direct role in our global expansion
  • Work with passionate teammates who value innovation, collaboration, and customer success
  • Grow your career in a culture that champions continuous learning and fast career development
  • Market-competitive compensation, global exposure, and a vibrant, creativity-fueled work atmosphere
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer - AI Framework

As a Senior Backend Engineer on Gong’s AI Framework team, you will build the fou...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
gong.io Logo
Gong
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of backend engineering experience, with strong system design and platform-building expertise
  • Strong analytical and problem-solving skills, with the ability to debug and resolve complex technical issues efficiently
  • Hands-on experience with agentic systems and frameworks such as LangChain, LangSmith, ADK, or equivalent agent orchestration platforms
  • Strong understanding of AI evaluation methodologies, including agent evaluations, prompt evaluation, regression testing, and quality monitoring
  • High proficiency in Python for building production-grade AI frameworks and services
  • Familiarity with Java and experience integrating backend platforms or tooling into Java-based systems
  • Experience building observability, monitoring, or platform tooling for distributed systems
  • Strong analytical skills and the ability to reason about complex, evolving AI-driven systems
  • Experience with cloud platforms and scalable microservices architectures
  • Excellent communication skills and a strong platform mindset, with experience enabling multiple teams
Job Responsibility
Job Responsibility
  • Agentic Framework Architecture: Designing and building Gong’s internal agentic framework, leveraging and integrating industry-standard tools such as LangChain, LangSmith, ADK, and similar ecosystems
  • Evaluation and Quality Systems: Building evaluation frameworks and workflows for AI agents, including offline and online evaluations, quality metrics, regression detection, and experimentation infrastructure
  • Observability, Monitoring, and Guardrails: Providing the organization with robust observability capabilities for AI agents, including tracing, logging, monitoring, cost tracking, and safety guardrails to ensure reliable and responsible usage
  • Developer Enablement Platforms: Creating APIs, SDKs, and abstractions that enable product teams to easily build, test, and operate agents while adhering to platform standards
  • Cross-Language Integrations: Designing integrations and tooling across Python and Java to enable seamless adoption of the AI framework within Gong’s broader backend ecosystem
What we offer
What we offer
  • flexibility
  • autonomy
  • positive work relationships
  • effective work habits
Read More
Arrow Right

Staff / Senior Backend Engineer, Agentic AI

This team designs intelligent, autonomous systems that eliminate financial opera...
Location
Location
United States , San Francisco
Salary
Salary:
150000.00 - 299000.00 USD / Year
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years backend experience with Python at scale
  • Deep knowledge of SQL/NoSQL database design
  • Experience with distributed systems, event-driven architectures, or microservices
  • Familiarity with GCP services (Pub/Sub, Cloud Run, Cloud SQL, BigQuery, KMS, etc.)
  • Strong grasp of security and compliance best practices
  • Passion for building the backend that powers intelligent products
Job Responsibility
Job Responsibility
  • Design and operate distributed, event-driven systems that process high-volume, high-sensitivity financial data with strict correctness and latency guarantees
  • Build typed, production-grade APIs and services in Python (FastAPI + Pydantic) that power agentic workflows, AI copilots, and real-time financial infrastructure
  • Own data architecture end-to-end schema design, event models, ledger primitives, and storage layers optimized for auditability, traceability, and scale
  • Develop resilient infrastructure primitives (queues, retries, idempotency, observability, backpressure handling) that let teams ship fast without sacrificing reliability
  • Work at the intersection of systems + AI, building feedback loops where product data continuously improves models and models autonomously improve system behavior
  • Ship platform foundations, not one-off features internal frameworks, SDKs, and tooling that accelerate every engineer in the org
  • Partner closely with ML + product teams to productionize research-grade ideas into real customer-facing systems
  • Help define the architecture of an AI-native financial stack not bolting AI onto software, but designing software assuming AI is a first-class runtime
What we offer
What we offer
  • Offers Equity
  • Offers Bonus
  • medical, dental, and vision insurance
  • a 401(k) plan
  • short-term and long-term disability
  • basic life insurance
  • well-being benefits
  • 20 paid days of vacation
  • 12 paid days of company holidays
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer, Applied AI

Our mission is to accelerate healthcare transformation through our AI-powered pl...
Location
Location
United States
Salary
Salary:
Not provided
Clarium
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Demonstrated experience in building and deploying AI applications
  • Understanding of backend architecture principles and AI application design best practices
  • Experience working with RESTful APIs and integrating third-party services
  • Strong understanding of database technologies
  • Self-motivated with excellent problem-solving and communication skills
Job Responsibility
Job Responsibility
  • Architect and develop robust backend systems to integrate with proprietary LLM APIs
  • Take ownership of critical system components, from backend APIs to AI agent implementation
  • Design and develop scalable back-end services using Python and FastAPI
  • Collaborate with internal product managers and customers to align product development with real-world needs
What we offer
What we offer
  • Incentive Stock Options proportionate to salary
  • Fully remote work
  • Unlimited PTO
  • Top-tier health, vision, and dental benefits
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Backend (AI)

We’re looking for a Senior Backend Engineer to join our newly formed AI R&D pod—...
Location
Location
United States , New York City
Salary
Salary:
200000.00 - 225000.00 USD / Year
posh.vip Logo
Posh
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3–6+ years of backend or full-stack engineering experience, with a proven track record of shipping high-quality, scalable systems in fast-paced environments
  • Deep expertise in Python and its ecosystem for web services and data processing
  • Strong experience with Infrastructure as Code (Terraform), a major cloud platform (e.g., GCP, AWS, Azure), and deploying containerized applications
  • A passion for shaping 0→1 products in a lean, fast-paced R&D environment where you'll help define new playbooks for AI-native experiences
Job Responsibility
Job Responsibility
  • Build and Scale AI Services: Design, build, and maintain scalable backend services and APIs for AI-powered features, writing primary production code in Python
  • Architect Multi-Agent Systems: Move beyond standard RAG to design and implement complex, hierarchical Multi-Agent Systems that can perform sophisticated, multi-step tasks
  • Implement Evaluation and Fine-Tuning: Build robust frameworks to evaluate the quality of AI systems and manage fine-tuning pipelines to continuously improve model performance
  • Own Cloud Infrastructure with IaC: Define, deploy, and manage our AI infrastructure using Terraform. You'll be responsible for scaling our container-based serverless solutions while ensuring reliability and performance
  • Optimize for Efficiency: Deeply analyze the tradeoffs between model performance, latency, and cost to make pragmatic, business-aware technical decisions when using managed AI services
  • Integrate Across the Stack: Collaborate with our core engineering teams by occasionally working in TypeScript (Node.js) to integrate AI features into our main application
What we offer
What we offer
  • Health,Dental and Vision Insurance
  • Equinox Membership
  • Unlimited PTO
  • Team Events, Dinners, & Offsites, Free Event Tickets to Dope Shows
  • New MacBook
  • Daily Uber Eats Credit
  • Relocation bonuses are available for some out-of-state candidates
  • Offers Equity
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer - Employee AI

Join our dedicated, fast-paced experimentation and innovation unit, where you'll...
Location
Location
Germany , Dresden
Salary
Salary:
Not provided
staffbase.com Logo
Staffbase
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional experience in backend software development
  • Strong proficiency in Golang and preferably Java/Kotlin
  • Experience with cloud platforms (AWS, GCP, or Azure) and containerization technologies (Docker, Kubernetes)
  • Experience building backend systems designed for complex agentic workflows or long-running conversational states
  • Familiarity with foundational LLM concepts such as retrieval-augmented generation (RAG)
  • Practical experience developing or managing MCP servers (Managing Conversational Protocols)
  • Familiarity with Agent-to-Agent (A2A) communication protocols and multi-agent system design
  • Experience with event-driven architecture and message queues (e.g. Kafka)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable and fault-tolerant backend services that power our AI applications
  • Apply advanced prompt engineering techniques to optimize model performance, manage context windows, and ensure reliable, high-quality responses
  • Implement model integration patterns to connect and orchestrate various external and internal services
  • Develop Agent-to-Agent (A2A) protocol communication strategies for complex multi-agent architectures
  • Implement systems for Managing Conversational Protocols (MCP servers) and Agent-to-Agent (A2A) protocol to handle and maintain long-running, stateful interactions
  • Define and implement observability standards for AI applications, including metrics for latency, cost, token usage, drift, and user-perceived quality
  • Implement logging, tracing, and monitoring tools to quickly diagnose and troubleshoot issues in the end-to-end AI pipeline
  • Collaborate with ML Scientists and Data Scientists to transition prototypes and models into production-ready, high-availability services
  • Ensure the security, reliability, and performance of all production systems
  • Participate in code reviews, architectural discussions, and technical strategy planning
What we offer
What we offer
  • Competitive Compensation - we offer attractive salary packages including LTIP (Long Term Incentive Plan)
  • Flexibility - we offer flexible working time models and the option of hybrid work, and support this with a yearly flex work allowance of €1560
  • Recharge - with 31 vacation days annually (incl. one floating holiday), plus pro rata fully paid Fridays off during August
  • Wellbeing - Monthly Wellbeing Allowance €35, from fitness to mental health, hobbies to relaxation
  • Support - we’re offering a company pension scheme
  • Volunteers Day - you’ll get one day off per year for supporting a social project
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer - Employee AI

Join our dedicated, fast-paced experimentation and innovation unit, where you'll...
Location
Location
Germany , Leipzig
Salary
Salary:
Not provided
staffbase.com Logo
Staffbase
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional experience in backend software development
  • Strong proficiency in Golang and preferably Java/Kotlin
  • Experience with cloud platforms (AWS, GCP, or Azure) and containerization technologies (Docker, Kubernetes)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable and fault-tolerant backend services that power our AI applications
  • Apply advanced prompt engineering techniques to optimize model performance, manage context windows, and ensure reliable, high-quality responses
  • Implement model integration patterns to connect and orchestrate various external and internal services
  • Develop Agent-to-Agent (A2A) protocol communication strategies for complex multi-agent architectures
  • Implement systems for Managing Conversational Protocols (MCP servers) and Agent-to-Agent (A2A) protocol to handle and maintain long-running, stateful interactions
  • Define and implement observability standards for AI applications, including metrics for latency, cost, token usage, drift, and user-perceived quality
  • Implement logging, tracing, and monitoring tools to quickly diagnose and troubleshoot issues in the end-to-end AI pipeline
  • Collaborate with ML Scientists and Data Scientists to transition prototypes and models into production-ready, high-availability services
  • Ensure the security, reliability, and performance of all production systems
  • Participate in code reviews, architectural discussions, and technical strategy planning
What we offer
What we offer
  • Competitive Compensation - we offer attractive salary packages including LTIP (Long Term Incentive Plan)
  • Flexibility - we offer flexible working time models and the option of hybrid work, and support this with a yearly flex work allowance of €1560
  • Recharge - with 31 vacation days annually (incl. one floating holiday), plus pro rata fully paid Fridays off during August
  • Wellbeing - Monthly Wellbeing Allowance €35, from fitness to mental health, hobbies to relaxation
  • Support - we’re offering a company pension scheme
  • Volunteers Day - you’ll get one day off per year for supporting a social project
Read More
Arrow Right