CrawlJobs Logo

Senior AI Backend Engineer

khealth.com Logo

K Health

Location Icon

Location:
Israel , Tel-Aviv

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

As a core member of our AI Engineering team, you will collaborate with data scientists, ML engineers, and product managers to build scalable, production-ready infrastructure and APIs that power intelligent systems.

Job Responsibility:

  • Build and maintain reliable, scalable backend services to support AI agent execution and orchestration
  • Develop AI agent systems for complex operational workflows using LangChain, LangGraph, LiteLLM, and Langfuse
  • Orchestrate a hybrid model stack that includes OpenAI and Google Gemini alongside self-hosted and fine-tuned LLMs like Gemma and Llama
  • Build and maintain integrations with clinical systems (FHIR, EMR)
  • Drive observability and reliability using OpenTelemetry, Datadog, and Langfuse
  • Design APIs (GraphQL, REST), background workers, and event-driven systems that interface with AI inference engines and agent runtimes
  • Collaborate with Data Science, ML, and engineering teams to deploy AI features and improve the performance, scalability, and reliability of backend systems
  • Participate in code reviews, knowledge sharing, and mentoring to elevate the team’s technical capabilities

Requirements:

  • 6+ years of backend engineering experience
  • Strong proficiency in more than one major programming language (such as Python, Java, Go, Rust, or Kotlin)
  • Solid understanding of AI systems architecture and experience working in environments involving AI agents, LLMs, or inference pipelines
  • Proven experience in building and scaling backend APIs, microservices, and background jobs
  • Strong experience with relational and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB, Redis), including schema design, data modeling, and query optimization
  • Experience with message brokers and distributed systems (e.g., Pub/Sub, Redis Streams, RabbitMQ)
  • Highly adaptable, a strong team player, with the ability to quickly learn and apply new technologies

Nice to have:

  • Strong proficiency in Python and/or Node.js/NestJS
  • Experience with clinical systems and healthcare data standards (FHIR, EMR/EHR)
  • Hands-on experience with AI agent frameworks such as LangChain, LangGraph, or LiteLLM
  • Experience orchestrating hybrid model stacks combining commercial APIs (OpenAI, Google Gemini) with self-hosted or fine-tuned LLMs
  • Familiarity with observability tools for AI systems (Langfuse, OpenTelemetry)
What we offer:

Competitive compensation packages based on industry benchmarks for function, level, and geographic location

Additional Information:

Job Posted:
February 18, 2026

Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior AI Backend Engineer

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...
Location
Location
India
Salary
Salary:
Not provided
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of software engineering experience with a focus on production systems
  • 1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
  • Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
  • Experience building multi-step AI agents, LLM chaining, and complex workflow automation
  • Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
  • Expert-level Python skills for production AI systems
  • Strong experience building scalable backend systems, APIs, and distributed architectures
  • Experience with LangChain, LlamaIndex, or other LLM application frameworks
  • Proven ability to integrate multiple APIs and services to create advanced AI capabilities
  • Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)
Job Responsibility
Job Responsibility
  • Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
  • Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
  • Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
  • System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
  • Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
  • Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
  • Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions
What we offer
What we offer
  • Invest deeply in your growth, ensuring you have the resources, support, and autonomy to own your role and make a real impact
  • Collaboration is at our core—we’re all for one, meaning you’ll have a team across departments ready to help you succeed
  • We encourage bold ideas and courageous action, giving you the freedom to experiment, take smart risks, and drive big wins
Read More
Arrow Right

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...
Location
Location
Canada; United States
Salary
Salary:
160000.00 - 260000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of software engineering experience with a focus on production systems
  • 1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
  • Production LLM Applications: Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
  • Agent Development: Experience building multi-step AI agents, LLM chaining, and complex workflow automation
  • Prompt Engineering Expertise: Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
  • Python Proficiency: Expert-level Python skills for production AI systems
  • Backend Engineering: Strong experience building scalable backend systems, APIs, and distributed architectures
  • LangChain or Similar Frameworks: Experience with LangChain, LlamaIndex, or other LLM application frameworks
  • API Integration: Proven ability to integrate multiple APIs and services to create advanced AI capabilities
  • Production Deployment: Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)
Job Responsibility
Job Responsibility
  • Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
  • Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
  • Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
  • System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
  • Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
  • Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
  • Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • at least 10 paid holidays per year, flex PTO, and parental leave
  • employee assistance program and wellbeing benefits
  • global travel coverage
  • life/AD&D/STD/LTD insurance
  • FSA/HSA and medical, dental, and vision benefits
  • Fulltime
Read More
Arrow Right

Senior AI Product Engineer, Backend

Our Backend Engineering team builds all of the highly scalable distributed servi...
Location
Location
United States
Salary
Salary:
125000.00 - 225000.00 USD / Year
arize.com Logo
Arize
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience working with high-performance backend systems
  • Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages
  • Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies
  • Previous work building and operating highly complex SaaS platforms/systems
  • Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.
Job Responsibility
Job Responsibility
  • Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript
  • Build high-volume and highly available analytics systems
  • Design and build APIs specific to our customers’ Machine Learning and LLM workflows
  • Prototype, optimize, and maintain scalable backend services that power the Arize core platform
  • Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks
  • Develop and integrate collection tools for robust monitoring of ML and LLM pipelines
  • Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment
  • Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings
  • Contribute to the build our own in-house AI Agents
What we offer
What we offer
  • competitive equity package
  • comprehensive benefits package, including medical, dental, vision
  • a 401(k) plan
  • unlimited paid time off
  • a generous parental leave plan
  • additional support for mental health and wellness
  • WFH monthly stipend to pay for co-working spaces
  • Fulltime
Read More
Arrow Right

Senior LLM Backend Engineer

We are looking for a Senior Backend Engineer with a strong focus on Large Langua...
Location
Location
Spain
Salary
Salary:
Not provided
bark.com Logo
Bark
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive production experience with Python in backend engineering
  • Proven experience integrating LLMs into applications via APIs or SDKs
  • Strong experience building and maintaining APIs for LLM-based features
  • Strong experience building and maintaining event-driven workflows
  • Strong experience building and maintaining business logic that consumes AI outputs
  • Strong experience building and maintaining integrations with 3rd party AI/ML platforms
  • Solid SQL and NoSQL experience (especially in AI data pipelines)
  • Production experience with Docker, ideally with Kubernetes or AWS Fargate/ECS/EKS
  • Experience deploying and maintaining AI services in cloud environments
  • Strong organisational skills and ability to deliver in a fast-paced, product-focused environment
Job Responsibility
Job Responsibility
  • Work with product managers to understand user needs and translate them into AI-powered functionality
  • Design and build APIs, services, and workflows that integrate LLMs (both proprietary and open-source)
  • Implement prompt engineering, RAG pipelines, and model fine-tuning where required
  • Optimise AI inference performance, scalability, and cost-effectiveness
  • Ensure AI features meet high standards for security, reliability, and maintainability
  • Collaborate with other engineers to integrate AI features seamlessly into the wider system
  • Stay on top of emerging LLM technologies and best practices, running experiments and sharing knowledge across the team
What we offer
What we offer
  • Fully remote working
  • Personal annual L&D Budgets with 600€ to spend on your development
  • Being at the forefront of an industry with new and exciting problems to solve
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Backend

As a Senior Software Engineer, Backend specializing in database architecture and...
Location
Location
United States , San Francisco
Salary
Salary:
150000.00 - 240000.00 USD / Year
chefrobotics.ai Logo
Chef Robotics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
  • 7+ years of professional experience in backend development roles with demonstrated leadership experience
  • Expert knowledge of relational databases (MySQL, PostgreSQL) including schema design, optimization, and administration
  • Strong proficiency with Python and JavaScript/TypeScript with advanced software engineering skills
  • Extensive experience leading projects with at least two web frameworks: Flask, FastAPI, Django, Node.js, or Next.js
  • Proven experience designing and implementing RESTful and GraphQL APIs at scale
  • Advanced understanding of containerization (Docker) and orchestration (Kubernetes) technologies
  • Experience with cloud infrastructure and deployment (AWS, GCP, or Azure) in production environments
  • Proven experience leading complex backend projects and mentoring junior engineers
  • Understanding of data requirements for robotics or automation systems
Job Responsibility
Job Responsibility
  • Lead the design, implementation, and optimization of database schemas to support robot operations, telemetry, recipe management, and system analytics
  • Develop robust data migration strategies and version control for database schema evolution
  • Implement efficient query optimization and indexing strategies to support high-throughput robot operations
  • Establish data integrity protocols and backup systems to ensure operational continuity across customer deployments
  • Create scalable data access layers that balance security, performance, and maintainability
  • Mentor team members on database design patterns and optimization techniques
  • Lead the development and maintenance of scalable APIs to serve robot control systems, dashboards, and monitoring tools
  • Design and implement secure authentication and authorization mechanisms across backend services
  • Develop robust middleware for processing and validating data between robotics subsystems
  • Create service interfaces that enable efficient communication between robotics components and cloud services
What we offer
What we offer
  • medical, dental, and vision insurance
  • commuter benefits
  • flexible paid time off (PTO)
  • catered lunch
  • 401(k) matching
  • early-stage equity
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Backend (AI Agent)

At Cresta, the AI Agent team is on a mission to create state-of-the-art AI Agent...
Location
Location
Canada , Toronto
Salary
Salary:
Not provided
cresta.com Logo
Cresta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or a related field
  • 5+ years of experience in backend system architecture, cloud services, or related technology fields
  • Proficient in designing and maintaining clear and robust APIs with a strong understanding of protocols including gRPC, REST
  • Previous experience working with Virtual Agent or AI Agent systems
  • Experience in high-performance database schema design and query optimization, including knowledge of SQL and NoSQL databases
  • Experience in containerized application deployment using Kubernetes and Docker in microservices architectures
  • Experience with cloud environments such as AWS, Azure, or Google Cloud, with a strong understanding of cloud security and compliance standards
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable and robust backend architectures for Cresta’s AI Agent solutions and proprietary models
  • Collaborate with cross-functional teams including frontend engineers, machine learning engineers to ensure seamless integration of AI Agents into Cresta’s customer solutions
  • Lead initiatives to enhance system scalability and reliability in production environments, focusing on backend services that support AI functionalities
  • Drive efforts to optimize server response times, process large volumes of data efficiently, and maintain high system availability
  • Innovate and implement security measures, cost-reduction strategies, and performance improvements in backend systems supporting AI Agents
What we offer
What we offer
  • We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs
  • Paid parental leave to support you and your family
  • Monthly Health & Wellness allowance
  • Work from home office stipend to help you succeed in a remote environment
  • Lunch reimbursement for in-office employees
  • PTO: 3 weeks in Canada
Read More
Arrow Right

Senior Backend Engineer

Fullpath is an AI-first tech company in the automotive space with hubs across th...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
fullpath.com Logo
Fullpath
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • University degree (B.Sc) in Computer Science or related field
  • 5+ years of Backend Software development experience
  • Hands-on experience with web development, including building and maintaining web applications
  • Deep familiarity with and daily hands-on use of AI and emerging technologies
  • Strong SQL skills with databases such as PostgreSQL, MySQL, or similar
  • Knowledge of cloud platforms, preferably AWS, or similar services and tools
  • Experience designing and working with microservices architecture
  • Excellent communication skills in both Hebrew and English
  • Team player with collaborative mindset
  • Capability to see the big picture, break down projects into milestones, and prioritize tasks
Job Responsibility
Job Responsibility
  • Write clean, high-quality, high-performance, maintainable code
  • Ensure that the projects you work on meet business objectives and coding standards
  • Support the deployment and testing of new products and features
  • Collaborate with cross-functional teams to gather and analyze requirements, translating them into technical specifications
  • Design and implement APIs and integrations with third-party services to enhance system functionality
  • Optimize application performance through code profiling, monitoring, and refactoring as necessary
  • Implement automated testing frameworks to ensure code robustness and reliability
  • Participate in code reviews and provide constructive feedback to peers to foster continuous improvement
  • Stay updated with emerging technologies, best practices, and industry trends to drive innovation within the team
  • Assist in the establishment and enforcement of development standards and coding conventions
What we offer
What we offer
  • An awesome global team of forward-thinking, innovative go-getters
  • Integrate with tech titans: Work directly with APIs from Google, Facebook, Microsoft, and more
  • Be part of a rapidly scaling company poised for the future
  • Learning and growth opportunities within a fast-paced SaaS startup environment
  • Clear career advancement path for strong performers
  • Cibus and lots of yummy kitchen treats
  • Fulltime
Read More
Arrow Right

Senior Backend Software Engineer

The Coaching team builds Highspot’s personalized, AI-enhanced coaching capabilit...
Location
Location
Canada , Vancouver
Salary
Salary:
146000.00 - 178000.00 CAD / Year
highspot.com Logo
Highspot
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or equivalent practical experience
  • 5+ years of experience in back-end software development building and maintaining large-scale web applications
  • At least 3 years of experience working with object-oriented programming languages
  • Ruby and Python preferred
  • Experience architecting, building, and deploying mid-to-large scale web applications in a distributed environment
  • Strong understanding of API design, data modeling, and backend scalability
  • Experience integrating or working with AI/LLM platforms such as OpenAI, Anthropic (Claude), or Azure OpenAI
  • Familiarity with AI-powered development tools (e.g., Cursor, GitHub Copilot, Cody, etc.) and a demonstrated ability to incorporate them effectively into day-to-day workflows
  • Deep expertise in web performance, security, and reliability best practices
  • Proven ability to deconstruct complex technical problems and deliver elegant, maintainable solutions
Job Responsibility
Job Responsibility
  • Design, develop, and maintain high-quality, scalable, and user-centric backend systems using modern technologies
  • Architect and optimize backend infrastructure to power intelligent, AI-driven workflows and Agentic AI integrations
  • Build and maintain integrations with multiple large language models (LLMs) including ChatGPT, Claude, and other OpenAI and Microsoft models
  • Collaborate closely with AI/ML engineers to productionize agentic workflows and autonomous reasoning systems
  • Partner effectively with Product Management and UX Design to translate ideas and research into production-ready, AI-enhanced features
  • Leverage AI-assisted development tools such as Cursor, GitHub Copilot, and other code generation frameworks to accelerate development and improve code quality
  • Lead and mentor engineers through complex projects, emphasizing clean architecture, testing, and software craftsmanship
  • Drive backend infrastructure improvements that enhance reliability, observability, and performance
  • Collaborate cross-functionally to deliver differentiated customer value through AI and data-driven solutions
  • Troubleshoot and resolve critical production issues while contributing to internal documentation and best practices
What we offer
What we offer
  • Comprehensive medical, dental, vision, disability, and life benefits
  • Group Retirement Savings Plan (RRSP) and matching employer contributions (DPSP) with immediate vesting
  • Flexible PTO
  • Generous Holiday Schedule + 5 Days for Annual Holiday Week
  • Quarterly Recharge Fridays (paid days off for mental health recharge)
  • Flexible work schedules
  • Access to Coaches and Therapists through Modern Health
  • 2 Volunteer days per year
  • Monthly transportation allowance for employees that work in our Vancouver Hub location
  • Employees are eligible to receive stock options
  • Fulltime
Read More
Arrow Right