CrawlJobs Logo

Senior LLM Backend Engineer

Spain · Job Posted December 06, 2025
Apply Position
Job Link Share

Job Description

We are looking for a Senior Backend Engineer with a strong focus on Large Language Models (LLMs) to join one of our product squads. You’ll be responsible for designing, implementing, and optimising LLM-powered features, working closely with product managers, designers, and engineers to bring AI capabilities directly into our products. You’ll own the full lifecycle of LLM integration, from experimentation and prototyping, to production deployment, to ongoing optimisation. You’ll also help shape our AI architecture, ensuring that LLM features are scalable, efficient, and cost-effective. Our backend is written in Python, and you’ll use it alongside AI integration tools, APIs, and frameworks to create innovative features in areas such as personalisation, conversational interfaces, AI-assisted analytics, and automated decision-making.

Job Responsibility

  • Work with product managers to understand user needs and translate them into AI-powered functionality
  • Design and build APIs, services, and workflows that integrate LLMs (both proprietary and open-source)
  • Implement prompt engineering, RAG pipelines, and model fine-tuning where required
  • Optimise AI inference performance, scalability, and cost-effectiveness
  • Ensure AI features meet high standards for security, reliability, and maintainability
  • Collaborate with other engineers to integrate AI features seamlessly into the wider system
  • Stay on top of emerging LLM technologies and best practices, running experiments and sharing knowledge across the team

Requirements

  • Extensive production experience with Python in backend engineering
  • Proven experience integrating LLMs into applications via APIs or SDKs
  • Strong experience building and maintaining APIs for LLM-based features
  • Strong experience building and maintaining event-driven workflows
  • Strong experience building and maintaining business logic that consumes AI outputs
  • Strong experience building and maintaining integrations with 3rd party AI/ML platforms
  • Solid SQL and NoSQL experience (especially in AI data pipelines)
  • Production experience with Docker, ideally with Kubernetes or AWS Fargate/ECS/EKS
  • Experience deploying and maintaining AI services in cloud environments
  • Strong organisational skills and ability to deliver in a fast-paced, product-focused environment

Nice to have

  • Familiarity with LangChain, LlamaIndex, or similar LLM orchestration frameworks
  • Experience with vector databases (e.g. Pinecone, Weaviate, FAISS, Elasticsearch)
  • Knowledge of prompt engineering and evaluation techniques
  • Knowledge of and experience with agentic workflows and MCP
  • Familiarity with cloud monitoring tools (e.g. Datadog) for AI systems
  • Interest in using AI to enhance developer productivity and product innovation

What we offer

  • Fully remote working
  • Personal annual L&D Budgets with 600€ to spend on your development
  • Being at the forefront of an industry with new and exciting problems to solve

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior LLM Backend Engineer

8 matching positions

Senior Backend Engineer, Applied AI

Our mission is to accelerate healthcare transformation through our AI-powered pl...
Location
Location
United States
Salary
Salary:
Not provided
Clarium
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Demonstrated experience in building and deploying AI applications
  • Understanding of backend architecture principles and AI application design best practices
  • Experience working with RESTful APIs and integrating third-party services
  • Strong understanding of database technologies
  • Self-motivated with excellent problem-solving and communication skills
Job Responsibility
Job Responsibility
  • Architect and develop robust backend systems to integrate with proprietary LLM APIs
  • Take ownership of critical system components, from backend APIs to AI agent implementation
  • Design and develop scalable back-end services using Python and FastAPI
  • Collaborate with internal product managers and customers to align product development with real-world needs
What we offer
What we offer
  • Incentive Stock Options proportionate to salary
  • Fully remote work
  • Unlimited PTO
  • Top-tier health, vision, and dental benefits
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer

This is a high-impact, deeply technical individual contributor role where you’ll...
Location
Location
Salary
Salary:
Not provided
Catio
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in backend engineering at top-tier startups or technology companies
  • Proven track record of building scalable, production-grade systems, ideally in 0→1 product environments
  • Expertise in modern backend languages and frameworks (Go, Python preferred)
  • Deep knowledge of distributed systems and microservices architectures, with practical familiarity in observability and DevOps tooling
  • A systems-thinking mindset and a passion for solving architecture and infrastructure challenges—especially for the cloud-native space
  • Strong aptitude for performance tuning, debugging, and technical architecture design
  • Demonstrated ability to leverage AI-assisted development (e.g. Cursor, ChatGPT, Claude Code)
  • A high-trust personality with a growth mindset—able to collaborate across teams, share context, and own outcomes
  • Academic strength in Computer Science or related field
  • graduate-level education is a plus
Job Responsibility
Job Responsibility
  • Build scalable backend systems powering our observability, architecture modeling, and recommendation engines—leveraging data pipelines, microservices, and system modeling techniques
  • Integrate AI/ML workflows by collaborating with AI engineers to embed LLM-based and multi-agent architecture intelligence within the platform, enabling rich architecture recommendations and generative planning
  • Contribute to core architecture capabilities: Help identify key architectural patterns and best practices, build backend services that reflect architecture decisions and evolution, and ensure Catio provides actionable visibility for our users
  • Optimize performance and maintainability: Implement monitoring, fault-tolerant workflows, and observability layers for mission-critical services
  • Collaborate cross-functionally: Work with product managers, AI researchers, and technical leadership to translate requirements into robust platform capabilities
  • Learn and inform: Contribute to a high-performing engineering culture by sharing learnings and taking initiative to inform other team members where relevant
What we offer
What we offer
  • top-tier compensation for startups at our stage
  • highly competitive salaries
  • significant equity in a rapidly growing, VC-backed company
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer (AI Applications)

Plaud is building the world's most trusted AI work companion for professionals t...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
plaud.ai Logo
Plaud
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3 years of software engineering experience in AI, backend systems, or related fields
  • Strong programming fundamentals in languages such as Python, Go, or similar
  • Practical understanding of LLM applications and integrating model-based workflows into products
  • Ability to design, implement, and maintain large-scale, production-grade systems
Job Responsibility
Job Responsibility
  • Design and build AI Agent application systems that power intelligent user experiences
  • Develop and optimize retrieval systems that integrate deeply with Agent reasoning and workflows
  • Collaborate with product and cross-functional teams to deliver end-to-end AI application features
  • Continuously iterate on Agent capabilities, improving reliability, adaptability, and performance
  • Explore and prototype new forms of AI intelligence to push the boundaries of product experience
What we offer
What we offer
  • Define the next-gen paradigm for human-AI interaction
  • Gain exposure to cutting-edge AI for Pro tools and play a direct role in our global expansion
  • Work with passionate teammates who value innovation, collaboration, and customer success
  • Grow your career in a culture that champions continuous learning and fast career development
  • Market-competitive compensation, global exposure, and a vibrant, creativity-fueled work atmosphere
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer

Zapier is hiring a Senior Backend Engineer to help design and scale the systems ...
Location
Location
United States
Salary
Salary:
174200.00 - 261200.00 USD / Year
zapier.com Logo
Zapier
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience designing, developing and maintaining complex production systems
  • Comfortable writing backend services (Python or Node.js ideal)
  • Experience with API design, database modeling, or CI/CD pipelines
  • Understanding and leveraging AI tooling (e.g., GitHub Copilot, Cursor)
  • Experience with or implemented components like model context protocol or agent frameworks
  • Platform thinking with focus on extensibility, documentation, and robust foundations
  • Customer empathy and curiosity
  • Bias toward action
  • Ownership mindset
  • Self-starter comfortable with ambiguity
Job Responsibility
Job Responsibility
  • Design, implement, and evolve core APIs that enable agents to take meaningful actions across Zapier’s integration ecosystem
  • Build systems that support scalable orchestration, robust logging, and high-availability execution
  • Influence and collaborate on the core performance for MCP focusing on memory, context windows, token usage, and reasoning steps
  • Integrate with Zapier’s existing execution infrastructure and help build the interfaces between LLM clients and Zapier
  • Partner closely with Product, Design, Platform, and Sales teams to ensure the protocol serves both external and internal needs
  • Drive design decisions that prioritize scalability, performance, security, and clarity for developers and AI systems alike
What we offer
What we offer
  • Offers Equity
  • Offers Bonus
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer - Employee AI

Join our dedicated, fast-paced experimentation and innovation unit, where you'll...
Location
Location
Germany , Dresden
Salary
Salary:
Not provided
staffbase.com Logo
Staffbase
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional experience in backend software development
  • Strong proficiency in Golang and preferably Java/Kotlin
  • Proven experience integrating various AI/ML models into production backend systems
  • Practical experience with prompt engineering
  • Experience with cloud platforms (AWS, GCP, or Azure) and containerization technologies (Docker, Kubernetes)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable and fault-tolerant backend services that power our AI applications
  • Apply advanced prompt engineering techniques to optimize model performance, manage context windows, and ensure reliable, high-quality responses
  • Implement model integration patterns to connect and orchestrate various external and internal services
  • Develop Agent-to-Agent (A2A) protocol communication strategies for complex multi-agent architectures
  • Implement systems for Managing Conversational Protocols (MCP servers) and Agent-to-Agent (A2A) protocol to handle and maintain long-running, stateful interactions
  • Define and implement observability standards for AI applications, including metrics for latency, cost, token usage, drift, and user-perceived quality
  • Implement logging, tracing, and monitoring tools to quickly diagnose and troubleshoot issues in the end-to-end AI pipeline
  • Collaborate with ML Scientists and Data Scientists to transition prototypes and models into production-ready, high-availability services
  • Ensure the security, reliability, and performance of all production systems
  • Participate in code reviews, architectural discussions, and technical strategy planning
What we offer
What we offer
  • Competitive Compensation - we offer attractive salary packages including LTIP (Long Term Incentive Plan)
  • Flexibility - we offer flexible working time models and the option of hybrid work, and support this with a yearly flex work allowance of €1560
  • Recharge - with 31 vacation days annually (incl. one floating holiday), plus pro rata fully paid Fridays off during August
  • Wellbeing - Monthly Wellbeing Allowance €35, from fitness to mental health, hobbies to relaxation
  • Support - we’re offering a company pension scheme
  • Volunteers Day - you’ll get one day off per year for supporting a social project
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer - Employee AI

Join our dedicated, fast-paced experimentation and innovation unit, where you'll...
Location
Location
Germany , Leipzig
Salary
Salary:
Not provided
staffbase.com Logo
Staffbase
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional experience in backend software development
  • Strong proficiency in Golang and preferably Java/Kotlin
  • Proven experience integrating various AI/ML models into production backend systems
  • Practical experience with prompt engineering
  • Experience with cloud platforms (AWS, GCP, or Azure) and containerization technologies (Docker, Kubernetes)
  • Experience building backend systems designed for complex agentic workflows or long-running conversational states
  • Familiarity with foundational LLM concepts such as retrieval-augmented generation (RAG)
  • Practical experience developing or managing MCP servers (Managing Conversational Protocols)
  • Familiarity with Agent-to-Agent (A2A) communication protocols and multi-agent system design
  • Experience with event-driven architecture and message queues (e.g. Kafka)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable and fault-tolerant backend services that power our AI applications
  • Apply advanced prompt engineering techniques to optimize model performance, manage context windows, and ensure reliable, high-quality responses
  • Implement model integration patterns to connect and orchestrate various external and internal services
  • Develop Agent-to-Agent (A2A) protocol communication strategies for complex multi-agent architectures
  • Implement systems for Managing Conversational Protocols (MCP servers) and Agent-to-Agent (A2A) protocol to handle and maintain long-running, stateful interactions
  • Define and implement observability standards for AI applications, including metrics for latency, cost, token usage, drift, and user-perceived quality
  • Implement logging, tracing, and monitoring tools to quickly diagnose and troubleshoot issues in the end-to-end AI pipeline
  • Collaborate with ML Scientists and Data Scientists to transition prototypes and models into production-ready, high-availability services
  • Ensure the security, reliability, and performance of all production systems
  • Participate in code reviews, architectural discussions, and technical strategy planning
What we offer
What we offer
  • Competitive Compensation - we offer attractive salary packages including LTIP (Long Term Incentive Plan)
  • Flexibility - we offer flexible working time models and the option of hybrid work, and support this with a yearly flex work allowance of €1560
  • Recharge - with 31 vacation days annually (incl. one floating holiday), plus pro rata fully paid Fridays off during August
  • Wellbeing - Monthly Wellbeing Allowance €35, from fitness to mental health, hobbies to relaxation
  • Support - we’re offering a company pension scheme
  • Volunteers Day - you’ll get one day off per year for supporting a social project
Read More
Arrow Right

Senior Backend Engineer, AI Integrations

As a Senior Backend Engineer on our AI Team, you’ll focus on integrating AI serv...
Location
Location
Austria , Vienna
Salary
Salary:
Not provided
hostaway.com Logo
Hostaway
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years in backend engineering, ideally SaaS
  • Strong TypeScript/Node.js or Python proficiency
  • Experience with REST APIs and SaaS integrations
  • Familiarity with LLM/AI tools in the JS or Python ecosystem (LangChain, Vercel AI SDK, MCP servers)
  • Comfortable working alongside Python-based AI services and bridging stacks
  • Bonus: experience with PHP + Golang - our core backend
  • Strong collaboration skills - able to integrate work with platform and product teams
Job Responsibility
Job Responsibility
  • Design and build services that integrate AI into customer-facing features
  • Develop performant and scalable APIs and backend services that connect AI outputs to SaaS functionality
  • Collaborate with product and design teams to create intuitive AI-driven user experiences
  • Partner with platform and integration teams to embed AI into existing systems and workflows
  • Implement observability, monitoring, and error handling for AI services in production
  • Contribute to evolving our AI integration stack (TypeScript SDKs, MCP servers, LLM orchestration)
What we offer
What we offer
  • Competitive Compensation: We offer competitive pay based on market rates in the country of the applicant
  • 100% Remote: Enjoy the freedom to work from anywhere within your country of residence
  • Equity: Every role in our company comes with valuable stock options in a fast-growing and profitable company
  • Values-Driven Leadership: Our Core Values are not just words we’ve written to make us feel good
  • Professional Growth: Our rapid growth offers unparalleled learning and development opportunities, along with a multitude of career advancement opportunities
  • Annual Paid Leave: The specific amounts vary by country and are aligned with country and/or contract-specific norms
  • Geographic Specific Benefits: As an international employer, we offer different country-specific benefits such as Health Insurance and Pensions in countries where these perks are customary
  • Dynamic Team Culture: As a global company with team members in over 40 countries, our diverse and international culture fuels our innovation and creativity
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer - Employee AI

Join our dedicated, fast-paced experimentation and innovation unit, where you'll...
Location
Location
Germany , Dresden
Salary
Salary:
Not provided
staffbase.com Logo
Staffbase
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional experience in backend software development
  • Strong proficiency in Golang and preferably Java/Kotlin
  • Experience with cloud platforms (AWS, GCP, or Azure) and containerization technologies (Docker, Kubernetes)
  • Experience building backend systems designed for complex agentic workflows or long-running conversational states
  • Familiarity with foundational LLM concepts such as retrieval-augmented generation (RAG)
  • Practical experience developing or managing MCP servers (Managing Conversational Protocols)
  • Familiarity with Agent-to-Agent (A2A) communication protocols and multi-agent system design
  • Experience with event-driven architecture and message queues (e.g. Kafka)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable and fault-tolerant backend services that power our AI applications
  • Apply advanced prompt engineering techniques to optimize model performance, manage context windows, and ensure reliable, high-quality responses
  • Implement model integration patterns to connect and orchestrate various external and internal services
  • Develop Agent-to-Agent (A2A) protocol communication strategies for complex multi-agent architectures
  • Implement systems for Managing Conversational Protocols (MCP servers) and Agent-to-Agent (A2A) protocol to handle and maintain long-running, stateful interactions
  • Define and implement observability standards for AI applications, including metrics for latency, cost, token usage, drift, and user-perceived quality
  • Implement logging, tracing, and monitoring tools to quickly diagnose and troubleshoot issues in the end-to-end AI pipeline
  • Collaborate with ML Scientists and Data Scientists to transition prototypes and models into production-ready, high-availability services
  • Ensure the security, reliability, and performance of all production systems
  • Participate in code reviews, architectural discussions, and technical strategy planning
What we offer
What we offer
  • Competitive Compensation - we offer attractive salary packages including LTIP (Long Term Incentive Plan)
  • Flexibility - we offer flexible working time models and the option of hybrid work, and support this with a yearly flex work allowance of €1560
  • Recharge - with 31 vacation days annually (incl. one floating holiday), plus pro rata fully paid Fridays off during August
  • Wellbeing - Monthly Wellbeing Allowance €35, from fitness to mental health, hobbies to relaxation
  • Support - we’re offering a company pension scheme
  • Volunteers Day - you’ll get one day off per year for supporting a social project
  • Fulltime
Read More
Arrow Right