CrawlJobs Logo
Devire Logo Devire · IT - Software Development

GenAI and LLM Operations Engineer

Poland, Warszawa · Job Posted April 23, 2026
Apply Position
Job Link Share

Job Description

Join a team building next-generation AI solutions and applying them to real business processes. We’re looking for an experienced Software or Data Engineer who wants to grow in the space of Generative AI and LLM-based systems — from a practical, production, and engineering perspective. This role is ideal for someone who understands systems, data, and infrastructure — and is excited to apply those skills to modern AI solutions. You’ll be part of a global team (Europe + US) working on solutions within Crop Science (agriculture innovation). The role is based in Europe, with standard working hours aligned to the local time zone. You will design and build solutions that: leverage LLMs and agent-based systems to automate complex workflows; support the software development lifecycle (SDLC) using AI; enable conversational access to data and insights; integrate AI capabilities into existing engineering and data ecosystems.

Job Responsibility

  • Design and develop LLM-powered and multi-agent solutions
  • Build workflows where AI supports tasks such as requirements analysis, task creation, and code generation
  • Integrate AI solutions with engineering tools (e.g. code repositories, CI/CD pipelines)
  • Develop scalable, reliable system components
  • Build natural language interfaces for querying complex data
  • Combine structured and unstructured data sources
  • Ensure accuracy, explainability, and control in AI-driven outputs

Requirements

  • Strong Python skills and experience building production systems
  • Experience with data pipelines
  • Experience with relational and/or NoSQL databases
  • Experience with APIs and system integrations
  • Hands-on experience with CI/CD and version control (e.g. GitHub)
  • Hands-on experience with cloud platforms (AWS, Azure, or GCP)
  • Understanding of production systems (monitoring, debugging, reliability)
  • Interest in Generative AI and LLMs
  • Initial hands-on experience (projects, experiments, or courses)
  • Basic understanding of prompt engineering
  • Basic understanding of RAG / semantic search
  • Basic understanding of LLM capabilities and limitations
  • Self-starters who can work independently and take ownership
  • Engineers who learn quickly and adapt to new technologies
  • People who value iteration and delivery over perfection
  • Candidates comfortable working across engineering, data, and business domains

Nice to have

  • Background in data engineering or data platforms
  • Experience with tools like Airflow, dbt, Spark, Snowflake, etc.
  • Exposure to AI/ML or LLM-based applications
  • Experience in large organizations or regulated environments

What we offer

  • Hands-on experience building production-grade AI/LLM systems
  • Opportunity to work on real business use cases (not just prototypes)
  • Collaboration with international teams
  • Influence on how AI solutions are designed and scaled within the organization
  • Space to experiment and grow in a rapidly evolving field
Devire - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

GenAI and LLM Operations Engineer

8 matching positions

Senior Software Engineer - GenAI, LLM

Join the Engineering team working on an Autonomous marketing solution to help sh...
Location
Location
Czechia
Salary
Salary:
Not provided
bloomreach.com Logo
Bloomreach
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A holistic engineering mindset oriented toward product excellence and impact
  • Hands-on expertise in building, testing, and shipping GenAI/LLM-based agentic systems
  • Practical proficiency across software engineering, applied LLM development, and DevOps practices, ensuring real-world reliability—not just theoretical capability
  • Comfort with fast-paced, iterative development and a user-validated, visionary approach to technology and business outcomes
  • Hands-on experience designing, evaluating, and maintaining production-grade AI agentic systems—with a proven record of applying GenAI, LLMs, and agent orchestration in real-world scenarios
  • Proven proficiency in Python engineering and modern backend development—including data processing, API development, and creation of robust microservice architectures. Experience with prompt engineering and context/memory design for LLM-powered systems is highly valued
  • Operational knowledge across the full stack: solid grasp of software engineering principles, LLM/GenAI application development, cloud operations (especially in GCP environments), CI/CD, and DevOps practices. You know how to build, deploy, monitor, and scale complex agentic systems in production
  • Expertise in evaluation methodologies: you develop comprehensive test suites and system-level benchmarks, ensuring the functional and behavioral quality of autonomous agents and their integration into broader business workflows
  • Experience collaborating with product managers, data scientists, and UX/UI engineers to align technical solutions tightly with business goals and user needs—demonstrating a track record of delivering features that ship, iterate, and create value for customers
  • Strong initiative, ownership, and an agile problem-solving approach: you thrive in fast-paced, iterative environments, embrace feedback from early adopters, and adapt solutions quickly
Job Responsibility
Job Responsibility
  • Design and deliver meaningful, production-grade features end-to-end, always anchored in clear user needs and measurable business value. You’ll translate high-level vision and customer requirements into actionable plans, robust code, and scalable solutions
  • Define technical specifications directly from business goals and work collaboratively with product managers, engineers, QAs, and data scientists to ensure that every build solves a concrete problem for users
  • Build and ship APIs and backend components that drive agentic workflows and seamless AI-powered automation—ensuring performance, security, and maintainability at scale
  • Integrate and operationalize state-of-the-art GenAI, LLMs, and orchestration frameworks so your agents take real business actions in production environments, not just in proofs-of-concept
  • Take full accountability for the robustness of your solutions: developing comprehensive test suites, rigorous evaluation frameworks (including agent- and system-level benchmarking), and monitoring strategies to ensure reliability and measurable outcomes. You'll evaluate both automated agentic behaviors and overall system performance to guarantee these systems perform as intended in live scenarios
  • Apply your full stack of skills—ranging from software engineering and prompt/context design to real-world LLM/GenAI operations and DevOps best practices. You’ll make agentic systems functional, maintainable, and resilient from dev environments through to production and post-launch
  • Embrace and drive an iterative, agile development process: push early integrations, prototype quickly, validate solutions with internal customers and early adopters, solve problems collaboratively as they arise, and continually refine your work based on real feedback. You will balance near-term impact with a bold, forward-thinking product vision that anticipates the needs of tomorrow’s marketers
  • Support, maintain, and evolve your components post-launch, responding to customer needs, monitoring real-world performance, and delivering ongoing improvements in response to user and business insight
  • Document your systems and learnings to enable efficient collaboration within the team and fast, informed future iteration
What we offer
What we offer
  • A great deal of freedom and trust
  • Flexible working hours
  • Work virtual-first with several Bloomreach Hubs available across three continents
  • Company events
  • 5 paid days off to volunteer
  • People Development Program
  • Communication coach
  • Leader Development Program
  • $1,500 professional education budget
  • Employee Assistance Program
Read More
Arrow Right

Senior Software Engineer - GenAI, LLM

Join the Engineering team working on an Autonomous marketing solution to help sh...
Location
Location
Slovakia
Salary
Salary:
3700.00 EUR / Month
bloomreach.com Logo
Bloomreach
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A holistic engineering mindset oriented toward product excellence and impact
  • Hands-on expertise in building, testing, and shipping GenAI/LLM-based agentic systems
  • Practical proficiency across software engineering, applied LLM development, and DevOps practices, ensuring real-world reliability—not just theoretical capability
  • Comfort with fast-paced, iterative development and a user-validated, visionary approach to technology and business outcomes
  • Hands-on experience designing, evaluating, and maintaining production-grade AI agentic systems—with a proven record of applying GenAI, LLMs, and agent orchestration in real-world scenarios
  • Proven proficiency in Python engineering and modern backend development—including data processing, API development, and creation of robust microservice architectures
  • Experience with prompt engineering and context/memory design for LLM-powered systems is highly valued
  • Operational knowledge across the full stack: solid grasp of software engineering principles, LLM/GenAI application development, cloud operations (especially in GCP environments), CI/CD, and DevOps practices
  • Expertise in evaluation methodologies: you develop comprehensive test suites and system-level benchmarks, ensuring the functional and behavioral quality of autonomous agents and their integration into broader business workflows
  • Experience collaborating with product managers, data scientists, and UX/UI engineers to align technical solutions tightly with business goals and user needs—demonstrating a track record of delivering features that ship, iterate, and create value for customers
Job Responsibility
Job Responsibility
  • Design and deliver meaningful, production-grade features end-to-end
  • Define technical specifications directly from business goals
  • Build and ship APIs and backend components that drive agentic workflows and seamless AI-powered automation
  • Integrate and operationalize state-of-the-art GenAI, LLMs, and orchestration frameworks
  • Take full accountability for the robustness of your solutions: developing comprehensive test suites, rigorous evaluation frameworks, and monitoring strategies
  • Apply your full stack of skills—ranging from software engineering and prompt/context design to real-world LLM/GenAI operations and DevOps best practices
  • Embrace and drive an iterative, agile development process
  • Support, maintain, and evolve your components post-launch
  • Document your systems and learnings to enable efficient collaboration within the team
What we offer
What we offer
  • Stock options
  • Comprehensive benefits package
  • $1,500 professional education budget on an annual basis
  • Employee referral bonus of up to $3,000
  • Company performance bonus
  • Restricted Stock Units or Stock Options
  • Flexible working hours
  • Virtual-first work with several Bloomreach Hubs available across three continents
  • Company events
  • 5 paid days off to volunteer
  • Fulltime
Read More
Arrow Right

Senior GenAI Engineer

Hands‑on GenAI Engineer working on canonical LLM APIs—designing OpenAI‑compatibl...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • AI Gateways like KONG, Portkey, SSE/streaming, quota/rate limits
  • OpenAI‑compatible schemas
  • OpenAPI
  • versioning/deprecation
  • OAuth2 (client & user‑context), mTLS, token binding
  • LangGraph/ADK
  • Trace propagation
  • Python, Java, devin/github copilot
Job Responsibility
Job Responsibility
  • Design and maintain canonical LLM APIs (OpenAI‑compatible chat/generate, search, ingest, embeddings, responses, interactions) with multi‑model backends, consistent across on‑prem and cloud
  • Operate Gateway for LLM traffic (SSE/streaming), set TPS and payload SLOs, and coordinate capacity allocations with enterprise gateway owners
  • Implement authN/Z patterns: OAuth2 client credentials and user‑context flows
  • enforce mTLS and device/tls‑bound tokens to eliminate key sharing
  • Define versioning & deprecation policy
  • publish change notices and maintain compatibility matrices for SDKs and proxies
  • Build developer onboarding paths
  • Integrate Open telemetry (tracing/evals) into gateway and APIs
  • propagate correlation IDs and tags for spaces/projects
  • Evolve SDKs to standardize auth, observability, signal endpoints, and registry updates for LangGraph/ADK
Read More
Arrow Right

Senior GenAI Engineer

Hands‑on GenAI Engineer working on canonical LLM APIs—designing OpenAI‑compatibl...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • AI Gateways like KONG , Portkey, SSE/streaming, quota/rate limits
  • OpenAI‑compatible schemas
  • OpenAPI
  • versioning/deprecation
  • OAuth2 (client & user‑context), mTLS, token binding
  • LangGraph/ADK
  • Trace propagation
  • Python, Java, devin/github copilot
Job Responsibility
Job Responsibility
  • Design and maintain canonical LLM APIs (OpenAI‑compatible chat/generate, search, ingest, embeddings, responses, interactions) with multi‑model backends, consistent across on‑prem and cloud
  • Operate Gateway for LLM traffic (SSE/streaming), set TPS and payload SLOs, and coordinate capacity allocations with enterprise gateway owners
  • Implement authN/Z patterns: OAuth2 client credentials and user‑context flows
  • enforce mTLS and device/tls‑bound tokens to eliminate key sharing
  • Define versioning & deprecation policy
  • publish change notices and maintain compatibility matrices for SDKs and proxies
  • Build developer onboarding paths
  • Integrate Open telemetry (tracing/evals) into gateway and APIs
  • propagate correlation IDs and tags for spaces/projects
  • Evolve SDKs to standardize auth, observability, signal endpoints, and registry updates for LangGraph/ADK
Read More
Arrow Right

Senior GenAI Engineer

We are currently seeking a Senior GenAI Engineer to join our team in Bangalore, ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • AI Gateways like KONG, Portkey, SSE/streaming, quota/rate limits
  • OpenAI‑compatible schemas
  • OpenAPI
  • versioning/deprecation
  • OAuth2 (client & user‑context), mTLS, token binding
  • LangGraph/ADK
  • Trace propagation
  • Python, Java, devin/github copilot
Job Responsibility
Job Responsibility
  • Design and maintain canonical LLM APIs (OpenAI‑compatible chat/generate, search, ingest, embeddings, responses, interactions) with multi‑model backends, consistent across on‑prem and cloud
  • Operate Gateway for LLM traffic (SSE/streaming), set TPS and payload SLOs, and coordinate capacity allocations with enterprise gateway owners
  • Implement authN/Z patterns: OAuth2 client credentials and user‑context flows
  • enforce mTLS and device/tls‑bound tokens to eliminate key sharing
  • Define versioning & deprecation policy
  • publish change notices and maintain compatibility matrices for SDKs and proxies
  • Build developer onboarding paths
  • Integrate Open telemetry (tracing/evals) into gateway and APIs
  • propagate correlation IDs and tags for spaces/projects
  • Evolve SDKs to standardize auth, observability, signal endpoints, and registry updates for LangGraph/ADK
Read More
Arrow Right

Python API AWS Engineer GenAI

We are seeking an experienced and highly skilled Python API AWS Engineer GenAI t...
Location
Location
India , Noida
Salary
Salary:
Not provided
techmahindra.com Logo
Tech Mahindra
Expiration Date
June 09, 2026
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience)
  • 4 6 years of experience in cloud engineering, with a strong focus on AWS
  • Strong hands on experience with Python, AWS APIs, and backend service development
  • Strong hands on experience delivering GenAI/LLM solutions in production, with focus on AWS Bedrock
  • Strong knowledge of database systems, particularly DynamoDB and cloud data design patterns
  • Hands on experience in AWS services used by this platform (Lambda, Step Functions, S3, SQS, DynamoDB, Bedrock, Secrets Manager, CloudWatch)
  • Proven expertise in prompt engineering, LLM output validation, and reliability patterns (retries, guardrails, fallback handling)
  • Strong understanding of event driven and asynchronous architectures, including idempotency, retries, and queue based decoupling
  • Proven experience with REST API integrations in enterprise environments (Bitbucket/Jenkins like integrations preferred)
  • Excellent problem solving and analytical skills
Job Responsibility
Job Responsibility
  • Design and implement complex cloud based solutions using AWS services (Lambda, S3, SQS FIFO, Step Functions, DynamoDB, Bedrock, Secrets Manager, SNS, CloudWatch, SageMaker)
  • Build and maintain secure API and integration workflows for Jenkins, Bitbucket Server REST APIs, and internal operational tooling
  • Write, test, and maintain high quality Python code for cloud native and serverless applications
  • Design and optimize data models and access patterns, particularly for DynamoDB and S3 job artifact/state flows
  • Collaborate with cross functional teams (Product, DevOps, Security, platform teams) to deliver architecture aligned solutions
  • Ensure security, compliance, and best practices in cloud infrastructure (OAuth2, IAM least privilege, secrets management, TLS)
  • Troubleshoot and resolve complex technical issues in distributed cloud environments (async job orchestration, retries, failure handling, network integration)
  • Mentor junior engineers and contribute to engineering standards, design reviews, and team technical growth
  • Stay up to date with AWS GenAI, serverless architecture, and enterprise integration best practices
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - GenAI

Shape the future of AI-powered search and help billions of users find answers in...
Location
Location
United States , Mountain View
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C#, JavaScript and TypeScript
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C#, JavaScript and TypeScript
  • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C#, JavaScript and TypeScript
  • OR equivalent experience
  • 2+ years of experience with C# and .NET development for high-performance, scalable backend services
  • 2+ years of experience with distributed systems, microservices architecture, or cloud-native development at scale
  • 2+ years of experience with AI/ML systems, large language models, or prompt engineering in production environments
Job Responsibility
Job Responsibility
  • Provides technical leadership related to building large language model-driven Generative Search projects, and prototype, develop and ship these projects
  • Partners with stakeholders to determine user requirements for a set of scenarios
  • Leads identification of dependencies and the development of design documents for a product, application, service, or platform
  • Leads by example and mentors others to produce extensible and maintainable code used across products
  • Holds accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions
  • Proactively seeks new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and shares knowledge with other engineers
  • Fulltime
Read More
Arrow Right

GenAI Prompt Security Engineer

This role sits within the newly formed GenAI Security team, which is responsible...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Highly motivated self-starter with excellent interpersonal and problem-solving skills
  • Bachelor’s degree or equivalent work experience
  • Good oral and written communication skills
  • Significant relevant industry work experience
  • Experience of the full lifecycle of design, implementation and running of enterprise software solutions involving cross functional team collaboration
  • Expertise in a major programming language such as Python and/or Go, and associated tooling (Git, Maven, IDEs, Jenkins, Bitbucket etc)
  • Expertise in designing and implementing secure APIs and libraries
  • Experience in Generative AI, LLM frameworks, LLM prompt engineering and/or adversarial testing is a bonus
  • Experience with Cyber engineering and Operations, which could include DevSecOps or MLSecOps
  • Experience contributing to the architecture and design (architecture, design patterns, reliability, scaling) of new and current systems
Job Responsibility
Job Responsibility
  • Designing, developing, optimizing, and enhancing a GenAI prompt security platform to protect firm AI/LLM-based applications from adversarial attacks and prompt injections
  • Building and automating a security testing framework to validate protection mechanisms for various LLM use cases
  • Owning solutions that are expected to operate and perform at scale across the organisation
  • Collaboration with multiple stakeholders and partners across Engineering and Operations as well as partner teams within the wider Citi organisation, across different time zones
  • Fulltime
Read More
Arrow Right