CrawlJobs Logo

Senior MLOps / LLMOps Engineer

immoscout24.de Logo

ImmoScout24 GmbH

Location Icon

Location:
Germany , Berlin

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Responsibility:

  • Design and maintain scalable ML/LLM infrastructure and pipelines
  • Productionize traditional ML and generative AI solutions with cross-functional product teams
  • Own the ML/LLMOps lifecycle: prompting, deployment, monitoring, evaluation and optimization
  • Build and evolve an LLM Gateway service to standardize access, routing, and governance
  • Develop evaluation frameworks to measure quality, performance, and reliability of LLM outputs
  • Design and implement MCP-compatible services to enable standardized context exchange between LLMs, tools, and data sources
  • Integrate MCP into internal platforms to support tool use, retrieval, and agent-based workflows across teams
  • Work with AWS and integrate self-hosted open-source AI models for scalable, secure applications
  • Ensure observability, cost efficiency, and system performance
  • Contribute to project management, stakeholder communication and cross-team collaboration

Requirements:

  • Strong experience in MLOps (CI/CD, Docker, Kubernetes) and operating production-grade systems
  • Proficiency in Python and solid software engineering and scalable system design skills
  • Hands-on experience with LLMs and generative AI technologies (e.g. GPT, Gemini or Anthropic-like models)
  • Expertise in prompt engineering, agent orchestration, context management, and output validation
  • Experience with LLM evaluation frameworks and deploying self-hosted LLMs
  • Familiarity with cloud platforms (e.g. AWS, GCP) as well as DevOps, testing, and observability practices
  • Strong communication skills and ability to collaborate with cross-functional teams and stakeholders
What we offer:
  • A competitive salary package and a bonus on top
  • Hybrid work model with three days of on-site work per week in the office
  • 30 days of vacation per year
  • Possibility to work from abroad for 10 days per year
  • Relocation agency support with visa process and attractive relocation package
  • Plus membership for tenants on ImmoScout24
  • Dedicated learning time per month, online courses on ScoutAcademy, regular book challenges, structured feedback, Lunch & Learn events and individual career paths
  • Professional family service for childcare
  • Bring your dog to work (upon approval)
  • Subsidized public transport or Job Bikes
  • Company pension scheme with subsidy
  • Most innovative office in Berlin with gym, napping room, rooftop terrace, organic coffee, cafeteria, 100% green electricity and massage therapist
  • Life Situation Coaching, regular health check ups
  • Latest technical tools and hardware

Additional Information:

Job Posted:
May 14, 2026

Work Type:
Hybrid work
Icon
ImmoScout24 GmbH - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior MLOps / LLMOps Engineer

Senior LLMOps Engineer

Working closely with our Engineering Manager, you’ll be a Senior LLMOps Engineer...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
heidihealth.com Logo
Heidi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven track record of designing, building, and maintaining MLOps or LLMOps infrastructure in a production environment
  • Previous hands-on experience building scalable, cloud-native infrastructure and platforms
  • Deployed and managed large-scale machine learning models in a production environment
  • Expert in Python, cloud platforms (AWS, GCP, or Azure), containerization (Docker, Kubernetes), and Infrastructure as Code (e.g., Terraform, CloudFormation)
  • Deep and practical understanding of the entire machine learning lifecycle and the specific operational challenges of large language models
  • Ability to translate complex engineering and research requirements into concrete, robust, and automated platform solutions
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Lead the architecture, design, and implementation of our end-to-end LLMOps platform, from data ingestion and model training pipelines to production deployment and monitoring
  • Build and maintain robust CI/CD/CT (Continuous Integration/Continuous Delivery/Continuous Training) pipelines to automate the testing, validation, and deployment of large language models
  • Engineer highly available and scalable model serving solutions using modern infrastructure like Kubernetes, ensuring low latency and high throughput for our production services
  • Collaborate closely with AI research and engineering teams to understand their needs, streamline workflows, and create the tooling that accelerates their development cycles
  • Champion and implement best practices for model versioning, experiment tracking, monitoring, and governance across the organization
  • Mentor mid-level and junior engineers, sharing your deep expertise in infrastructure, automation, and operational excellence to foster a culture of reliability and scalability
What we offer
What we offer
  • Flexible hybrid working environment, with 3 days in the office
  • Additional paid day off for your birthday and wellness days
  • Special corporate rates at Anytime Fitness in Melbourne, Sydney tbc
  • A generous personal development budget of $500 per annum
  • Learn from some of the best engineers and creatives, joining a diverse team
  • Become an owner, with shares (equity) in the company
  • Fulltime
Read More
Arrow Right

Senior Machine Learning Engineer (Team Lead)

As our Artificial Intelligence (AI) and Machine Learning (ML) Team Leader, you w...
Location
Location
Australia , South Bank
Salary
Salary:
Not provided
fctgcareers.com Logo
Flight Centre Brand
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years delivering production grade ML or AI systems with proven commercial impact
  • 3+ years Leading and Mentoring engineers
  • Experience building AI agents, RAG systems or LLM powered applications in production
  • Demonstrated experience leading technical teams and managing complex AI programmes
  • Strong hands on experience across ML infrastructure, distributed systems and scalable AI architecture
  • Experience building and governing AI agent platforms including endpoints, gateways and tool orchestration
  • Familiarity with MCP servers and emerging agent communication standards and protocols
  • Experience defining evaluation frameworks, safety mechanisms and governance for LLM and agent based systems
  • Deep knowledge of Python, modern AI/ML frameworks and scalable AI platforms including Databricks
  • Strong expertise in Kubernetes and cloud native production environments
Job Responsibility
Job Responsibility
  • Lead the development and productionisation of ML models, LLM powered systems and agent based applications
  • Define and build end to end MLOps including CI CD, model registry, monitoring, drift detection and retraining for predictive ML systems
  • Establish LLMOps standards including context engineering, automated evaluation pipelines, red teaming, safeguards and policy guardrails
  • Architect and build AI agent workflows, endpoints, gateways and orchestration layers enabling secure tool access, structured reasoning and multi agent collaboration
  • Design and govern MCP servers and modern agent communication protocols to ensure interoperability, security and scalability
  • Implement strong observability across ML and GenAI systems including reliability, latency, evaluation metrics, usage tracking and cost control
  • Drive scalable ML infrastructure, feature stores and data platforms on Databricks
  • Oversee Kubernetes based deployments and cloud native AI infrastructure
  • Partner with senior stakeholders to prioritise and deliver multiple high impact AI initiatives
  • Coach and grow a high performing AI engineering team
What we offer
What we offer
  • Individualised, ongoing Learning & Development via communities of practice
  • Innovation Days
  • Dedicated Engineering Days
  • Access to 'LinkedIn Learning' for ongoing skills development
  • Women in PM&E group
  • Exclusive Staff Discounts
  • Travel Discounts
  • Career opportunities in a network of brands and businesses across the globe
  • Corporate Health Discounts
  • Mental Health Support and Employee Assistance Program for staff and family
  • Fulltime
Read More
Arrow Right

Senior / Lead AI Engineer

Omio is building the future of travel. We’re moving from manual, rule-based syst...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
foodlabs.com Logo
FoodLabs & Atlantic Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 10+ years of experience in software engineering, developing complex models and algorithms
  • Proven track record in designing, implementing, and deploying production-grade AI solutions at scale
  • Strong communication and presentation skills, with the ability to influence and collaborate effectively with non-technical stakeholders
  • Self-motivated and capable of working independently, driving initiatives with minimal supervision
  • Prior experience deploying scalable AI and LLM-based solutions for real-time, high-performance systems is highly desirable
  • Experience with diverse model evaluation techniques (quantitative and qualitative) and an iterative approach to improving AI system performance and user outcomes
  • Expertise in building AI applications using large language models such as OpenAI, Claude, Gemini, LLaMA
  • Experience with LLM orchestration frameworks like LangChain, LangGraph, vLLM, LMDeploy
  • Strong programming skills in Java, Python, and SQL
  • Familiarity with data preprocessing, feature engineering, model evaluation, MLOps, and LLMOps best practices
Job Responsibility
Job Responsibility
  • Develop AI solutions leveraging LLMs to improve productivity and deliver strong business impact
  • Lead the end-to-end development lifecycle from ideation to deployment of AI-powered solutions across various domains
  • Build scalable AI systems that support Omio’s global expansion goals
  • Act as an evangelist for AI adoption by demonstrating clear value to stakeholders
  • Collaborate with Business, Product, and Engineering teams to integrate AI into workflows and drive adoption
  • Present models, results, and systems to both technical and non-technical audiences, including C-level stakeholders
  • Fulltime
Read More
Arrow Right

Senior Lead AI Engineer

Omio is building the future of travel. We’re moving from manual, rule-based syst...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
foodlabs.com Logo
FoodLabs & Atlantic Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 10+ years of experience in software engineering, developing complex models and algorithms
  • Proven track record in designing, implementing, and deploying production-grade AI solutions at scale
  • Strong communication and presentation skills, with the ability to influence and collaborate effectively with non-technical stakeholders
  • Self-motivated and capable of working independently, driving initiatives with minimal supervision
  • Prior experience deploying scalable AI and LLM-based solutions for real-time, high-performance systems is highly desirable
  • Experience with diverse model evaluation techniques (quantitative and qualitative) and an iterative approach to improving AI system performance and user outcomes
  • Expertise in building AI applications using large language models such as OpenAI, Claude, Gemini, LLaMA
  • Experience with LLM orchestration frameworks like LangChain, LangGraph, vLLM, LMDeploy
  • Strong programming skills in Java, Python, and SQL
  • Familiarity with data preprocessing, feature engineering, model evaluation, MLOps, and LLMOps best practices
Job Responsibility
Job Responsibility
  • Develop AI solutions leveraging LLMs to improve productivity and deliver strong business impact
  • Lead the end-to-end development lifecycle from ideation to deployment of AI-powered solutions across various domains
  • Build scalable AI systems that support Omio’s global expansion goals
  • Act as an evangelist for AI adoption by demonstrating clear value to stakeholders
  • Collaborate with Business, Product, and Engineering teams to integrate AI into workflows and drive adoption
  • Present models, results, and systems to both technical and non-technical audiences, including C-level stakeholders
  • Fulltime
Read More
Arrow Right

Senior MLOps Engineer

Prolific is not just another player in the AI space – we are the architects of t...
Location
Location
United Kingdom
Salary
Salary:
Not provided
prolific.com Logo
Prolific
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years experience with cloud infrastructure and infrastructure as code
  • Previous experience with the ML and LLM lifecycle - training, hosting, optimisation, observability
  • Used to working closely with researchers and data scientists - taking experiments from worksheets into production
  • Strong grasp of ML fundamentals and modern GenAI stack
Job Responsibility
Job Responsibility
  • Infrastructure & Platform Engineering: Design and maintain scalable cloud environments (GCP/AWS) using Terraform
  • Manage GPU/TPU resource allocation for training, fine-tuning, and interactive notebooks
  • Build internal services and CLI tools to streamline the developer experience for the AI team
  • ML & LLM Orchestration: Design CI/CD/CT (Continuous Training) pipelines using tools such as GitHub Actions, MLFlow, Vertex AI Pipelines
  • Develop reusable patterns for model serving
  • Managing service deployments to Kubernetes
  • Manage and optimize vector databases and embedding pipelines for RAG-based systems
  • Performance & Optimization: Implement techniques to reduce latency and increase throughput
  • Solve scaling bottlenecks for serverless or containerized model deployments
  • Optimize GPU utilization and cloud spend without compromising performance
What we offer
What we offer
  • competitive salary
  • benefits
  • remote working
  • impactful, mission-driven culture
Read More
Arrow Right

Senior AI Engineer

Omio is building the future of travel. We’re moving from manual, rule-based syst...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
foodlabs.com Logo
FoodLabs & Atlantic Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 6+ years of experience in developing complex models and algorithms
  • Proven track record in designing and deploying production-grade AI solutions
  • Strong communication and presentation skills, with the ability to influence non-technical stakeholders
  • Self-motivated, independent contributor capable of driving initiatives with minimal guidance
  • Prior experience deploying scalable AI and LLM-based solutions for real-time, high-performance systems is highly desirable
  • Expertise in building AI applications using large language models such as OpenAI, Claude, Gemini, LLaMA
  • Experience with LLM orchestration frameworks like LangChain, LangGraph, vLLM, LMDeploy
  • Strong programming skills in Java, Python, and SQL
  • Familiarity with data preprocessing, feature engineering, model evaluation, MLOps, and LLMOps best practices
  • Ability to construct Retrieval-Augmented Generation (RAG) systems for advanced AI workflows
Job Responsibility
Job Responsibility
  • Develop AI solutions leveraging LLMs to improve productivity and deliver strong business impact
  • Lead the end-to-end development lifecycle from ideation to deployment of AI-powered solutions across various domains
  • Build scalable AI systems that support Omio’s global expansion goals
  • Act as an evangelist for AI adoption by demonstrating clear value to stakeholders
  • Collaborate with Business, Product, and Engineering teams to integrate AI into workflows and drive adoption
  • Present models, results, and systems to both technical and non-technical audiences, including C-level stakeholders
  • Fulltime
Read More
Arrow Right

Senior Data Scientist – Gen AI Engineer - Assistant Vice President

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Data Science, Artificial Intelligence, or a related quantitative field.
  • 8–12 years of experience as a Data Scientist or equivalent role, with at least 2 years of specialized, hands-on experience in Generative AI, including leading technical development and mentoring teams.
  • Demonstrable experience across the full lifecycle of production-level GenAI projects — from ideation and prototyping through deployment, monitoring, and ongoing maintenance in live environments.
  • Expert-level Python proficiency
  • Scikit-learn, XGBoost, LightGBM
  • PyTorch
  • Hugging Face Transformers, LangChain, LlamaIndex, Semantic Kernel
  • LangGraph, CrewAI, AutoGen
  • Transformer architectures
  • RAG patterns
Job Responsibility
Job Responsibility
  • Working with financial and enterprise data, applying modern NLP and GenAI techniques to solve business problems.
  • Designing, refining, and systematizing prompt engineering strategies for large language models (LLMs), including structured prompting, chain-of-thought, and few-shot/zero-shot approaches.
  • Collaborating with business stakeholders to translate requirements into GenAI-powered solutions.
  • Developing, testing, and maintaining production-grade Python code for GenAI applications.
  • Integrating with vector databases (e.g., Pinecone, Weaviate, Milvus, pgvector, Qdrant) for retrieval-augmented generation (RAG) pipelines.
  • Building, monitoring, and optimizing MLOps/LLMOps pipelines for continuous model deployment and observability.
  • Researching and evaluating emerging GenAI technologies, frameworks, and best practices to maintain competitive advantage.
  • Troubleshooting and debugging GenAI models and agentic systems in production, including rapid identification and resolution of issues in real-world deployments.
  • Communicating complex AI/ML concepts clearly to non-technical stakeholders, translating technical jargon into actionable business terms.
  • Participating in and leading team meetings, design reviews, and architecture discussions.
  • Fulltime
Read More
Arrow Right

Senior Engineer, Machine Learning Engineering

Mastercard’s Business & Market Insights (B&MI) group empowers organizations to a...
Location
Location
India , Pune
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s/bachelor’s degree in computer science or engineering
  • Considerable work experience with a proven track-record of successfully leading and managing complex projects/products and delivering to aggressive market needs
  • Expert-level hands on experience designing, building and deploying both conventional AI/ML solutions and LLM/Agentic solutions
  • Strong analytical and problem-solving abilities, with quick adaptation to new technologies, methodologies, and systems
  • Strong applied knowledge and hands on experience in advanced statistical techniques, predictive modelling, machine learning algorithms, GenAI and deep learning frameworks
  • Experience with AI and machine learning platforms such as TensorFlow, PyTorch, or similar
  • Strong programming skills in languages such as Python/SQL is a must
  • Experience with data visualization tools (e.g., Tableau, Power BI) and understanding of cloud computing services (AWS, Azure, GCP) related to data processing and storage is a plus
Job Responsibility
Job Responsibility
  • Implement multi-agent intelligence frameworks (LangGraph, CrewAI, AutoGen) to enable reasoning, coordination, and adaptive decision-making across specialized AI agents
  • Design and operationalize multi-modal AI pipelines combining text, image, tabular, and graph data using transformer-based architectures (BERT, CLIP, LLaVA, T5, Whisper, etc.) for unified intelligence
  • Build scalable RAG and Graph-RAG systems integrating vector stores and knowledge graphs (Neo4j, AWS Neptune) to enable contextual retrieval, semantic linking, and entity-aware reasoning
  • Develop and productionize transformer-based models for NLP, vision-language understanding, and sequential prediction tasks leveraging Hugging Face, PyTorch, and TensorFlow ecosystems
  • Implement advanced Python-based backend services for inference orchestration, async job handling, and distributed data workflows supporting high-throughput AI operations
  • Establish end-to-end LLMOps and MLOps pipelines on Databricks (AWS) integrating MLflow, feature stores, model lineage, prompt evaluation, and continuous retraining frameworks
  • Apply traditional AI/ML and statistical modeling techniques (regression, clustering, forecasting, ensemble methods) alongside deep learning models for hybrid interpretability and explainability
  • Engineer state and memory management subsystems that preserve context, track embeddings, and enable agents to reason temporally across multiple modalities and interactions
  • Implement Responsible AI practices—bias detection, explainability dashboards, data ethics checks, and performance governance ensuring fairness and transparency of deployed models
  • Continuously research, benchmark, and productionize innovations in multimodal transformers, generative modeling, and agentic orchestration to drive enterprise-scale intelligence and automation
  • Fulltime
Read More
Arrow Right