CrawlJobs Logo
R
Recraft · IT - Software Development

ML Data Engineer

United Kingdom, London · Job Posted February 20, 2026
Apply Position
Job Link Share

Job Description

At Recraft, we’re building the next generation of generative models across images and text. We’re looking for an ML Data Engineer to scale our data pipelines for unstructured data (primarily images) and keep our training flows fast, reliable, and repeatable. You’ll design and operate high-throughput ingestion and preprocessing on Kubernetes, evolve our internal data-pipeline framework, and work hand-in-hand with ML engineers to ship datasets that move model quality forward.

Job Responsibility

  • Develop and maintain data-ingestion pipelines to source and prepare large-scale image (and occasional text/HTML) datasets from open, publicly accessible, and permitted sources
  • Own the end-to-end flow: raw data → quality/beauty/relevance filtering → dedup/validation → ready-to-train artifacts
  • Operate and improve our Kubernetes-based data-pipeline framework (distributed jobs, retries, monitoring, automation)
  • Work with S3-style object storage: efficient layouts, lifecycle, throughput, and cost awareness
  • Add tooling around pipelines (progress/health visualization, metrics, alerts) for observability and faster iteration
  • Collaborate closely with ML engineers to align datasets with training needs and accelerate experimentation

Requirements

  • Strong Python fundamentals
  • you write clean, maintainable, production-ready code
  • Solid hands-on Kubernetes experience (containers, jobs, batch/distributed processing)
  • Proven track record with unstructured data, especially images (loading, filtering, transforming at scale)
  • Experience developing data-ingestion or parsing tools for publicly accessible sources, including handling real-world reliability and failure cases gracefully
  • Comfort with S3/object storage and moving lots of data efficiently and safely
  • Pragmatic, detail-oriented, ownership mindset
  • you enjoy making systems reliable and fast

Nice to have

  • Familiarity with ML workflows (PyTorch) and downstream training considerations
  • Experience with image quality scoring, captioning, or image-to-text pipelines
  • DAG/workflow visualizations or pipeline UX tooling
  • DevOps fluency: Docker, CI/CD, infra automation

What we offer

  • Competitive salary and equity
  • We’re able to offer Skilled Worker visa sponsorship in the UK for qualified candidates
  • Real impact on model quality: your pipelines directly power training runs and product improvements
  • Ownership with support: autonomy to design and improve systems, alongside experienced ML peers
  • Modern stack: Python, Kubernetes, S3, internal pipeline framework built for scale
  • Growth: a fast-moving environment where shipping well-engineered systems is the norm
Recraft - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

ML Data Engineer

8 matching positions

Full-Stack Data Engineer – Data & ML Automation (Databricks)

We are seeking a Fullstack Data Engineer who can operate at the intersection of ...
Location
Location
India , Pune
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with CLI tools, scripts, and utilities for automating data platform workflows
  • Experience with Databricks APIs, Terraform, Databricks SDK
  • Experience designing integration tests, end-to-end pipeline tests, validation frameworks for Databricks ETL/ELT pipelines and ML inference workflows
  • Experience building internal applications using React, Streamlit, or similar frameworks
  • Experience with spec-driven development, coding agents and automation patterns, CI/CD workflows for data/ML systems
Job Responsibility
Job Responsibility
  • Develop CLI tools, scripts, and utilities to automate repetitive workflows across the data platform
  • Automate Databricks workflows, job deployments, environment provisioning, and MLOps operations using Databricks APIs, Terraform, Databricks SDK
  • Design and implement integration tests, end-to-end pipeline tests, validation frameworks for Databricks ETL/ELT pipelines and ML inference workflows
  • Improve reliability, observability, and overall engineering productivity across the data & ML team
  • Build quick internal applications using React, Streamlit, or similar frameworks to visualize data flows, provide model inference demos, enable operational or configuration controls
  • Develop internal productivity and monitoring dashboards
  • Apply best practices around spec-driven development, coding agents and automation patterns, CI/CD workflows for data/ML systems
  • Fulltime
Read More
Arrow Right

ML / Data Engineer – Data Science Enablement

This role will report to the Data Science Enablement Manager and support the Rar...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s in Computer Science, Data Engineering, or related technical field
  • 3–5 years of experience in ML engineering, data engineering, or related roles
  • Strong programming skills in Python and SQL
  • Experience with data pipeline development and distributed computing (e.g., Spark/PySpark)
  • Working knowledge of Databricks and at least one cloud platform (AWS, Azure, or GCP)
  • Experience with ML lifecycle tools (e.g., MLflow, Git, CI/CD pipelines)
  • Understanding of model deployment, monitoring, and reproducibility practices
Job Responsibility
Job Responsibility
  • Build and maintain scalable data and ML pipelines to support patient finding use cases across the patient journey
  • Productionize machine learning models by developing deployment workflows, APIs, and batch/real-time scoring pipelines
  • Design and implement model evaluation, validation, and monitoring frameworks (performance tracking, drift detection, alerting)
  • Enable end-to-end ML lifecycle management, including training, versioning, deployment, and retraining workflows
  • Partner with RDBU data science teams to translate analytical solutions into production-ready systems
  • Develop ML-ready datasets and feature pipelines, ensuring data quality, consistency, and reusability
  • Support model tracking and experiment management using standardized tools and frameworks
  • Build tools and utilities to monitor, track, and operationalize model outputs for downstream consumption
  • Collaborate with enterprise data and platform teams to ensure compliance with data governance, security, and architecture standards
  • Follow engineering best practices for code quality, documentation, testing, and CI/CD integration
Read More
Arrow Right

Senior Speech & Audio Biomarkers ML Engineer / Data Scientist / LLM Researcher

Adalyon is transforming clinical trials with a behavioural-intelligence platform...
Location
Location
Finland
Salary
Salary:
Not provided
life-science-talent-solutions.dk Logo
Life Science Talent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree PhD, postdoctoral experience, or equivalent research depth in speech technology, audio signal processing, acoustics, machine learning, data science, computational linguistics, or a related field
  • Audio and NLP experience – You have built systems that process raw audio and transcripts to derive actionable insights. Familiarity with prosodic and spectral features, and the ability to engineer features like jitter, shimmer and harmonic-to-noise ratio, which have been shown to correlate with cognitive and emotional conditions
  • Speech processing toolkits: Experience with speech processing toolkits (e.g., librosa, Kaldi, Praat) and ML frameworks (PyTorch, TensorFlow, scikit-learn) is essential
  • LLM expertise – Hands-on experience with large language models, including prompting, fine-tuning and integrating them into downstream ML pipelines. Ability to interpret and control LLM outputs to ensure transparency and reproducibility, avoiding the unpredictable behaviour of generic LLMs
  • Startup mindset – Comfortable working in an agile, evolving environment. You take initiative, think creatively and can operate with limited structure. You thrive when delivering an MVP while planning for scalable solutions
  • Practical programming ability, ideally in Python and relevant scientific/data tooling. You do not need to be a software engineer, but you must be able to build the systems and pipelines needed for your research.
Job Responsibility
Job Responsibility
  • Conversational design & data pipeline
  • Signal processing & feature extraction
  • Model development & integration
  • Validation & evidence generation
  • Research & innovation
What we offer
What we offer
  • A competitive salary package that reflects your experience and the value you create
  • The opportunity to work with advanced AI, acoustic analysis, and speech-based biomarker technology at an early stage
  • A central and highly influential role with direct access to research and technology leadership
  • High autonomy, high visibility, and the opportunity to shape the scientific foundation of a growing company
  • A dynamic and flexible startup environment with room for deep technical discussion, scientific exploration, and practical impact
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, ML Data Platform

DUTIES: Develop fast, robust, and spike-resistant data consumption, data mining...
Location
Location
United States , Detroit
Salary
Salary:
216418.50 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Electronic Engineering, Management Information Systems, or related field of study and Five (5) years of experience as a Software Engineer, Programmer Analyst, or related occupation
  • Five (5) years of experience with: Building Peta Byte (PB) scale data management systems
  • Optimizing those data processing clusters for cost efficiency and performance
  • Building serving systems capable of delivering data at high-throughput, low-latency and high QPS (Queries Per Second) in a cost-efficient and spike-resilient manner
  • Building scalable infrastructure on the cloud with Python, Java, or Scala
  • Writing SQL queries for analytic purposes.
Job Responsibility
Job Responsibility
  • Develop fast, robust, and spike-resistant data consumption, data mining, and processing tools for the entire company
  • Develop orchestration for large-scale post-processing, and computational pipelines
  • Participate in the development, optimization and productionization of the next generation data processing platform using Beam and Spark in the cloud
  • Build self-serve capabilities to help customers to adopt the next generation data processing platform
  • Use the latest cloud technologies to own, design, implement, and test scalable distributed data systems in the cloud
  • Champion engineering excellence by continuously improving systems and processes
  • Own technical projects from start to finish, contribute to the team’s product roadmap, and be responsible for major technical decisions and tradeoffs
  • Effectively participate in team’s planning, code reviews and design discussions
  • Consider the effects of projects across multiple teams and proactively manage conflicts
  • Work with partner teams and orgs to achieve cross-organizational goals and satisfy broad requirements
What we offer
What we offer
  • An incentive pay program offers payouts based on company performance, job level, and individual performance
  • Fulltime
Read More
Arrow Right

Big Data Engineer - ML Analytics & Search

We train models on petabyte-scale automotive sensor data, but training is only h...
Location
Location
Germany , Munich
Salary
Salary:
Not provided
bmw.de Logo
BMW
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • University degree in Computer Science, Engineering, or a related field
  • 3–5 years of experience in big data or data engineering with a focus on analytics and search over very large datasets
  • Strong Python and SQL skills, with experience in at least one distributed compute framework
  • Experience with columnar or analytical storage and query optimisation at PB scale
  • Familiarity with search and indexing technologies, including full-text search, vector/embedding search or metadata catalogues
  • Production experience with Kubernetes and AWS / Azure / Google Cloud, as well as hands-on experience with infrastructure-as-code
  • Experience with automotive measurement data (MDF4/ASAM MDF or MCAP) as well as with embedding-based retrieval, dataset management tools, stream processing, or graph-based metadata systems
Job Responsibility
Job Responsibility
  • Design and build high-performance search and query pipelines over PB-scale MDF4 and MCAP data lakes, enabling ML engineers to find relevant driving scenarios, sensor conditions, and edge cases across billions of records in seconds
  • Build and operate indexing and cataloguing systems for automotive sensor data, including metadata extraction, signal-level indexing, scene tagging, and embedding-based similarity search
  • Implement distributed compute pipelines for large-scale data evaluation, such as batch statistics, distribution analysis, annotation coverage reports, and data-quality scoring
  • Build fast analytical queries that enable interactive exploration on top of raw data
  • Develop dataset assembly pipelines that automatically assemble, version, and register training and evaluation datasets
  • Optimise for cost and performance through intelligent partitioning, tiered storage, caching strategies, and query pushdown to minimise scan volumes over PB-scale data
  • Operate observability stacks for data pipelines, including query latency dashboards, pipeline health, and data freshness monitors
What we offer
What we offer
  • Challenging projects with which we shape the mobility of tomorrow together
  • Wide range of personal and professional development opportunities
  • Attractive, fair and performance-related remuneration
  • High level of job security
  • Annual special payments such as vacation pay, Christmas bonus, and profit sharing
  • Flexible working hours including six weeks annual leave and overtime compensation
  • Discounted BMW & MINI conditions
Read More
Arrow Right

Senior Staff Data Engineer- ML & AI Platform

At Marktplaats, data is at the heart of everything we do, but Intelligence is wh...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience with a specific focus on the intersection of Data Engineering, MLOps, and AI Infrastructure
  • Deep knowledge of Spark internals, structured streaming, and performance tuning for large-scale data processing
  • Proven experience architecting end-to-end ML platforms for Traditional ML (Classic MLOps) while actively enabling the organization on Generative AI concepts
  • Strong background in building automated pipelines and ensuring system observability
  • Practical experience building infrastructure for Large Language Models, including managing the complexity of chaining models and tools
  • Solid experience serving models at low latency and high concurrency using containerized solutions
  • Ability to speak the language of AI/ML Engineers and effectively bridge the gap between experimental code and production systems
  • Expert level Python
  • Experience with PyTorch, Terraform, Terragrunt, Docker, Kubernetes, GitHub Actions, Datadog
  • Experience with Databricks AI Stack: MLflow, Mosaic AI, Unity Catalog, Feature Store, Databricks Model Serving, Vector Databases
Job Responsibility
Job Responsibility
  • Lead the evolution of our Machine Learning & AI Platform, designing the architecture for AI Agents and establishing patterns for Vector Databases
  • Act as a first mover: validate new Databricks features and integrate them into the platform
  • Write the guidelines for GenAI development, helping teams transition from notebook experiments to production-grade LLM applications
  • Design the Feature Store, manage the Model Registry, and set up the infrastructure for Vector Search and RAG (Retrieval Augmented Generation) workflows
  • Elevate the technical bar of the team, mentoring Staff and Senior engineers on design patterns, code quality, and architectural decisions
  • Translate complex requirements from ML Engineers and Data Scientists into robust engineering tickets and infrastructure roadmaps
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • Fulltime
Read More
Arrow Right

Software Engineer - Data / ML

At Koah Labs, we believe in rewarding world-class talent with highly competitive...
Location
Location
United States , San Francisco
Salary
Salary:
180000.00 - 250000.00 USD / Year
koahlabs.com Logo
Koah Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You like debugging and optimizing performance
  • You are detail oriented and use data to support your claims
  • You enjoy digging deeply and owning the platform side supporting product
  • You enjoy experimentation, measuring, and creating reliable systems
Job Responsibility
Job Responsibility
  • Build data pipelines using Debezium to stream real-time changes from PostgreSQL to our OLAP database for analytics workloads
  • Reduce p99 latency in critical write paths by optimizing SQL query execution plans, implementing robust retry mechanisms, and enforcing strict timeouts for third-party services
  • Tune conversion and clickthrough rate metrics in our core ad matcher from analyzing impression and click data
  • Enhance ad matching algorithms using regression analysis to identify data patterns and develop hypotheses for new predictive features that improve conversion likelihood
  • Set up experiment tracking and observability with logs and custom metrics that make it easy for us to understand why certain ads are chosen
What we offer
What we offer
  • Offers Equity
  • top-tier benefits
  • Fulltime
Read More
Arrow Right

Data Engineer / ML Ops

As our Data Engineer, you will design, build, and maintain the data infrastructu...
Location
Location
Germany , Berlin; Potsdam
Salary
Salary:
Not provided
sensmore.ai Logo
Sensmore GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of hands-on experience building production data pipelines in the cloud (AWS, GCP, or Azure)
  • Proficiency in Python, SQL, and at least one big-data framework
  • Familiarity with ML Ops tooling: DVC, MLflow, Kubeflow, or similar
  • Experience designing and operating data warehouses/data lakes (e.g., Redshift, Snowflake, BigQuery, Delta Lake)
  • Strong understanding of distributed systems, data serialization (Parquet, Avro), and batch vs. streaming paradigms
  • Excellent problem-solving skills and the ability to work in ambiguous, fast-paced environments
Job Responsibility
Job Responsibility
  • Build & operate data pipelines: Ingest, process, and transform multi-sensor telemetry (radar point-clouds, video frames, log streams) into analytics-ready and ML-ready formats
  • Design scalable storage: Architect high-throughput, low-latency data lakes and warehouses (e.g., S3, Delta Lake, Redshift/Snowflake)
  • Enable ML Ops workflows: Integrate DVC or MLflow, automate model training/retraining triggers, track data/model lineage
  • Ensure data quality: Implement validation, monitoring, and alerting to catch anomalies and schema changes early
  • Collaborate cross-functionally: Partner with Embedded Systems, Robotics, and Software teams to align on data schemas, APIs, and real-time requirements
  • Optimize performance: Tune distributed processing, queries, and storage layouts for cost-efficiency and throughput
  • Document & evangelize: Maintain clear documentation for data schemas, pipeline architectures, and ML Ops practices to uplift the whole team
What we offer
What we offer
  • Attractive compensation package and stock options
  • Beverages on-site and regular social events
  • Engage with top-tier researchers, engineers, and thought leaders
  • Influence the future of robotic technologies and tackle significant technological challenges
  • Assistance with relocation to Berlin
  • Fulltime
Read More
Arrow Right