CrawlJobs Logo
Randstad Logo Randstad · IT - Software Development

Data Engineer

United Kingdom, London · Job Posted June 30, 2026
Apply Position
Job Link Share

Job Description

The Role: We are seeking a passionate Data Engineer to design scalable, robust systems that turn large-scale consumption and royalty data into accurate payouts. You will build self-serve tools for our Finance team and develop modular, easily maintainable platform capabilities.

Job Responsibility

  • Design scalable, robust systems that turn large-scale consumption and royalty data into accurate payouts
  • Build self-serve tools for our Finance team
  • Develop modular, easily maintainable platform capabilities

Requirements

  • Deep expertise in data engineering with the ability to extend into backend services
  • Proven experience building pipelines for large-scale transactional or financial data
  • Fluency in Scala (Scio/Dataflow) and comfort with cloud-native development on GCP
  • Strong communication skills to collaborate with Finance, Product, and Engineering teams to ship auditable, reliable systems that meet regulatory scrutiny
  • Ability to thrive in fast-moving, ambiguous spaces while prioritizing long-term sustainability

Nice to have

Experience with Java, Python, and BigQuery is a plus

Randstad - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

Design, develop, and maintain data solutions, pipelines and analytics applicatio...
Location
Location
United States , Alpharetta
Salary
Salary:
Not provided
iqzsystems.com Logo
IQZ Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • MS or foreign equivalent in Computer Science or Engineering (any) or Information Systems or Data Science or Related
  • 1 year experience in data storage, analysis and pipelines, ETL, Apache Kafka and Apache Storm
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions, pipelines and analytics applications using various tools and technologies including Hadoop, Spark, Hive, Kafka, SQL, MapReduce, Apache Kafka, Apache Storm, AWS, Snowflake etc
  • Gather & analyze requirements
  • Identify and implement process improvements
  • Assemble large, complex data sets to meet requirements
  • Implement methods to improve data reliability and data quality
  • Design and develop frameworks to stream data
  • Optimize data delivery and re-design infrastructure for greater scalability
  • Perform troubleshooting and provide issue resolution and similar duties
  • Fulltime
Read More
Arrow Right
New

Data Engineer

As a Data Engineer in our Finance Systems and Analytics team, you’ll help design...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience building and maintaining data pipelines and scalable data products using structured and unstructured data
  • Strong knowledge of SQL, ideally within a Snowflake environment
  • Experience with at least one server-side language such as Python, Java, Kotlin or NodeJS or experience with Alteryx
  • Knowledge of event-driven, loosely coupled architectures and data processing patterns
  • Experience working with CI/CD tools such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development approaches
  • Experience with automated testing techniques within data or software engineering environments
  • Proven experience working in the energy industry
  • Ability to translate complex data concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Building and maintaining scalable data products that deliver insight across finance systems
  • Designing and optimising ETL processes to ensure data integrity and performance
  • Collaborating with engineers, analysts, and business teams to define and deliver data solutions
  • Contributing to agile delivery, including planning, retrospectives, and continuous improvement
  • Supporting the operational performance, monitoring, and reliability of data platforms
What we offer
What we offer
  • Competitive salary and potential for an annual bonus
  • Market-leading pension scheme
  • Electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer. At Barclays, we don’t just adapt to the future, we c...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience in ETL technologies, Ab Initio GDE and EME
  • Strong hands-on experience on SQL, Hive, Impala
  • Strong hands-on experience on Unix, Hadoop, Spark
  • Hands-on experience in Python
  • Experience working with cloud platforms, especially AWS
  • Strong knowledge of Data warehousing
  • Proficiency in Gitlab, CI/CD
  • Practical knowledge and hands‑on experience with AI-powered development tools such as Copilot, Claude Code, and GitLab Duo
  • Familiarity with data visualization tools such as Tableau, Grafana
  • Knowledge of data messaging platforms like Apache Kafka
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer. At Barclays, we don't just adapt to the future, we c...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands on experience in Abinitio ETL tool
  • Hands on experience in python and pyspark and strong knowledge on Dataframes, RDD and SparkSQL
  • Hands on Experience in developing, testing and maintaining applications on AWS Cloud
  • Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena)
  • Experience in Writing advanced SQL and PL SQL programs
  • Experience in AWS data pipeline development
  • Hands On Experience for building reusable components using AWS Tools/Technology
  • Should have worked at least on two major project implementations
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays, where you will spearhead the evolution o...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong in Abinitio (GDE), Unix and Data warehousing concepts
  • Working experience in Linux/UNIX
  • Ability to understand source to target ETL mappings
  • Ability to design, develop and maintain Abinitio graphs
  • Ability to explain functional and technical details
  • Well versed in data integration, batch processing, and delta processing
  • Hands-on experience on UNIX shell scripts to automate routine task
  • Strong understanding on job schedulers
  • Hands-on experience on database
  • Analyse and trouble shoot issues
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a Data Engineer with strong experience in Microsoft Azure and Dat...
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of Data Engineering experience
  • Hands-on experience with Azure Databricks
  • Experience with Azure services such as: Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure SQL Database
  • Strong SQL development skills
  • Experience with Python, PySpark, or Spark
  • Experience building and maintaining ETL/ELT pipelines
  • Understanding of data warehousing concepts and dimensional modeling
  • Experience working with large datasets in cloud environments
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data pipelines in Azure and Databricks
  • Build and optimize ETL/ELT processes for structured and unstructured data
  • Develop and support data lake, data warehouse, and analytics solutions
  • Integrate data from multiple internal and external sources
  • Collaborate with business analysts, data scientists, and stakeholders to understand data requirements
  • Ensure data quality, integrity, security, and governance standards are met
  • Monitor and troubleshoot data workflows and performance issues
  • Create and maintain technical documentation and data models
  • Support reporting and analytics initiatives by delivering reliable datasets
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

Design, build, and maintain scalable data pipelines and ETL/ELT processes. Devel...
Location
Location
United States , Austin
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in data engineering, data integration, or a related role
  • Strong proficiency in SQL and experience working with large, complex datasets
  • Experience building and maintaining ETL/ELT data pipelines
  • Proficiency in at least one programming language (Python, Java, Scala, or similar)
  • Hands‑on experience with data warehouses and data platforms (Snowflake, Redshift, BigQuery, Databricks, etc.)
  • Experience working in cloud environments (AWS, Azure, or GCP)
  • Familiarity with data modeling, schema design, and performance optimization
  • Experience integrating data from APIs, databases, and streaming sources
  • Strong problem‑solving and troubleshooting skills related to data pipelines and performance
  • Ability to collaborate with data analysts, data scientists, and business stakeholders
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines and ETL/ELT processes
  • Develop and manage data architectures such as data warehouses, data lakes, and lakehouses
  • Ingest and integrate data from multiple sources (databases, APIs, streaming platforms)
  • Ensure data quality, integrity, and reliability across systems
  • Optimize data processing, storage, and query performance
  • Collaborate with data analysts, data scientists, and business teams to support analytics and reporting needs
  • Implement automation for data workflows, monitoring, and error handling
  • Troubleshoot and resolve data pipeline issues and performance bottlenecks
  • Support batch and real‑time data processing frameworks
  • Document data models, pipelines, and data engineering processes
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • enrollment in company 401(k) plan
Read More
Arrow Right
New

Data Engineer

This position will play a key role in strengthening an established Microsoft Fab...
Location
Location
United States , Westchester
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building and maintaining solutions within Microsoft Fabric
  • Strong knowledge of data modeling concepts and layered architecture patterns, including Bronze, Silver, and Gold frameworks
  • Experience working in Azure-based data environments and delivering cloud-oriented data engineering solutions
  • Demonstrated ability to apply independent judgment to data design decisions rather than simply executing predefined requests
  • Background in ingesting, transforming, and modeling Salesforce data for analytics or reporting purposes
  • Familiarity with legacy reporting or warehousing environments, including spreadsheet-heavy processes and older platform patterns
  • Experience with tools and technologies such as Python, Apache Spark, ETL processes, and related big data or streaming concepts
  • Strong communication skills and confidence working directly with business partners to clarify needs and explain technical recommendations
Job Responsibility
Job Responsibility
  • Expand and enhance an existing Microsoft Fabric data platform to improve performance, consistency, and downstream usability
  • Develop layered data solutions using Bronze, Silver, and Gold design principles, with particular attention to delivering trusted and analytics-ready Gold datasets
  • Create and refine data models that support accurate reporting by evaluating data relationships, structure, quality, and business context
  • Build ingestion and transformation pipelines for Salesforce data along with additional source systems used across the organization
  • Contribute to the evolution of reporting and warehousing practices by reducing dependence on legacy approaches and spreadsheet-driven processes
  • Work autonomously on technical deliverables while providing clear updates on milestones, design decisions, dependencies, and potential issues
  • Partner with business stakeholders to understand reporting needs and translate them into effective data structures that support analytics and visualization tools
  • Use data engineering technologies such as Python, Spark, ETL frameworks, and related platform capabilities to deliver scalable solutions
  • Support report-oriented data design by preparing curated datasets that align with Power BI and other business intelligence use cases
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right