CrawlJobs Logo

Senior Data Engineer

United Kingdom, London 370.00 - 450.00 GBP / Day · Job Posted May 28, 2026
Apply Position
Job Link Share

Job Description

My Client is financial service is launching a new divisional data team to build a next-generation enterprise data platform. Reporting to the AVP of Data Engineering, you will define engineering best practices, build data-intensive pipelines, and bridge the gap between global business units and technical delivery.

Job Responsibility

  • Design, test, and maintain robust data pipelines and data warehouse architecture
  • Lead code/architecture reviews, enforce IT controls, and optimize system quality
  • Provide technical guidance and assistance to junior development staff
  • Partner with global stakeholders to translate business needs into technical outputs

Requirements

  • Expert SQL skills
  • extensive experience with Snowflake and MS SQL Server
  • strong experience with dbt and at least one ETL tool (Matillion, Fivetran, SNP Glue, or Informatica)
  • hands-on experience with Azure DevOps (or similar) and shell scripting
  • deep understanding of data modeling, curation, orchestration, and TDD/unit testing
  • Agile approach, excellent stakeholder communication, and a results-oriented mindset

Nice to have

  • Insurance/Reinsurance industry experience
  • PowerBI/Tableau
  • SAP
  • NoSQL (DynamoDB/Cosmos)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer

8 matching positions

Senior Data Engineer

*** Senior Data Engineer - 10 Months+ Contract - Hybrid -Vilnius, Lithuania*** R...
Location
Location
Lithuania , Vilnius
Salary
Salary:
Not provided
redglobal.com Logo
RED Commerce - The Global SAP Solutions Provider
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience as a Data Engineer
  • 7+ years of experience in the overall IT area
  • Strong experience with PySpark and Databricks (AWS environment)
  • Proven experience building data pipelines and implementing Medallion architecture from scratch
  • Excellent communication skills with fluent English (spoken and written)
  • Strong stakeholder management skills with the ability to gather business requirements and translate into technical solutions
  • Able to join within 2-4 weeks of offer
Read More
Arrow Right
New

Senior Data Engineer

We’re looking for a Senior Data Engineer to help scale and evolve our data platf...
Location
Location
United States
Salary
Salary:
150000.00 - 180000.00 USD / Year
helpcare.ai Logo
Helpcare AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A min of 5+ years of software engineering experience with the last 2-3 years in data engineering, ideally including early-stage or 0→1 environments
  • Strong Python programming experience
  • Advanced proficiency in SQL
  • Proven experience building ETL/ELT pipelines end-to-end
  • Experience with orchestration tools like Airflow
  • Deep understanding of the data lifecycle: ingestion → storage → processing → transformation → serving
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Experience supporting BI tools (Looker, Tableau, etc.)
  • Familiarity with modern data warehouses (Snowflake, BigQuery, Redshift)
Job Responsibility
Job Responsibility
  • Design and scale our data platform including pipelines, models, and orchestration frameworks
  • Develop scalable ETL/ELT pipelines for ingesting data from APIs, databases, and event streams
  • Define and implement systems for data ingestion, storage, processing, and transformation
  • Build and manage workflow orchestration using tools like Airflow
  • Build semantic layer as well as dashboards
  • Establish best practices for data modeling, testing, and quality
  • Partner with stakeholders to shape data requirements and enable BI and analytics use cases
  • Optimize systems for performance, scalability, and cost from day one
  • Apply software engineering principles (testing, CI/CD, modular design) to data infrastructure
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Senior Data Engineer. Must Haves: Strong hands-on experience building and suppor...
Location
Location
United States , Los Angeles
Salary
Salary:
Not provided
bhsg.com Logo
Beacon Hill
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience building and supporting production-grade data pipelines using PySpark and Apache Spark
  • Extensive experience working within Databricks environments
  • Experience with Databricks Unity Catalog migrations and modernization initiatives
  • Experience with Databricks Unity Catalog governance and security models
  • Strong understanding of ETL/ELT design, data modeling, and incremental data processing
  • Experience modernizing legacy data platforms and data migration projects
  • Experience working with large-scale datasets in cloud-based data platforms
  • Experience with workflow orchestration, scheduling, and pipeline automation
  • Knowledge of cloud data platforms such as Snowflake and/or Google Cloud
  • Experience implementing data quality checks, monitoring, logging, and alerting
Job Responsibility
Job Responsibility
  • Migrate existing data assets and pipelines to Databricks Unity Catalog
  • Refactor and optimize existing pipelines using modern engineering standards and best practices
  • Build and maintain scalable PySpark-based data pipelines
  • Develop new source-of-truth datasets and modernize legacy data workflows
  • Design and implement workflow orchestration using Databricks Jobs
  • Deploy and manage pipelines using Databricks Asset Bundles
  • Ensure data pipelines are reliable, observable, and production-ready
  • Implement data quality controls, monitoring, and operational alerting
  • Support platform migrations, testing, validation, and production cutovers
  • Partner with engineering teams to improve platform stability, scalability, and data reliability
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are seeking an experienced Senior Data Engineer to join a leading automotive ...
Location
Location
Sweden , Gothenburg
Salary
Salary:
53333.00 - 66667.00 SEK / Month
amaris.com Logo
Amaris Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with PySpark and Databricks in production environments
  • Advanced Python programming skills
  • Experience with Git/Gerrit and CI/CD pipelines (GitHub Actions, Jenkins, GitLab, or similar)
  • Solid knowledge of Docker and workflow orchestration tools such as Airflow or Databricks Jobs
  • Expertise in designing scalable, privacy-compliant data architectures and pipelines
  • Strong SQL skills and experience handling large-scale datasets
  • Experience with Azure cloud services and Snowflake (or equivalent cloud data warehouse technologies)
  • Knowledge of monitoring, observability, automated testing, and cost optimization practices
  • Familiarity with Power BI or similar BI and reporting tools
  • Understanding of automotive UDS diagnostics and vehicle signal data
Job Responsibility
Job Responsibility
  • Design and develop scalable data pipelines using PySpark and Databricks
  • Build and maintain raw and refined data products related to vehicle signals, software versions, drive cycles, distance measurements, and driver feedback
  • Optimize data processing performance, reliability, and cost efficiency
  • Implement monitoring, observability, automated testing, and usage tracking for data products
  • Collaborate with architects, engineers, Product Owners, and business stakeholders to deliver robust data solutions
  • Support documentation, knowledge transfer, and operational handovers
  • Contribute to technical leadership and best practices within the data engineering domain
What we offer
What we offer
  • An international community, bringing together 110+ different nationalities
  • An environment where trust has a central place: 70% of our key leaders started their careers at the first level of responsibilities
  • A robust training system with our internal Academy and 250+ available modules
  • A vibrant workplace that frequently gathers for internal events (afterworks, team buildings, etc.)
  • Opportunity to turn ideas into action and make a tangible impact through ESG commitments
  • WeCare Together program empowering employees to design and lead projects that create social or environmental impact
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Senior Data Engineer - Media Org (Hybrid NYC or LA). I’m working on a Senior Dat...
Location
Location
United States , New York City or Los Angeles
Salary
Salary:
Not provided
lawrenceharvey.com Logo
Lawrence Harvey
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong Data Engineering experience building production data pipelines
  • Strong PySpark and SQL expertise
  • Experience with Databricks or similar Spark-based cloud platforms
  • Experience building batch and streaming pipelines
  • Experience with orchestration tools such as Airflow or similar
  • Familiarity with AWS environments, data lakes, and modern cloud data architecture
  • Experience with modern Lakehouse design patterns, including Medallion Architecture (Bronze, Silver / Gold layers) for structuring scalable and modular data pipelines
Job Responsibility
Job Responsibility
  • Designing batch and real-time data pipelines
  • Working heavily within a Databricks environment
  • Helping shape modern lakehouse architecture
  • Partnering closely with analytics, product, and data science teams
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

At AO, we’re all about using data to make smarter decisions and create brilliant...
Location
Location
United Kingdom , Bolton
Salary
Salary:
Not provided
ao.com Logo
AO
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid experience in data engineering, building and maintaining data pipelines
  • Strong hands-on knowledge of AWS services like Redshift, Glue, Spectrum and Lambda
  • Confidence working with Python and TSQL
  • A good understanding of data modelling, ETL processes and data warehousing
  • Experience (or exposure to) Infrastructure as Code tools such as Terraform or CloudFormation
  • Familiarity with CI/CD pipelines and automated deployment practices
  • A natural problem solver who enjoys improving and optimising the way things work
  • Comfortable collaborating with different teams and bringing ideas to life together
  • Someone who’s keen to share knowledge and support others’ development
Job Responsibility
Job Responsibility
  • designing and building robust data pipelines that keep our data flowing smoothly and reliably, using AWS tools like Redshift, Glue, Spectrum and Lambda
  • Working closely with teams across AO, you’ll turn business needs into practical, scalable solutions that help unlock the value of our data
  • continuously improve performance, reliability and cost-efficiency across our data systems, while making sure everything is secure and compliant
  • setting up automated deployments using Infrastructure as Code and CI/CD pipelines, to troubleshooting issues and documenting your work, you’ll help keep things running seamlessly
  • share your knowledge with others in the team, helping to coach and support colleagues as we grow
What we offer
What we offer
  • 25 days holidays, plus bank holidays (increasing to 27 days after 2 years with us)
  • Pension
  • Contribute 5% of your annual salary and we'll do the same
  • Be a VIP at the AO Arena
  • discounted gym membership
  • an onsite spa
  • Help @ Hand scheme giving you access to virtual GP’s, Mental Health support and much more
  • exclusive discounts across our product range
  • Enhanced Maternity, Paternity and Adoption leave
  • 2 fully paid days a year to donate your time to any charity of your choice
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Are you a Senior Data professional who enjoys mentoring talent and designing hig...
Location
Location
Greece , Athens
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 10, 2026
Flip Icon
Requirements
Requirements
  • University degree in Computer Science, Statistics, Mathematics, or a related Quantitative field.
  • 5+ years of professional experience in Data Engineering with a mastery of MS SQL Server (T-SQL, SSIS, Performance Tuning).
  • Proven experience in mentoring or leading technical team members.
  • Exposure to VBM methodologies or a strong understanding of financial/business data modeling.
  • Hands-on experience with QlikSense or Qlikview (or similar BI visualization tools like Tableau/Power BI).
  • Excellent command of the English language.
  • A proactive leader with an analytical mindset and a passion for knowledge sharing.
Job Responsibility
Job Responsibility
  • Lead the design and implementation of robust data architectures using on-premise MS SQL Server technologies.
  • Mentor and guide junior developers, assisting them in technical design and ensuring best practices in database management and ETL processes.
  • Develop complex data models that drive strategic business decisions and high-level reporting.
  • Collaborate with business stakeholders to translate VBM methodologies into technical requirements.
  • Oversee the integration of data flows into visualization tools, ensuring data accuracy and top-tier performance.
Read More
Arrow Right
New

Senior Data Engineer

We're looking for an experienced Senior Data Engineer to lead the design, develo...
Location
Location
United Kingdom; Netherlands; Germany; Sweden , Luton; Rijswijk; Hanover; Stockholm
Salary
Salary:
Not provided
https://www.tui.com Logo
TUI
Expiration Date
June 22, 2026
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent professional experience in data engineering or software development
  • Master's degree in Computer Science, Data Science, or related field would be beneficial
  • Proven experience in data engineering and leading technical teams
  • Strong data engineering skills including SQL and Python, with experience managing codebases, CI/CD pipelines, and code reviews
  • Knowledge of cloud-based data systems such as Google Cloud Platform and cloud storage solutions like Snowflake/AWS
  • Deep understanding of data pipeline design, ETL processes, and data integration tools
  • Expertise in relational and NoSQL databases
  • Knowledge of data quality assurance methodologies
  • Excellent problem-solving, analytical, communication, and leadership skills
  • Professional certifications in cloud platforms
Job Responsibility
Job Responsibility
  • Lead the design and implementation of data pipelines and integration processes for customer and marketing data from digital sales channels
  • Design scalable ETL processes for analytics data
  • Develop data integration solutions between various platforms
  • Implement data transformation and enrichment processes
  • Establish and maintain data quality frameworks
  • Develop automated data quality checks and validation processes
  • Implement monitoring systems for data pipeline health
  • Create documentation and standards for data quality assurance
  • Collaborate with the Architect to implement technical designs
  • Translate architectural designs into implementation plans
What we offer
What we offer
  • Attractive remuneration
  • Discretionary bonus schemes
  • Generous travel benefits
  • Extensive health & well-being support
  • Flexible working
  • Access the TUI Learning Hub
  • Opportunities to work on global projects and teams
  • Local charity and sustainability initiatives
  • Fulltime
Read More
Arrow Right