CrawlJobs Logo

Senior Data Engineer

United Kingdom, Cardiff · Job Posted July 02, 2026
Apply Position
Job Link Share

Job Description

We are looking for an enthusiastic, numerically minded individual with a strong interest in data and a creative approach to problem-solving. This role requires someone who is confident working independently, making technical decisions, raising engineering standards, and sharing knowledge with others. As part of a platform-focused team, you will also be expected to support the solutions you build and, where needed, take part in out-of-hours support. Working in an agile environment, you will need to be comfortable both independently and as part of a team in a fast-paced, evolving setting. This calls for someone who can meet agreed deadlines, communicate clearly, and think innovatively.

Job Responsibility

  • Provide platform administration support for our BI tools, primarily Looker and MicroStrategy, ensuring high-quality, reliable services
  • Own and administer the Looker platform, maintaining availability, performance, stability and security
  • Manage platform configuration, user access, roles, permissions, service accounts and governance controls in line with security and audit requirements
  • Manage LookML deployments and source control processes using Azure DevOps to support safe, efficient and repeatable change delivery
  • Support release planning and controlled platform changes to ensure smooth, low-risk delivery
  • Monitor platform usage, performance and incidents, identify root causes, and implement lasting improvements
  • Promote BI administration best practice, including standards for naming, folder structures, access models, content lifecycle and environment management
  • Work closely with engineers, analysts and stakeholders to understand requirements, resolve issues and support effective use of Looker across the business
  • Use automation and infrastructure-as-code approaches where possible to improve consistency, reduce manual effort and strengthen platform controls
  • Contribute to technical design, change management and release planning for BI platform enhancements and strategic initiatives
  • Coach and support team members by sharing knowledge, promoting engineering standards and encouraging continuous improvement
  • Actively take part in squad, chapter and guild ceremonies, contributing to team culture, delivery practices and wider Data Tribe goals
  • Bring forward innovative ideas and practical solutions to improve how our BI platforms are managed, used and developed
  • Keep your skills up to date by following advancements in business intelligence solutions and data warehousing, bringing forward ideas that improve platform capability, resilience and user experience

Requirements

  • Expert knowledge and experience administering Looker, including user access, roles and permissions, GCP IAM integration, environment management, and service accounts
  • Good understanding of LookML, deployment workflows and version control practices
  • Experience supporting BI platforms, with strong troubleshooting and performance optimisation skills
  • Strong experience with CI/CD, release management, and automation tools using Azure DevOps and Terraform
  • Strong SQL skills, with the ability to investigate data issues and support platform users effectively
  • Knowledge of Git and experience working within engineering standards, governance processes and controlled change environments
  • Strong written and verbal communication skills, both technical and non-technical, with the ability to build effective relationships horizontally and vertically across the business
  • A proactive, collaborative approach and experience working effectively in agile, fast-paced environments
  • Adaptable and open to change, with a willingness to upskill in MicroStrategy administration
  • Able to drive change and innovation, with strong strategic awareness and a broader business perspective

Nice to have

  • Experience with other BI tools such as Power BI or Tableau
  • Knowledge of Python or scripting for automation
  • Experience with cloud data platforms such as Big Query or Snowflake
  • Knowledge of data modelling

What we offer

  • 33 days holiday (including bank holidays) when they join us, increasing the longer you stay with us, up to a maximum of 38 days (including bank holidays)
  • Option to buy or sell up to an additional five days of annual leave
  • Up to £3,600 of free shares each year after one year of service
  • Flexible working
  • 24-Hour Ecare
  • Cycle to Work Scheme
  • Simply Health
  • Private Health Cover
  • Critical Illness Cover
  • Financial & Mortgage Advice

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer

8 matching positions

New

Senior Data Engineer

This role is centered on building a Centralized Data Lakehouse from scratch. The...
Location
Location
Germany , Ansbach
Salary
Salary:
Not provided
zalando.se Logo
Zalando Sverige
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience with the Databricks ecosystem (Unity Catalog, Delta Live Tables, Workflows)
  • Deep understanding of the Medallion Architecture (Bronze, Silver, Gold) and Delta Lake internals
  • Proficient in Apache Spark (PySpark) and Python for large-scale data processing
  • Several years of experience in building and maintaining scalable Streaming & Batch pipelines, specifically using CDC (Change Data Capture) from RDBMS (e.g., MySQL/BinLogs)
  • Familiar with Infrastructure as Code (Terraform), Docker, Git (trunk-based development), and DevOps principles
  • Ability to translate complex business requirements into robust, de-normalized data models optimized for Lakehouse performance
  • Good understanding of Cloud Infrastructure (AWS), REST APIs, and secure data exchange
  • Excellent verbal and written communication skills in English and the ability to accurately document designs and processes
  • Experience in aligning data strategies within a larger group ecosystem (like Zalando)
Job Responsibility
Job Responsibility
  • Take end-to-end responsibility for our Data Refinery – from ingestion (CDC) to providing business-ready data products in the Gold layer
  • Design, build, and maintain scalable ELT pipelines using Databricks Delta Live Tables (DLT)
  • Liaise with the owners of source systems (e.g., TB.One) to define and align Data Contracts
  • Implement and oversee Data Governance and security standards within the Unity Catalog
  • Perform technical analysis and root cause analysis to improve data quality and pipeline reliability
  • Build and maintain strong working relationships with the development teams and the Zalando Data Foundation
  • Record and share information on current working methods and lessons learned to foster a high-performance data culture
What we offer
What we offer
  • Employee shares program
  • 40% off fashion and beauty products sold and shipped by Zalando, 30% off Lounge by Zalando, discounts from external partners
  • 2 paid volunteering days a year
  • Hybrid working model - work where it works for you within Germany or the UK, with occasional office attendance required for moments that matter
  • Work from abroad for up to 30 working days a year
  • 27 days of vacation a year to start for full-time employees
  • Relocation assistance available (subject to prior agreement)
  • Family services, including counseling and support
  • Health and wellbeing options (including Wellhub, formerly Gympass)
  • Mental health support and coaching available
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Roku is changing how the world watches TV. Roku is the #1 TV streaming platform ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive SQL Skills
  • Proficiency in at least one scripting language, Python is required
  • Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
  • Proficiency in data modeling, including designing, implementing, and optimizing conceptual, logical, and physical data models to support scalable and efficient data architectures
  • Experience with AWS, GCP, Looker is a plus
  • Collaborate with cross-functional teams such as developers, analysts, and operations to execute deliverables
  • 8+ years professional experience as a data Engineer
  • BS in Computer Science
  • MS in Computer Science preferred
  • AI Literacy / AI growth mindset
Job Responsibility
Job Responsibility
  • Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 10s of terabytes of data ingested every day and petabyte-sized data warehouse
  • Build quality data solutions and refine existing diverse datasets to simplified data models encouraging self-service
  • Build data pipelines that optimise on data quality and are resilient to poor quality data sources
  • Own the data mapping, business logic, transformations and data quality
  • Low level systems debugging, performance measurement & optimization on large production clusters
  • Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • Healthcare (medical, dental, and vision)
  • Life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Time off in accordance with local leave policies
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

As a Senior Data Engineer, you'll design, build, and operate scalable, reliable ...
Location
Location
Croatia
Salary
Salary:
Not provided
mypos.com Logo
myPOS
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
  • 6+ years of experience as a Data Engineer, building and maintaining production-grade pipelines and datasets
  • Strong Python and SQL skills with a solid understanding of data structures, performance, and optimization strategies
  • Hands-on experience with orchestration (like Airflow, Dagster, Databricks Workflows) and distributed processing in a cloud environment
  • Experience with analytical data modeling (star and snowflake schemas), DWH, ETL/ELT patterns, and dimensional concepts
  • Experience building reliable incremental data ingestion pipelines from DBs and APIs
  • Familiarity with at least one major cloud provider (GCP, AWS, Azure) and deploying data solutions in the cloud
  • Familiarity with CI/CD for data pipelines, IaC (Terraform), and/or DataOps practices
  • Strong troubleshooting mindset: ability to debug issues across data, infra, pipelines, and deployments
  • Collaborative mindset and clear communication across engineering, analytics, and business stakeholders
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations
  • Develop and evolve scalable data architecture to meet business and performance requirements
  • Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics
  • Implement best practices for data quality, testing, monitoring, lineage, and reliability
  • Optimize workflows for performance, cost, and scalability (e.g., tuning Spark jobs, query optimization, partitioning strategies)
  • Ensure secure data handling and compliance with relevant data protection standards and internal policies
  • Contribute to documentation, standards, and continuous improvement of the data platform and engineering processes
  • Ensure secure, compliant handling of data and models, including access controls, auditability, and governance practices
  • Build and maintain MLOps automation: CI/CD for ML, environment management, artifact handling, versioning of data/models/code
What we offer
What we offer
  • Vibrant international team operating in hi-tech environment
  • Excellent compensation package
  • myPOS Academy for upskilling and training
  • Unlimited access to courses on LinkedIn Learning
  • Refer a friend bonus as we know that working with friends is fun
  • Teambuilding, social activities and networks on a multi-national level
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

I'm working with a leading global hedge fund that is looking to hire a Data Deve...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software and/or data engineering experience
  • Strong development experience in Python or C#, ideally both
  • Expert-level SQL skills
  • Strong experience with relational databases, data modelling and schema design
  • Experience building ETL pipelines and data-driven applications
  • Strong problem-solving ability and a genuine interest in understanding systems end-to-end
  • Excellent communication skills and the ability to work directly with business users
Job Responsibility
Job Responsibility
  • Design and develop data models, reporting solutions and analytics platforms
  • Build and enhance ETL pipelines and data processing workflows
  • Develop applications and tooling using Python
  • Design and optimise database schemas and reporting architectures
  • Create and tune complex SQL queries for reporting, reconciliation and analytics
  • Work directly with business stakeholders to gather requirements and deliver solutions
  • Support and modernise existing reporting and analytics platforms
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Well-known technology platform company is looking for a Senior Data Engineer to ...
Location
Location
United States , San Francisco
Salary
Salary:
155000.00 - 195000.00 USD / Year
strategicemployment.com Logo
Strategic Employment Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience
  • Strong Python development skills
  • Production experience with Airflow or other workflow orchestration tools
  • Experience building data pipelines in the public cloud (AWS, GCP, or Azure)
  • Strong communication (ex: push back, clarify, and manage expectations proactively)
Job Responsibility
Job Responsibility
  • Work directly with stakeholders to understand their data needs
  • Build and maintain production pipelines
  • Deliver high-quality data sets that drive business decisions
  • Be embedded within the business unit attending stakeholder meetings
  • Translate ambiguous requirements into technical specs
  • Manage your domain end to end
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Ready to lead data engineering that powers critical financial decisions at scale...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience leading small to medium sized engineering teams within agile delivery environments
  • Strong expertise in at least one server-side language such as Python, Java, Kotlin or NodeJS
  • Knowledge of serverless, event-driven, and loosely coupled architectures
  • Experience designing and integrating REST APIs and third-party services
  • Commercial experience working with React or React Native and state management libraries
  • Strong experience with CI/CD tooling such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development practices
  • Proven experience working within the energy industry
  • Ability to communicate complex technical concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Leading the day-to-day engineering capability within the Finance Data Squad
  • Delivering scalable data products and software components aligned to business priorities
  • Driving quality through code reviews, testing practices, and engineering standards
  • Mentoring and developing engineers to build capability and performance
  • Collaborating with product owners, architects, and stakeholders to deliver value-focused solutions
What we offer
What we offer
  • Competitive salary
  • Potential for an annual bonus
  • Market-leading pension scheme
  • Customisable benefits including electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin
Salary
Salary:
133000.00 - 188600.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant full-time experience
  • or equivalent knowledge
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field, or equivalent practical experience.
  • Strong proficiency in Scala, Python, SQL, Spark, and Databricks, with production-quality software engineering practices.
  • Strong experience building and supporting cloud-based ETL/ELT pipelines, data platforms, and pipeline orchestration patterns for both batch and streaming operations.
  • Experience deploying machine learning models into production environments and supporting model development through operational release.
  • Strong experience with Databricks jobs, workflows, repos, Unity Catalog, and MLflow-based experimentation and model lifecycle management.
  • Experience building CI/CD pipelines with Git-based workflows, automated testing, and deployment of data or ML products.
  • Strong troubleshooting, communication, and cross-functional collaboration skills.
Job Responsibility
Job Responsibility
  • Design and develop batch and streaming ETL/ELT pipelines in Azure Databricks to support ingestion, transformation, curation, and delivery of manufacturing and enterprise data
  • Build reusable Bronze, Silver, and Gold data pipelines, data quality frameworks, and governed data products in Unity Catalog
  • Build and operationalize ML workflows for data preparation, feature engineering, model training, evaluation, deployment, batch scoring, retraining, and inference
  • Establish and maintain MLflow-based model lifecycle controls, including experiment tracking, model registration, versioning, lineage, traceability, and controlled promotion across environments
  • Implement CI/CD pipelines for data products, ML code, workflows, and deployment bundles using Git-based development practices, automated testing, and release automation
  • Build and support Databricks jobs and workflows for orchestration, scheduled execution, retraining, scoring, and downstream operational consumption
  • Improve reliability, observability, and production readiness through testing, monitoring, validation, alerting, documentation, and automation that reduce deployment risk and manual intervention
  • Partner with data scientists, data engineers, platform teams, architecture, manufacturing, and business stakeholders to productionize scalable, supportable solutions aligned to production constraints
  • Support modernization of legacy data and ML workflows into standardized cloud-native Databricks patterns and help bridge proof-of-concept work into repeatable production solutions
What we offer
What we offer
  • Medical
  • Dental
  • Vision
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Tuition assistance programs
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

As a Data Engineer, you will join our Data Platform team and contribute to the d...
Location
Location
Poland , Cracow
Salary
Salary:
18000.00 - 23000.00 PLN / Month
medius.com Logo
Medius
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience developing with Python, including Pandas and PySpark
  • Strong SQL skills and experience working with large-scale datasets
  • Hands-on experience designing and implementing ETL/ELT processes in Data Lakehouse environments
  • Practical experience with Azure cloud services
  • Experience working with Apache Spark and Azure Databricks
  • Understanding of data modeling, data integration, and modern data engineering best practices
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data processing infrastructure and ETL/ELT pipelines on Azure
  • Build and optimize data solutions within Azure Databricks and Data Lakehouse environments
  • Deliver high-quality, reliable data to support AI/ML applications, analytics, reporting, and other data consumers
  • Ensure data governance, security, integrity, and availability across the data platform
  • Monitor, troubleshoot, and improve data workflows and platform performance
  • Collaborate with cross-functional teams to understand data requirements and implement effective solutions
  • Stay current with emerging technologies and best practices in data engineering
  • Share knowledge and contribute to continuous learning within the team
What we offer
What we offer
  • 26 days PTO
  • medical, dental, and vision coverage
  • paid time off
  • retirement benefits
  • variable compensation (performance bonus or commission)
  • Fulltime
Read More
Arrow Right