CrawlJobs Logo

Data Engineer

United Kingdom, London · Job Posted January 17, 2026
Apply Position
Job Link Share

Job Description

Octopus Energy is a global energy leader revolutionising the way people use energy. We're not just an energy supplier; we're a tech company building a cleaner, smarter energy future. The Global Energy Markets team makes sure we always have the electricity and gas we need to power our customers’ homes and businesses, while also supporting the grid to accelerate the transition to Net Zero. To deliver on this mission, we are looking for a Data Engineer to join the Energy Markets Engineering team and help us build efficient databases, APIs, pipelines and applications to ensure critical forecasting, trading, risk and PPA processes continue to run like clockwork. This is a chance to take on a role that blends complex data engineering, platform infrastructure, and business-critical problem-solving, all while helping transform the energy industry for the better.

Job Responsibility

  • Maintaining and developing our critical data applications - scoping and implementing architectural improvements for long-term global scalability and robustness
  • Growing our suite of self-service application monitoring tools and alerts to help team members debug live issues and understand historic root causes
  • Supporting different Energy Markets teams to design and build key operational and reporting pipelines and dashboards across all Octopus Energy global regions
  • Setting up and maintaining processes for capturing, preparing and loading valuable new data into the data lake
  • Working with international teams across the Octopus Energy Group to ensure everyone shares the best practises and code is standardised where possible
  • Taking ownership of data platform improvements that enhance the capabilities for all Energy Markets teams and drives trust in the stability of the setup

Requirements

  • Strong aptitude with SQL, Python and Airflow essential
  • Experience building efficient, scalable databases and APIs (e.g. Django, FastAPI) a huge plus
  • Experience in Kubernetes, Docker, Spark and related monitoring tools (e.g. DataDog, Grafana, Prometheus) for DataOps a huge plus
  • Experience with dbt for pipeline modelling also beneficial
  • Skilled at shaping needs into a solid set of requirements and designing scalable solutions to meet them
  • Able to quickly understand new domain areas and visualise data effectively
  • Team player excited at the idea of ownership across lots of different projects and tools
  • Passion for driving towards Net Zero
  • Drives knowledge sharing and documentation for a more effective platform
  • Open to travelling to Octopus offices across Europe and the US

Nice to have

  • Experience building efficient, scalable databases and APIs (e.g. Django, FastAPI)
  • Experience in Kubernetes, Docker, Spark and related monitoring tools (e.g. DataDog, Grafana, Prometheus) for DataOps
  • Experience with dbt for pipeline modelling

What we offer

  • Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary
  • Octopus Energy Group is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground
  • We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people
  • We’ve also been placed in the top 10 companies for senior leadership
  • Visit our UK perks hub - Octopus Employee Benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

We are looking for a highly motivated expert Data Engineer to design and develop...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration and performance tuning on big data processing
  • Strong understanding of AWS services
  • Ability to quickly learn, adapt, and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • Experience with streaming technologies such as Apache Kafka, Debezium, or similar platforms for real-time data processing and integration
  • Master’s /Bachelor’s degree and 5-8 years of Computer Science, IT, or related field experience
Job Responsibility
Job Responsibility
  • Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets
  • Build highly efficient data pipelines to migrate and deploy complex data across systems, with an understanding of biotech/pharma/manufacturing or related domains
  • Design and implement solutions to enable unified data access, governance, and interoperability across hybrid cloud environments
  • Ingest and transform structured and unstructured data from databases (PostgreSQL, MySQL, SQL Server, MongoDB, etc.), APIs, logs, event streams, images, PDFs, and third-party platforms
  • Ensure data integrity, accuracy, and consistency through rigorous quality checks and monitoring
  • Innovate, explore, and implement new tools and technologies to enhance efficient data processing
  • Proactively identify and implement opportunities to automate tasks and develop reusable frameworks
  • Work in an Agile and Scaled Agile (SAFe) environment, collaborating with cross-functional teams, product owners, and Scrum Masters to deliver incremental value
  • Use JIRA, Confluence, and Agile DevOps tools to manage sprints, backlogs, and user stories
  • Support continuous improvement, test automation, and DevOps practices in the data engineering lifecycle
Read More
Arrow Right

Data Engineer

We are looking for a skilled Data Engineer to join our team on a long-term contr...
Location
Location
United States , New York
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in implementing and managing Snowflake and Palantir platforms
  • Strong proficiency in programming languages such as Python for data manipulation and analysis
  • Expertise in working with Apache Spark, Hadoop, and Kafka for large-scale data processing
  • In-depth knowledge of ETL processes and tools to handle complex data workflows
  • Familiarity with building and optimizing data pipelines and architectures
  • Ability to troubleshoot and resolve data system issues in a timely manner
  • Excellent problem-solving skills and attention to detail
  • Strong communication skills to collaborate effectively with cross-functional teams
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data pipelines to support efficient data integration and processing
  • Implement and manage Snowflake-based data repositories to centralize and secure organizational data
  • Utilize Palantir to standardize and analyze data across multiple divisions, ensuring consistency and accuracy
  • Develop ETL processes to extract, transform, and load data from various sources into centralized systems
  • Collaborate with stakeholders to define data requirements and optimize system performance
  • Leverage tools like Apache Spark, Hadoop, and Kafka to build scalable data solutions
  • Monitor and troubleshoot data systems to ensure reliability and address any issues promptly
  • Deploy advanced analytics and AI models to drive operational efficiencies
  • Document processes and provide technical support to ensure smooth implementation and usage of data systems
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Read More
Arrow Right

Data Engineer

As a Data Engineer, you will take ownership of major parts of our data platform ...
Location
Location
Hungary , Budapest
Salary
Salary:
Not provided
lensa.com Logo
Lensa
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience in data engineering or a related field
  • Strong programming skills in Python and SQL (CTEs, window functions, complex joins, stored procedures)
  • Experience building batch and real-time data pipelines with Spark, Flink or similar frameworks
  • Solid understanding of ETL/ELT workflows, CI/CD pipelines, and production-grade deployment practices
  • Strong knowledge of data modeling, Redshift or similar MPP data warehouses, and distributed systems
  • Experience with AWS or other cloud provider services (EC2, Lambda, Step Functions, Glue, Redshift, S3)
  • Ability to operate independently, solve complex problems, and make sound technical decisions
  • Excellent communication skills and ability to work with both technical and non-technical stakeholders
  • Solid communication skills in English
Job Responsibility
Job Responsibility
  • Design data structures, batch and streaming pipelines, and processes for large-scale analytics and machine learning
  • Design, optimize and implement robust ETL/ELT workflows to feed Data Warehouse (Redshift) and other analytical layers for reporting, analytics, and operational use cases
  • Maintain, improve, and troubleshoot production pipelines, ensuring high reliability and performance
  • Own the architecture and development of core data systems end-to-end
  • Mentor Mid-Level and Junior Engineers and provide guidance on best practices, workflow standards, and troubleshooting
  • Collaborate closely with Data Scientists, Product, and Engineering teams to translate business requirements into scalable data solutions
  • Document systems, pipelines, and architecture
  • maintain runbooks and operational guides
  • Identify technical risks, propose solutions, and drive improvements in platform design, reliability, and performance
  • Participate in code reviews, provide technical mentorship, and help establish best practices
What we offer
What we offer
  • Flexible working hours with home office opportunity
  • Medicover health insurance
  • Company lunch every day in the office
  • In-house gym in the office
  • Exciting programs and team-building events
  • Recreation room with darts, ping pong, foosball, XBox, and other games
  • Modern and fancy office in Buda close to Széll Kálmán tér
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Microsoft’s mission is to empower every person and every organization on the pla...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Formulate business problems and translate them into actionable data science projects
  • Explore, analyze, and centralize data to supply meaningful insights and create a single version of the truth
  • Design, prototype, implement, and test descriptive, predictive, forecasting, and causal inference models
  • Identify and action IT operations return to capacity success improvement
  • perform defect analysis, quantify opportunities, and set targets
  • Partner and collaborate with teams to identify opportunities for machine learning and predictive analysis
  • Build and deploy visualizations that deliver insights to decision-makers at all organizational levels
  • Communicate effectively with technical and non-technical audiences, contributing modeling expertise as a team player
  • Influence across disciplines to ensure data-driven decisions and solve critical problems for customers
  • Mentor others and foster a culture of continuous learning
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a Data Engineer to design and build scalable data pipelines and p...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience in cloud environments (AWS and/or Azure)
  • Hands‑on experience with Databricks, Apache Spark, and Delta Lake
  • Strong skills in Python / PySpark and SQL
  • Experience with data pipelines, ETL/ELT, and data modeling
  • Familiarity with orchestration tools (Airflow or similar) and modern data architectures
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines using Databricks, Spark, and cloud-native services
  • Develop and optimize ETL/ELT workflows for batch and streaming data across AWS and Azure environments
  • Build and manage data models, data lakes, and warehousing solutions for analytics and AI use cases
  • Ensure data quality, reliability, and governance across the data lifecycle
  • Collaborate with data science, analytics, and platform teams to deliver data solutions
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to join a real estate and property organizati...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Microsoft Fabric and/or Azure Data Factory, including building and optimizing pipelines
  • Proven background working with Azure data services and cloud-based data architecture
  • Advanced experience with data modeling, complex querying, and performance tuning in enterprise data platforms
  • Solid programming skills in Python, Java, Scala, or a comparable language used in data engineering
  • Experience with ETL development, relational databases, and data warehousing concepts
  • Familiarity with technologies such as Apache Spark, Hadoop, or Kafka in support of large-scale data processing
  • Ability to work effectively as an individual contributor in a lean team environment with high accountability
  • Exposure to Power BI or Tableau, along with the ability to align technical solutions with business needs
Job Responsibility
Job Responsibility
  • Design, build, and enhance end-to-end data pipelines using Microsoft Fabric and/or Azure Data Factory for production use
  • Manage and improve the data environment with a strong ownership mindset, ensuring performance, reliability, and maintainability
  • Integrate data from varied sources such as APIs, databases, and flat files into structured, usable datasets
  • Develop data models and schema designs that support reporting, analytics, and downstream business needs
  • Monitor data quality and implement validation checks, troubleshooting issues through root cause analysis and continuous optimization
  • Create scalable cloud-based data solutions within Azure that support long-term operational and analytical goals
  • Partner with cross-functional stakeholders to translate business questions into practical data engineering solutions
  • Contribute to orchestration, automation, and ongoing support of data workflows using modern engineering tools and programming languages
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

We’re on the lookout for a Data Engineer to join us on a 12-month fixed-term con...
Location
Location
United Kingdom , Nottingham
Salary
Salary:
45000.00 GBP / Year
microlise.com Logo
Microlise
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Strong experience building SQL-based pipelines and transformations
  • Solid understanding of data modelling and structured datasets
  • Experience working with data quality, governance, or metadata concepts
  • A collaborative mindset with the ability to translate business needs into data solutions
  • Someone who thrives in a fast-paced, delivery-focused environment
Job Responsibility
Job Responsibility
  • Build and maintain robust data pipelines and transformations
  • Create curated, analytics-ready datasets aligned to business logic
  • Translate business requirements into data structures and reusable models
  • Apply and monitor data quality checks and validation rules
  • Support data governance, metadata and lineage standards
  • Collaborate with stakeholders to understand data usage and requirements
  • Deliver datasets that directly support Analytics & AI teams
What we offer
What we offer
  • 37.5 hour week with flexible working opportunities
  • Access to our salary sacrifice EV Car Scheme
  • Private medical insurance with Vitality Health including rewards
  • 25 days holiday, excluding bank holidays, increasing with service
  • Invested in employee health and well-being with over 20 mental health first aiders
  • Employee Assistance Programmes
  • Free Costco membership, 20% off EE mobile and line rental, and other local discounts
  • Great staff extras: Easter eggs, yearly BBQ, Christmas gifts and annual staff awards
  • Free Microlise Cresswell Racing Tickets
  • Executive Box at Motorpoint Arena Nottingham
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a growing financial services organiza...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-8 years of experience in data engineering or a closely related field
  • Strong hands-on background in building and supporting ETL or data pipeline solutions
  • Proven experience working with Snowflake in a production environment
  • Proficiency in Python for scripting, automation, and data processing tasks
  • Familiarity with modern cloud platforms
  • Experience with data ingestion technologies such as Fivetran or similar platforms
  • Ability to work through imperfect or incomplete data while communicating clearly with technical and business partners
Job Responsibility
Job Responsibility
  • Design and support data workflows that collect, refine, and deliver information across a contemporary cloud ecosystem
  • Develop and enhance scalable data pipelines using Python and automated ingestion platforms such as Fivetran or comparable tools
  • Model and transform datasets within Snowflake to enable reliable analytics and downstream business intelligence reporting
  • Collaborate closely with the data architect to expand and improve the organization’s overall data infrastructure
  • Contribute to reporting readiness by preparing curated datasets for visualization tools including Power BI and Sigma
  • Monitor pipeline performance and resolve data issues to maintain accuracy, consistency, and dependable delivery
  • Assess emerging technologies and recommend practical additions to the data stack as business needs evolve
  • Work effectively in a fast-paced team environment where priorities can shift and new tooling may be introduced regularly
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right