CrawlJobs Logo
DataCareers Logo DataCareers · IT - Software Development

Data Engineer (Cloud Architecture)

United Kingdom, East Midlands · Job Posted June 29, 2026
Apply Position
Job Link Share

Job Description

Data Careers is supporting a secure public sector organisation in the East Midlands in the search for an experienced Data Engineer / Cloud Architect. This is a key role within a growing data function focused on building modern cloud-based data capabilities. You'll play a central role in designing, developing and supporting the data platforms, pipelines and architectures that enable intelligence, operational insight, performance reporting and data-driven decision-making.

Job Responsibility

  • Design, develop and maintain modern cloud-based data pipelines
  • Build and support ETL and ELT processes across multiple source systems
  • Configure and administer Microsoft Fabric data environments
  • Design and implement data ingestion and landing strategies
  • Develop scalable data architectures using Medallion Architecture principles
  • Deliver API integrations and automated data workflows
  • Support data quality, governance and compliance requirements
  • Collaborate with analysts and stakeholders to develop effective data solutions
  • Contribute to the ongoing development of data engineering standards and best practice

Requirements

  • UK-based
  • Continuously resided in the UK for a minimum of five years
  • Eligible to obtain NPPV3 and SC clearance
  • Microsoft Fabric implementation, configuration or administration
  • Data engineering and ETL/ELT development
  • Data ingestion and integration from multiple source systems
  • Cloud-based data platform experience, ideally Azure
  • API integration and data pipeline development
  • SQL and data modelling expertise
  • Experience working with large and complex datasets
  • Strong understanding of modern data architecture principles

Nice to have

  • Medallion Architecture (Bronze, Silver, Gold)
  • Azure Data Factory, Synapse or related Azure data services
  • Public sector, policing or regulated environment experience
  • Existing SC or NPPV clearance
DataCareers - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer (Cloud Architecture)

8 matching positions

Data Engineer (Big Data, Cloud - AWS, Databricks) - Assistant Vice President

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Scala, Spark/Pyspark is must, Hadoop ( BIG Data ), + AWS,Databricks
  • 8 to 11 years’ experience implementing data-intensive solutions using agile methodologies
  • Experience of relational databases and using SQL for data querying, transformation and manipulation
  • Experience of modelling data for analytical consumers
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • Experience in cloud native technologies and patterns
  • A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • An inclination to mentor
  • an ability to lead and deliver medium sized components independently
Job Responsibility
Job Responsibility
  • Developing and supporting scalable, extensible, and highly available data solutions
  • Deliver on critical business priorities while ensuring alignment with the wider architectural vision
  • Identify and help address potential risks in the data supply chain
  • Follow and contribute to technical standards
  • Design and develop analytical data models
  • Fulltime
Read More
Arrow Right

Fabric Data Engineer / Azure Data Engineer

Location
Location
Salary
Salary:
Not provided
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on Data Engineer with strong Microsoft Fabric experience, including Lakehouse, OneLake, Data Factory/Pipelines, Warehousing, and Fabric ecosystem services
  • Strong Python development skills for data engineering, data transformation, automation, and pipeline development
  • Experience working with Microsoft Fabric Lakehouse architecture, including data ingestion, transformation, storage, and analytics enablement
  • Strong understanding of data engineering fundamentals, including data modeling, partitioning, optimization, and performance tuning
  • Experience supporting Azure Data Platform technologies, including Azure Data Factory, Azure Synapse Analytics, Azure Storage, and related services
  • Ability to work within large-scale enterprise data environments supporting multiple business units and data domains
  • Knowledge of Medallion Architecture (Bronze, Silver, Gold) and practical implementation of modern data lakehouse solutions
  • Experience integrating and transforming structured and semi-structured data sources including APIs, databases, JSON, CSV, and cloud-based systems
  • Understanding of Fabric operational monitoring, capacity consumption monitoring, and platform governance best practices
  • Ability to clearly explain and demonstrate the distinction between Fabric Files, Tables, Lakehouses, Warehouses, and OneLake storage concepts
Job Responsibility
Job Responsibility
  • Design, build, and support scalable ETL/ELT data pipelines across enterprise Azure environments
  • Ability to support integration across multiple systems, applications, databases, and cloud platforms
Read More
Arrow Right

Data Engineer – Cloud and Analytics Platforms

As a Data Engineer, you will be the foundational backbone of our data analytics ...
Location
Location
Canada , Calgary
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
August 02, 2026
Flip Icon
Requirements
Requirements
  • Minimum of 3+ years in a dedicated Data Engineering role or a Software Developer role with a strong focus on data-backend development and complex transformations
  • Excellent, production-level knowledge of Python
  • Strong knowledge of SQL paired with a deep understanding of performance analysis and query optimization techniques
  • Rigid grasp of computer science fundamentals, including modularity, abstraction, data structures, and algorithms
  • Solid understanding of core data modeling concepts (normalized vs. denormalized data architectures, conceptual/logical/physical models, and star/snowflake schemas)
  • Proven experience building automated, production-grade ETL/ELT pipelines
  • Solid project experience leveraging various data storage technologies (including RDBMS, NoSQL, and Graph Databases)
  • Direct experience with cloud infrastructure provisioning and deployment automation on AWS
Job Responsibility
Job Responsibility
  • Build, improve, and maintain data infrastructure for ingesting, storing, and transforming data across advanced analytical workflows
  • Implement robust, scalable data pipelines supporting both stream and batch processing
  • Perform end-to-end ETL/ELT processes to extract and load data from a wide variety of structured and unstructured sources
  • Partner with enterprise architects and Information Services (IS) teams to design and evolve the overarching data platform environment in AWS
  • Write complex, automated SQL queries to manipulate data extracts and manage large-scale data flows
  • Perform continuous query optimization, performance analysis, and database tuning to minimize processing latency and cost
  • Assist with logical and physical data modeling, implementing optimized data structures (e.g., star and snowflake schemas)
  • Automate cloud deployments, data flows, and automated data quality validation checks
  • Collaborate closely with Data Scientists and ML developers to build, test, and operationalize automated ML pipelines
  • Design rigorous testing processes, formulating and executing comprehensive test cases for data validation
  • Fulltime
Read More
Arrow Right

Cloud Data Engineer

We are looking for an experienced Cloud Data Engineer with strong expertise in b...
Location
Location
India , Bangalore South
Salary
Salary:
Not provided
votredircom.fr Logo
Wissen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience with AWS (ETL, data services)
  • Expertise with structured and unstructured (OCR) data
  • Knowledge of streaming data tools
  • Proficiency in SQL
  • Strong Python programming skills
  • Hands-on experience with PySpark
  • Experience with Airflow for workflow orchestration
  • Excellent communication skills
Job Responsibility
Job Responsibility
  • Design and develop scalable ETL pipelines using AWS cloud services
  • Build data ingestion frameworks for structured and unstructured (OCR-based) data
  • Develop and optimize SQL queries and data transformation logic
  • Orchestrate workflows using Airflow
  • Develop big data solutions using Python and PySpark
  • Build and maintain streaming data pipelines
  • Ensure data quality, performance, and reliability
  • Collaborate with cross-functional teams to gather requirements
  • Document architecture, workflows, and processes
  • Fulltime
Read More
Arrow Right

Cloud Data Engineer

Hunkemöller is looking for a Cloud Data Engineer to take a core role in our digi...
Location
Location
Netherlands , Hilversum
Salary
Salary:
Not provided
hunkemoller.de Logo
Hunkemöller
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3 to 5 years of hands-on experience in data engineering, with a strong focus on data integration, APIs, and pipeline architecture
  • A strong desire to learn quickly and adapt to new technologies
  • Strong Python programming skills with a proven track record of building custom API extractors, handling pagination, rate limiting, and working with REST/GraphQL endpoints
  • Hands-on experience with Google Cloud Platform's ecosystem, specifically Cloud Composer, Dataflow, Cloud Run, and Firestore
  • Proficient in writing clean, well-documented, and tested code (e.g., pytest), with strong experience using Git, Docker, and CI/CD pipelines
  • Excellent written and verbal English communication skills
Job Responsibility
Job Responsibility
  • Build Ingestion Pipelines: Design, develop, and deploy robust data ingestion pipelines from various third-party APIs, webhooks, and source systems into Google Cloud
  • AI-Augmented Engineering: Actively leverage advanced AI coding assistants to accelerate pipeline development, generate boilerplate API connection code, debug complex scripts, and automate repetitive tasks
  • GCP Infrastructure & Orchestration: Build and manage data workflows using Cloud Composer (Airflow), and leverage Cloud Run and Dataflow for scalable, containerized data processing
  • Drive Reverse ETL: Architect and maintain the data pipelines that push refined data from BigQuery back into our operational platforms (marketing tools, CRM, etc.) to drive business action
  • Manage Operational Databases: Utilize Firestore and other NoSQL/relational databases to support operational data needs and microservices
  • Collaborate and Learn: Partner with our data modeling specialists to ensure smooth handoffs between ingestion and transformation
  • Participate in code reviews and continuously share new engineering best practices
  • Fulltime
Read More
Arrow Right

Senior Google Cloud Data Engineer

We are seeking a Senior Google Cloud Data Engineer with a strong background in d...
Location
Location
United States , New York City
Salary
Salary:
170000.00 - 240000.00 USD / Year
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Candidates must be legally authorized to work in the United States and must hold either U.S. citizenship or lawful permanent resident (Green Card) status.
  • Strong expertise in Python - for building data pipelines, processing tasks, and automation
  • SQL - Advanced SQL capabilities (nested fields, analytic functions)
  • Hands-on experience with Core GCP Data Stack: BigQuery: Expert-level SQL, performance tuning, and specifically BigQuery ML (BQML) for implementing logistic regression or k-means clustering on data in-place
  • Dataflow (Apache Beam): Strong proficiency in writing data pipelines (Python or Java) handling windowing, watermarks, and triggers for streaming data
  • Pub/Sub: Experience with event-driven architecture and message queuing
  • Hands-on experience with Visualization & BI: Looker Core – Advanced proficiency in LookML (not just drag-and-drop), including derived tables, explores, and Liquid syntax
  • Semantic Modeling: Develop robust LookML models to create a trusted layer of data governance, ensuring metrics are consistent across the organization
  • Dashboard Creation: Design intuitive, high-impact dashboards in Looker for two distinct audiences: Operational teams (real-time threat monitoring) and Executives (risk posture and compliance reporting
  • Familiarity with Alerting Frameworks
Job Responsibility
Job Responsibility
  • Drive projects independently, ensuring timely delivery and high-quality outcomes
  • Lead and execute projects related to cybersecurity, including anomaly detection in data to identify potential security threats
  • Develop dashboards and visuals for operational and executive use, leveraging Looker Core and BigQuery
  • Implement alerting systems to proactively detect anomalies and security issues
  • Design and implement data ingestion and transformation pipelines leveraging Google Cloud Dataflow / Apache Beam and BigQuery for analytics and large-scale querying
  • Implement Machine Learning models (specifically leveraging BigQuery ML or Vertex AI) to identify statistical outliers, potential intrusions, and fraudulent patterns in network traffic
  • Build fault-tolerant, self-healing, adaptive, and highly accurate streaming and batch data pipelines on GCP
  • Perform data manipulation and analysis to support threat detection and reporting
  • Collaborate closely with cross-functional teams to ensure data quality, availability, and reliability across cloud environments
  • Develop and maintain technical documentation for all assigned systems and projects
What we offer
What we offer
  • Flexibility, with remote and hybrid work options (country-dependent)
  • Career advancement, with international mobility and professional development programs
  • Learning and development, with access to cutting-edge tools, training and industry experts
  • Medical, dental, and vision insurance for you and your family, plus employer contributions to Health Savings Accounts
  • Fulltime
Read More
Arrow Right

Senior Google Cloud Data Engineer

We are seeking a Senior Data Engineer with a strong background in data engineeri...
Location
Location
Canada
Salary
Salary:
90000.00 - 140000.00 CAD / Year
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong expertise in Python for building data pipelines, processing tasks, and automation
  • Advanced SQL capabilities (nested fields, analytic functions)
  • Hands-on experience with Core GCP Data Stack: BigQuery, Dataflow (Apache Beam)
  • Strong proficiency in building reliable batch and incremental pipelines for GA4/Google Ads data into BigQuery
  • Experience with Pub/Sub: event-driven architecture and message queuing
  • Hands-on experience with Visualization & BI: Looker Core – Advanced proficiency in LookML
  • Ability to independently own workstreams while collaborating closely with data science, analytics, and engineering peers in agile delivery
  • Advanced English skills
Job Responsibility
Job Responsibility
  • Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data pipelines
  • Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
  • Provide consultation and lead the implementation of complex programs
  • Develop and maintain documentation relating to all assigned systems and projects
  • Tune queries running over billions of rows of data running in a distributed query engine
  • Perform root cause analysis to identify permanent resolutions to software or business process issues
  • Implement and maintain dbt transformation models, CI pipelines, and data contracts for curated campaign, ad group, keyword, audience, and landing-page marts
  • Build and monitor data quality gates (Great Expectations and reconciliation checks) and freshness SLOs
  • Optimize BigQuery cost and performance using query tuning, storage design, and reservation strategy
  • Implement platform hardening controls including retries, dead-letter queues, DR runbooks, and support for VPC-SC and DLP validation
What we offer
What we offer
  • A comprehensive insurance plan
  • Dialogue via Sun Life provides virtual healthcare services
  • Access to the Employee and Family Assistance Program
  • A complete mental health support program
  • A $500 Personal Spending Account
  • A retirement plan where Valtech will match 100% of your RRSP contributions through a Deferred Profit Sharing Plan (DPSP), up to a maximum of 4%
  • Access to a flexible vacation under Valtech's policy
  • Personal Technology Reimbursement – $30/month
  • We close during the winter holidays and offer flexible scheduling throughout the year
  • Fulltime
Read More
Arrow Right

Senior Google Cloud Data Engineer

We are seeking a Senior Data Engineer with a strong background in data engineeri...
Location
Location
Brazil
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong expertise in Python for building data pipelines, processing tasks, and automation
  • Advanced SQL capabilities (nested fields, analytic functions)
  • Hands-on experience with Core GCP Data Stack: BigQuery (expert-level SQL, performance tuning, partitioning and clustering strategy, production-grade curated marts and feature tables, working knowledge of BQML)
  • Dataflow (Apache Beam)
  • Strong proficiency in building reliable batch and incremental pipelines for GA4/Google Ads data into BigQuery, with streaming patterns
  • Pub/Sub: Experience with event-driven architecture and message queuing
  • Hands-on experience with Visualization & BI: Looker Core – Advanced proficiency in LookML (derived tables, explores, Liquid syntax)
  • Semantic Modeling: Develop robust LookML models
  • Dashboard Creation: Design intuitive dashboards in Looker for operational teams and executives
  • Ability to independently own workstreams while collaborating closely with data science, analytics, and engineering peers in agile delivery
Job Responsibility
Job Responsibility
  • Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data pipelines
  • Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
  • Provide consultation and lead the implementation of complex programs
  • Develop and maintain documentation relating to all assigned systems and projects
  • Tune queries running over billions of rows of data running in a distributed query engine
  • Perform root cause analysis to identify permanent resolutions to software or business process issues
  • Implement and maintain dbt transformation models, CI pipelines, and data contracts for curated campaign, ad group, keyword, audience, and landing-page marts
  • Build and monitor data quality gates (Great Expectations and reconciliation checks) and freshness SLOs
  • Optimize BigQuery cost and performance using query tuning, storage design, and reservation strategy
  • Implement platform hardening controls including retries, dead-letter queues, DR runbooks, and support for VPC-SC and DLP validation
What we offer
What we offer
  • Growth opportunities
  • A values-driven culture
  • International careers
  • The chance to shape the future of experience
  • An environment designed for continuous learning, meaningful impact, and professional growth
  • A workplace culture that fosters creativity, diversity and autonomy
  • A borderless, global framework, which enables seamless collaboration
Read More
Arrow Right