CrawlJobs Logo

Lead Data Migration Engineer

United Kingdom, London · Job Posted June 14, 2026
Apply Position
Job Link Share

Job Description

We are seeking an accomplished and detail-oriented Lead Data Migration Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data migration, ETL/ELT pipeline engineering, and cloud-native data platforms, with a strong focus on AWS-based Data Lakehouse architectures. This role is critical in designing, building, and validating end-to-end data migration pipelines, enabling the seamless transition of data from legacy data warehouses to modern cloud platforms. You will play a key role in ensuring data quality, integrity, and performance, particularly through robust testing and validation of ETL pipelines. As a senior practitioner, you will collaborate with architects, engineers, and analysts to deliver secure, scalable, and high-performing migration solutions, leveraging technologies such as AWS Glue, Apache Iceberg, Python/PySpark, SQL, and YAML-based configurations. You will thrive in a collaborative, client-facing environment, with a passion for solving complex data challenges, ensuring delivery excellence, and driving modernisation through data migration initiatives.

Job Responsibility

  • Work as a senior engineer within data migration programmes, supporting delivery across complex transformation initiatives
  • Collaborate with architects and stakeholders to implement migration strategies and technical solutions
  • Contribute to project planning, estimation, and execution of migration deliverables
  • Design, build, and optimise data migration pipelines from legacy data warehouses to AWS-based Data Lakehouse platforms
  • Develop and maintain ETL/ELT pipelines using AWS Glue, Python/PySpark, SQL, and YAML-driven configurations
  • Implement bulk data migration processes followed by incremental/delta loads
  • Support pipeline repointing and replatforming to target cloud architectures
  • Test end-to-end ETL data solutions running on AWS services, including AWS Glue and Apache Iceberg
  • Validate data feed pipeline migrations transitioning to new AWS Data Lakehouse architectures
  • Test pipelines underpinned by AI ETL accelerators, Python/PySpark transformations, SQL-based logic, and YAML configuration-driven orchestration
  • Execute and validate initial bulk data loads and subsequent incremental/delta migrations
  • Develop and run SQL-based validation and reconciliation queries to ensure data completeness, accuracy, and transformation correctness
  • Support creation of automated testing and validation frameworks
  • Work hands-on with AWS cloud services, including AWS Glue and S3-based data lakes
  • Support implementation of Data Lakehouse architectures, including Apache Iceberg
  • Optimise data pipelines for performance, scalability, and reliability in cloud environments
  • Apply data transformation logic aligned to migration mapping rules
  • Support data modelling activities required for target-state schemas
  • Ensure consistency between source and target systems during migration
  • Collaborate with Solution Architects, Data Engineers, Data Migration Architects, Analysts and QA teams
  • Promote engineering best practices, reusable components, and automation
  • Contribute to migration accelerators and reusable frameworks
  • Ensure data integrity, quality, and traceability throughout migration processes
  • Follow best practices for secure data handling in regulated environments
  • Support compliance with GDPR and UK public sector data requirements where applicable
  • Contribute to audit and validation processes

Requirements

  • Proven experience in data engineering and data migration delivery, particularly within cloud environments
  • Strong focus on data pipeline testing, validation, and quality assurance
  • Ability to work across the full data lifecycle, with emphasis on migration and transformation
  • Strong analytical, problem-solving, and communication skills
  • Experience working in client-facing and delivery-focused environments
  • Ability to mentor junior engineers and contribute to team delivery
  • Strong hands-on experience with AWS cloud services, especially AWS Glue
  • Python / PySpark for data transformation
  • SQL for querying, validation, and reconciliation
  • YAML configuration for pipeline orchestration
  • Experience testing and validating end-to-end ETL/ELT pipelines and data migration workflows
  • Familiarity with Apache Iceberg and Lakehouse architectures
  • Distributed processing frameworks (e.g., Apache Spark)
  • Data lake environments
  • Understanding of ETL vs ELT design patterns
  • Migration performance tuning

Nice to have

Experience with version control and CI/CD tools desirable

What we offer

  • Flexible work options
  • Support for physical, emotional, and financial wellbeing
  • Continuous growth and development opportunities

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Lead Data Migration Engineer

8 matching positions

Lead Data Migration Engineer with .NET

You will lead the data migration workstream for a compliance-critical public-sec...
Location
Location
Poland , Wrocław; Bielsko-Biała
Salary
Salary:
145.00 - 170.00 PLN / Hour
cshark.com Logo
Cshark
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience with large-scale data migration projects: ETL, transformation pipelines, cutover planning
  • Hands-on experience with event sourcing (relational-to-event model transformation): decomposing relational data into domain events with deterministic ordering
  • Experience with legacy database analysis: reverse-engineering un(der)documented schemas, understanding data semantics and relationships without complete documentation
  • Experience with data quality handling: nulls, duplicates, inconsistent formats, missing fields, validation rules
  • Familiarity with document/file migration at scale: metadata extraction, filename parsing, large-volume validation and dealing with corrupted or ambiguous data or metadata
  • Strong knowledge of backend design patterns (dependency injection, repository, mediator, factory)
  • English language skills (B2+ minimum): required for clear communication with stakeholders and documentation of architectural decisions
  • Hands-on experience with CQRS, Domain-Driven Design, and Event Sourcing
  • Ability to design and implement aggregates, entities, value objects, and bounded contexts
  • Skilled in building systems that enforce clear separation of concerns, scalability, and maintainability
Job Responsibility
Job Responsibility
  • Lead the data migration workstream for a compliance-critical public-sector registry system
  • Converting a fully normalised relational database into an event-sourced architecture, migrating large volumes of document files, and ensuring every data related decision is documented and approved by the client
What we offer
What we offer
  • 100% remote work
  • Flexible hours
  • International projects
  • Business english lessons
  • Participation in charity actions
  • In-house technology workshops
  • Fulltime
Read More
Arrow Right

Forward Deployed Engineer - Data Migration & Data Consolidation Platforms

As a Forward Deployed Engineer (FDE) for Data Migration & Data Consolidation Pla...
Location
Location
United States
Salary
Salary:
Not provided
rackspace.com Logo
Rackspace
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-10+ years of progressive experience in enterprise data engineering, data migration, or large-scale system integration roles within complex, multi-platform environments
  • 3-5+ years directly leading end-to-end data migration or multi-system consolidation programs for Global Enterprises and Industry Leaders, with full ownership of technical delivery and client outcomes
  • Demonstrated client-facing experience serving as a trusted technical advisor to C-level executives, enterprise architecture teams, and cross-functional business stakeholders
  • Proven industry depth in at least two of the following verticals: Healthcare, Financial Services, Manufacturing, Retail, Energy & Utilities, or Public Sector
  • Hands-on migration complexity: successfully delivered programs involving at least 3+ heterogeneous source systems, 100M+ records, complex master data harmonization, and multi-phase cutover execution
  • Advanced proficiency in Python and SQL with working experience in PySpark and TypeScript/JavaScript
  • Hands-on expertise with modern ETL/ELT and data integration platforms (Informatica, Talend, Matillion, Fivetran, AWS Glue, Azure Data Factory)
  • Proven ability to build scalable, version-controlled data pipelines with error handling, incremental loading, and Change Data Capture (CDC)
  • Strong working knowledge of at least one major cloud provider (AWS, Azure, or GCP), including core infrastructure, managed data services, and security configurations
  • Experience with enterprise data warehouse and lakehouse platforms (Snowflake, Databricks, BigQuery, Redshift, Synapse Analytics, Delta Lake)
Job Responsibility
Job Responsibility
  • Migration Execution & Cloud Architecture: Lead end-to-end delivery of enterprise data migrations from corporate systems (SAP, Oracle, Epic ERP) to target cloud data platforms, including the design of cloud landing zones, data governance frameworks, and system rationalization strategies. Establish migration compliance controls, automated rollback procedures, and operational readiness gates while owning full technical accountability for 12–18+ month migration roadmaps
  • Data Pipeline Engineering & Transformation: Build production-grade data connectors to SAP (RFC, IDoc, BAPI, OData), Oracle (AQ, GoldenGate, APIs), and SQL/non-relational sources. Develop ETL/ELT pipelines with LLM-enabled transformation logic, multi-layer validation and reconciliation frameworks, and optimized throughput for datasets scaling from tens of millions to billions of records with built-in CDC and incremental loading
  • Ontology Layer Development & Schema Automation: Construct semantic ontology layers translating raw ERP structures into business-consumable objects (Customer, Order, Invoice, Product, Vendor, Asset). Deploy automated schema mapping agents for source-to-target analysis and transformation logic generation. Build unified master data models with row/column-level security, cross-system lineage tracking, and AI-ready semantic structures
  • Application & Workflow Delivery: Build operational dashboards, migration control centers, and agent-driven workflows for automated validation, exception handling, and anomaly detection using low-code platform tools. Generate TypeScript/Python SDKs for custom integrations and deliver real-time monitoring and self-service interfaces for migration progress, data quality KPIs, and compliance tracking
  • Multi-System Consolidation & Master Data Management: Lead consolidation of 5–15+ fragmented ERP instances into standardized master data models. Resolve complex entity resolution challenges including customer matching, product harmonization, and chart of accounts unification. Establish golden record frameworks, data quality scorecards, survivorship rules, and data stewardship workflows for post-migration governance
  • Client Engagement, Discovery & Modernization Advisory: Serve as primary technical advisor to C-suite and enterprise architecture stakeholders across all engagement phases. Deploy discovery agents to analyze legacy data estates, conduct assessment workshops, facilitate solution design sessions, and deliver executive briefings, go/no-go readiness assessments, and prioritized modernization roadmaps
  • Knowledge Transfer, Enablement & IP Development: Build reusable migration accelerators, playbooks, and reference architectures that scale across engagements. Lead knowledge transfer to upskill client teams for post-migration ownership and collaborate with internal product and sales engineering teams to feed field insights back into platform development and delivery methodology
  • Leadership & Executive Engagement: Operate autonomously in ambiguous, high-stakes client environments, driving outcomes with minimal oversight
  • translate deeply technical concepts into clear, business-level narratives for C-suite audiences through executive briefings and stakeholder communications
  • navigate organizational complexity, competing stakeholder priorities, and enterprise change management dynamics to maintain momentum across multi-workstream engagements
Read More
Arrow Right

Lead Data Migration Architect

We are seeking a Lead Data Migration Architect to lead the design, assurance, an...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Recent experience as a Lead Data Migration Architect, Lead Data Architect, or Data Solutions Architect in migration-focused programmes
  • Demonstrated ownership of end-to-end data migration strategy, execution, and testing assurance
  • Experience operating in consulting, systems integration, or delivery partner roles
  • Proven leadership of cross-functional migration teams, including engineers, testers, and architects
  • Experience working within UK Central Government or ALBs strongly preferred
  • Strong experience designing and delivering large-scale data migration solutions
  • Experience designing end-to-end data migration architectures from legacy systems to cloud platforms
  • Experience defining migration strategies including bulk data loads followed by incremental/delta processing
  • Re-platforming and repointing of data pipelines
  • Experience leading migration programmes from legacy data warehouses to AWS Data Lakehouse architectures
Job Responsibility
Job Responsibility
  • Lead the design, assurance, and delivery of secure, cloud-based data migration solutions for UK Central Government departments
  • Combine architectural strategy with hands-on migration delivery oversight and testing governance
  • Shape target-state data platforms while ensuring data is migrated accurately, securely, and efficiently within regulated, security-conscious environments
  • Strong emphasis on data migration validation, ETL testing, and pipeline assurance, particularly within AWS-based Data Lakehouse architectures
  • Define and govern end-to-end migration testing strategies, ensuring successful transition of data from legacy data warehouses to modern cloud platforms
What we offer
What we offer
  • Range of tailored benefits supporting physical, emotional, and financial wellbeing
  • Learning and Development opportunities for continuous growth and development
  • Opportunity for flexible work options
  • Inclusive work environment
  • Disability Confident Committed Employer
Read More
Arrow Right

Data Migration Lead

Are you a data visionary with a deep understanding of Product Lifecycle Manageme...
Location
Location
Canada , Lachine
Salary
Salary:
38.73 - 50.00 USD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
July 10, 2026
Flip Icon
Requirements
Requirements
  • PLM Expertise: Proven experience with Teamcenter / Active Workspace data structures, item management, and metadata rules
  • Migration Experience: Prior track record leading or executing large-scale PLM data migrations (multi-system enterprise migrations preferred)
  • Technical Literacy: Hands-on experience with ETL workflows, mapping design, and data validation frameworks
  • Engineering Knowledge: Deep understanding of core product data (BOMs, Specifications, CAD/PD data, Service BOM variants)
  • ERP Integration: Familiarity with SAP integration, part master data flows, and downstream ERP touchpoints
  • Analytical Skillset: Strong background in data profiling and handling complex, large-scale engineering datasets.
Job Responsibility
Job Responsibility
  • Lead BU-level data migration activities, ensuring alignment with global processes and timelines
  • Own data scope, mapping, and transformation logic to ensure migrated data is improved and fully functional in the new environment
  • Define and Validate attribute mapping between data structures, including items, BOMs, metadata, and engineering artifacts
  • Identify and Remediate legacy data issues and historical inconsistencies
  • Govern non-Teamcenter sources (spreadsheets, local tools) to ensure a cohesive migration into the new system
  • Orchestrate extraction, cleansing, transformation, and load (ETL) activities across internal SMEs and external partners
  • Manage Quality Gates and acceptance criteria in line with global governance frameworks
  • Drive Change Management by helping teams adapt to new data structures and ways of working
  • Create and maintain detailed data mapping specifications and transformation rules
  • Oversee the extraction of Teamcenter data and drive the cleansing of legacy issues
What we offer
What we offer
  • Global Impact: Lead a mission-critical project for a world-renowned engineering organization
  • Cutting-Edge Tech: Gain hands-on leadership experience with the latest PLM/Teamcenter and Active Workspace technologies
  • Collaborative Culture: Work within a highly structured, global framework with support from expert external partners
  • Strategic Visibility: Direct reporting lines to BU leadership and global governance boards
  • Fulltime
Read More
Arrow Right

Data Migration Lead

The Data Migration Lead plays a key role in ensuring HSO’s clients move to adopt...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
hso.com Logo
HSO
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep hands‑on experience with Dynamics 365 Finance & Operations (F&O) data migration
  • Expertise in T-SQL (authoring complex queries, stored procedures, performance tuning, and reconciliation)
  • A proven understanding of data migration principles (profiling, mapping, cleansing, validation, and cutover)
  • Experience managing data teams across multiple streams (Migration, Analytics, Integration)
  • The ability to handle commercially sensitive information and decisions is important
  • A bachelor's or master's degree in computer science, Information Systems, Data Analytics, or related field
  • A strong communicator who can manage stakeholders across technical and business audiences
  • A credible senior consultant with the presence of coaches, challenges, and align cross‑functional teams
  • Analytical and detail‑oriented, with strong problem‑solving skills and a focus on quality
  • Structured in delivery, able to plan, execute, and govern with clear milestones and acceptance criteria
Job Responsibility
Job Responsibility
  • Own the full data migration lifecycle for Dynamics 365 F&O (and CE where relevant), covering planning, execution, cutover, and postmigration verification and hypercare to ensure accuracy and business continuity
  • Lead data discovery, profiling, mapping, cleansing, transformation, and validation activities with functional and technical teams
  • Coordinate effectively with all stakeholders (client teams, HSO delivery teams, ISVs), providing clear communication around progress, risks, and decisions
  • Define migration scope, approach, timelines, resourcing, and risk controls in alignment with project governance and commercial sensitivities
  • Establish and enforce Data Governance standards (lineage, controls, security, retention) for migration assets, and guide Master Data Management (MDM) setup and data quality initiatives
  • Lead data engineering teams to design and implement robust ETL processes and quality checks
  • manage cutovers and reconciliation
  • Author migration scripts and queries in T-SQL. Use Python to automate repeatable tasks and validations when appropriate
  • Leverage Microsoft Fabric and modern data platforms
  • Enable legacy and migrate data for analytical purposes like AI and BI
What we offer
What we offer
  • Development and growth
  • Fun and success
  • International project exposure
  • Freedom and responsibility
  • Fulltime
Read More
Arrow Right

Senior Data Migration Engineer

As a Senior Data Migration Engineer, you will be a core execution member of the ...
Location
Location
Poland , Wrocław; Bielsko-Biała
Salary
Salary:
135.00 - 170.00 PLN / Hour
cshark.com Logo
Cshark
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience with large-scale data migration projects: ETL or systems integration on enterprise-scale projects, transformation pipelines, cutover planning
  • Experience working with XML-based data transformation (mapping files, XSLT, or equivalent config-driven ETL)
  • Proven ability to diagnose complex migration errors under time pressure: root-cause analysis, staging data fixes, re-run coordination
  • Experience coordinating with business stakeholders during UAT and cutover
  • clear written and verbal communication in English
  • Experience with legacy database analysis: reverse-engineering un(der)documented schemas, understanding data semantics and relationships without complete documentation and dealing with corrupted or ambiguous data or metadata
  • Comfortable working with SQL at an advanced level: complex queries, schema analysis, data profiling, and diagnosing data quality issues
  • Strong proficiency in SQL across at least two of: PostgreSQL, Oracle, SQL Server, DB2
  • Solid Java skills (Java 21 ecosystem preferred)
  • comfortable building and extending internal tooling – data pipelines, automation scripts, validation frameworks – with clean, testable code
Job Responsibility
Job Responsibility
  • Work hands-on across the full migration lifecycle – from extraction and mapping through conversion, validation, and cutover
  • Actively building the tooling and accelerators that make future migrations faster and safer (e.g.: artifact observability, version-controlled mapping pipelines, automated validation checks, and reusable migration templates)
  • Shape the process, own the tooling, and directly influence delivery velocity
  • Mentor and technically lead parallel migration teams
What we offer
What we offer
  • 100% remote work
  • Flexible hours
  • International projects
  • Business english lessons
  • Participation in charity actions
  • In-house technology workshops
  • Fulltime
Read More
Arrow Right

Lead Data Engineer - Finance & Accounting Focus

The Lead Data Engineer – Finance & Accounting focus owns the design, development...
Location
Location
United States , St. Petersburg; Plano; Boston; St. Louis; Atlanta
Salary
Salary:
127000.00 - 160550.00 USD / Year
zelis.com Logo
Zelis
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in data engineering, with 2+ years in a technical lead or ownership role
  • Demonstrated experience developing data solutions for finance and accounting domains, such as general ledger, revenue, payments, claims, billing, or financial reporting
  • Proven experience designing and delivering Snowflake cloud data warehouse solutions
  • Strong cloud engineering experience supporting financial data platforms, including data lakes, pipelines, and cloud-native services
  • Advanced SQL expertise, including complex joins, performance tuning, and reconciliation logic
  • Experience building and managing enterprise financial data warehouses and data lakes
  • Hands-on experience migrating financial data systems from on-premises SQL platforms to cloud environments
  • Strong understanding of financial data modeling, ETL/ELT patterns, and analytics architecture
  • Demonstrated leadership, mentorship, and cross-functional collaboration skills
  • Excellent communication skills with both technical teams and finance/accounting stakeholders
Job Responsibility
Job Responsibility
  • Own end-to-end delivery of finance and accounting data service solutions, from requirements and architecture through implementation, testing, deployment, and support
  • Design and implement Snowflake-based financial data architectures, including accounting-ready data models and DBT transformation pipelines
  • Build and maintain high-reliability data pipelines supporting financial reporting, reconciliations, close processes, and downstream analytics
  • Lead cloud data engineering initiatives across the data platform supporting general ledger, revenue, payments, claims, billing, and operational finance workflows
  • Serve as technical lead on finance-focused projects, setting engineering standards, making architectural decisions, and ensuring delivery quality and timelines
  • Partner closely with Finance, Accounting, FP&A, and Analytics teams to translate business and accounting requirements into scalable data products
  • Ensure financial data integrity, auditability, and traceability, including controls, lineage, and reconciliation logic
  • Mentor and guide data engineers through code reviews, design reviews, and hands-on technical leadership
  • Establish and enforce data quality, observability, and governance practices aligned to financial and regulatory expectations
  • Support migration of financial data platforms from on-premises systems to cloud-based solutions
What we offer
What we offer
  • 401k plan with employer match
  • flexible paid time off
  • holidays
  • parental leaves
  • life and disability insurance
  • health benefits including medical, dental, vision, and prescription drug coverage
  • Fulltime
Read More
Arrow Right

Data Migration Engineer

As a Data Manager – Enterprise at MoeGo, you will own and lead data migration an...
Location
Location
United States
Salary
Salary:
Not provided
moego.pet Logo
MoeGo
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of hands-on experience in data management, data migration, or data conversion roles
  • Strong Python experience with heavy use of the Pandas library for data manipulation and transformation
  • Advanced SQL skills, specifically with MySQL and PostgreSQL
  • Proven experience executing complex data cleansing, normalization, and deduplication work
  • Experience using Git or other version control systems
  • Client-facing experience leading data kickoff, discovery, and mapping sessions independently
  • Strong technical documentation skills and the ability to clearly explain data issues and requirements
  • Experience owning migration outcomes — not just assisting or supporting tasks
Job Responsibility
Job Responsibility
  • Own end-to-end data migration execution for enterprise and multi-location customers from discovery through cutover and validation
  • Lead client-facing data discovery and data mapping sessions to define source structures, transformation rules, and migration scope
  • Profile, cleanse, normalize, deduplicate, and transform large datasets using Python and Pandas
  • Write advanced SQL queries (MySQL and PostgreSQL) to validate, transform, and reconcile migrated data
  • Define and apply business rules for matching, merging, and record standardization
  • Build repeatable migration scripts and reusable data transformation workflows using version control best practices
  • Partner with Implementation, Solutions Engineering, Product, and Support to resolve data-related blockers and edge cases
  • Create clear technical documentation including data mapping specs, transformation logic, validation plans, and migration runbooks
  • Design and execute data validation and integrity checks before and after migration
  • Identify risks early and define rollback or remediation approaches when needed
What we offer
What we offer
  • Flexible benefit plans to employees and their family members at no cost to the employees
  • 401(k) matching
  • Fulltime
Read More
Arrow Right