Data Engineering Manager Job at Alter Domus (London)

Data Engineering Manager

Alter Domus

Location:
United Kingdom , London

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

Join our dynamic and innovative team as a Data Engineering Manager, where you will lead the design, development, and maintenance of our data infrastructure and pipelines. In this pivotal role, you will oversee a team of data engineers, collaborating closely with data analysts, data scientists, and various business stakeholders to ensure that our data is reliable, efficient, and accessible in a scalable manner.

Job Responsibility:

Lead, mentor, and develop a team of data engineers, fostering a culture of collaboration, innovation, and continuous improvement
Set clear goals and performance expectations for team members, conducting regular performance reviews and providing constructive feedback
Oversee the design, building, and maintenance of end-to-end data pipelines using Airflow to orchestrate, schedule, and monitor batch/streaming workflows
Ensure the implementation of DAGs (Directed Acyclic Graphs) with retry logic, error handling, and alerting to maintain data quality and pipeline reliability
Guide the integration of data from various sources using Airbyte for ingestion and dbt for transformations in a scalable and modular fashion
Collaborate with Data Analysts and Data Scientists to implement transformations and business logic, ensuring data is analytics-ready
Direct the design and implementation of efficient data models for both structured and semi-structured data in AWS S3 (data lake) and Snowflake (data warehouse)
Utilize Databricks for data processing and analytics, enabling real-time insights and advanced analytics capabilities
Ensure data schemas and transformations support advanced analytics, BI reporting, and machine learning use cases
Lead the utilization of AWS Lake Formation APIs and best practices to maintain data security, access controls, and compliance
Collaborate with IT security to establish robust encryption standards, audit trails, and identity/role-based access
Oversee the optimization of AWS Athena queries and configurations (e.g., data partitioning) for performance and cost efficiency
Monitor and tune Airflow DAGs, Snowflake queries, and Databricks jobs to improve throughput and reliability
Partner with cross-functional teams, including DevOps, Platform Engineering, and Data Science, to ensure seamless integration of data workflows and systems
Communicate technical solutions effectively to non-technical stakeholders and leadership, translating requirements into actionable tasks
Participate in architecture reviews, code reviews, and troubleshooting sessions to ensure quality and alignment with best practices
Stay current with emerging trends in data engineering, orchestration tools (Airflow, MWAA), and cloud services (AWS, Snowflake, Databricks)

Requirements:

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
5+ years of experience in data engineering or a similar role
At least 2 years in a leadership or managerial capacity working with cloud-based data platforms
Proficient in Airflow (self-managed or managed services like Amazon MWAA) for workflow orchestration, DAG development, and scheduling
Hands-on experience with AWS Lake Formation, S3, Athena, and related services (e.g., Lambda, Glue, IAM)
Proficient in setting up data warehouses, configuring security, and optimizing queries on Snowflake
Experience with Databricks for data processing, analytics, and real-time data insights
Experience with Airbyte or similar tools for data ingestion
dbt or other SQL-based transformation frameworks for modular data processing
Proficiency in Python and/or Java/Scala for building data pipelines and custom integrations
Advanced knowledge of SQL for data manipulation and analysis
Strong problem-solving and analytical abilities
Excellent communication and collaboration skills, able to effectively work in cross-functional teams
Ability to operate in a fast-paced, agile environment and manage multiple priorities simultaneously

Nice to have:

AWS certifications (e.g., AWS Certified Data Analytics – Specialty, AWS Certified Solutions Architect)
Experience with CI/CD pipelines, containerization (Docker, Kubernetes), and infrastructure as code (Terraform, CloudFormation)
Familiarity with DevOps best practices for managing Airflow environments (e.g., version control for DAGs, automated testing, monitoring)
Familiarity with financial services data, especially private equity and alternative investments

What we offer:

Support for professional accreditations such as ACCA and study leave
Flexible arrangements, generous holidays, plus an additional day off for your birthday
Continuous mentoring along your career progression
Active sports, events and social committees across our offices
24/7 support available from our Employee Assistance Program
The opportunity to invest in our growth and success through our Employee Share Plan
Plus additional local benefits depending on your location

Additional Information:

Job Posted:
February 14, 2026

Work Type:

Hybrid work

Alter Domus - All Job Offers

Job Link Share: