CrawlJobs Logo

Manager, Data Engineer

United States Employment contract 180000.00 - 200000.00 USD / Year · Job Posted May 29, 2026
Apply Position
Job Link Share

Job Description

We’re looking for a Manager, Data Engineering to lead the team responsible for the reliability, scalability, and performance of our data infrastructure. You will manage a team of data engineers and be accountable for the platforms and pipelines that power DMS’s data-driven business. This role owns the strategy and execution across high-availability transactional systems (MySQL, PostgreSQL, DynamoDB), ELT/ETL pipelines, Kafka streaming architectures, replication systems, and data warehousing infrastructure. You will partner closely with core engineering, data science, product, and infrastructure teams to ensure safe, scalable, and cost-efficient data movement across the organization.

Job Responsibility

  • Lead, mentor, and grow a team of data engineers and architects
  • Define and execute the technical roadmap for production database systems (MySQL, PostgreSQL, DynamoDB, Elastic)
  • Own the architecture and governance of binlog replication, logical replication, and CDC workflows
  • Drive strategy and reliability for ELT/ETL pipelines and Kafka-based streaming architectures
  • Set standards for performance optimization, query tuning, indexing, and database scaling across teams
  • Oversee backup, failover, disaster recovery (PITR), and incident response for all production data systems
  • Drive cost efficiency, infrastructure optimization, and monitoring across cloud-managed data services (AWS RDS, Aurora, DynamoDB)
  • Champion data integrity, security, and compliance standards across all data engineering work
  • Partner cross-functionally with backend, data science, infrastructure, and product teams to align on data platform priorities
  • Establish engineering guardrails, best practices, and documentation to enable team autonomy and quality at scale
  • Lead the evaluation and selection of next-generation data warehousing technology (Snowflake, Databricks, AWS Redshift Serverless)
  • Own the design of an upgraded data model for the warehouse in partnership with data engineers and architects
  • Oversee the end-to-end migration from the current Redshift warehouse

Requirements

  • 8+ years of data or database engineering experience, with 2+ years in an engineering management role
  • Deep hands-on experience with MySQL and/or PostgreSQL in high-availability production environments
  • Proven track record leading and developing teams of engineers in fast-paced, data-intensive environments
  • Strong expertise in binlog/logical replication and integrating OLTP systems with Kafka
  • Experience designing and supporting ELT/ETL pipelines safely at scale
  • Deep understanding of ACID principles, transaction isolation, and database internals
  • Experience with AWS-managed database services (RDS, Aurora, DynamoDB) and infrastructure cost management
  • Experience evaluating or migrating data warehouse platforms (Redshift, Snowflake, Databricks, or similar)
  • Experience designing or redesigning dimensional or analytical data models for large-scale warehouse environments
  • OLTP vs OLAP workload separation and architectural decision-making experience
  • Ability to balance performance, cost, and compliance at an organizational level
  • Strong communication skills with the ability to translate technical complexity for non-technical stakeholders

Nice to have

  • Experience with CDC implementation and large-scale database migrations
  • Infrastructure-as-code experience (Terraform)
  • Background in high-volume, transaction-intensive production environments
  • Prior experience building or scaling a data engineering function from the ground up

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Manager, Data Engineer

8 matching positions

Fabric Data Engineer / Azure Data Engineer

Location
Location
Salary
Salary:
Not provided
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on Data Engineer with strong Microsoft Fabric experience, including Lakehouse, OneLake, Data Factory/Pipelines, Warehousing, and Fabric ecosystem services
  • Strong Python development skills for data engineering, data transformation, automation, and pipeline development
  • Experience working with Microsoft Fabric Lakehouse architecture, including data ingestion, transformation, storage, and analytics enablement
  • Strong understanding of data engineering fundamentals, including data modeling, partitioning, optimization, and performance tuning
  • Experience supporting Azure Data Platform technologies, including Azure Data Factory, Azure Synapse Analytics, Azure Storage, and related services
  • Ability to work within large-scale enterprise data environments supporting multiple business units and data domains
  • Knowledge of Medallion Architecture (Bronze, Silver, Gold) and practical implementation of modern data lakehouse solutions
  • Experience integrating and transforming structured and semi-structured data sources including APIs, databases, JSON, CSV, and cloud-based systems
  • Understanding of Fabric operational monitoring, capacity consumption monitoring, and platform governance best practices
  • Ability to clearly explain and demonstrate the distinction between Fabric Files, Tables, Lakehouses, Warehouses, and OneLake storage concepts
Job Responsibility
Job Responsibility
  • Design, build, and support scalable ETL/ELT data pipelines across enterprise Azure environments
  • Ability to support integration across multiple systems, applications, databases, and cloud platforms
Read More
Arrow Right

Manager Data Engineer

We are seeking a highly skilled Manager Data Engineer to lead data engineering i...
Location
Location
United States , Irvine, CA
Salary
Salary:
50.00 - 60.00 USD / Hour
solomonpage.com Logo
Solomon Page
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Data Engineering, Data Platform Delivery, or related disciplines
  • Proven experience leading globally distributed engineering teams within managed services environments
  • Strong hands-on experience designing and building enterprise-scale data platforms
  • Experience working directly with business stakeholders and client-facing teams
  • Excellent communication, leadership, and stakeholder management skills
  • Strong problem-solving and analytical abilities
  • Data Engineering & Big Data: PySpark, Hive, SQL, Python, Databricks, Delta Lake, Unity Catalog, Apache Spark Performance Tuning, Enterprise Data Warehousing Concepts
  • Cloud & Platform Technologies: AWS, AWS Data Quality (AWS DQ), Airflow, Redshift, SQL Data Warehouse (SQLDW), GitHub, BitBucket
  • Data Architecture & Modeling: Data Modeling, Enterprise Data Architecture, Data Pipeline Design, CI/CD Best Practices, Medallion Architecture
  • Leadership & Delivery: Technical Leadership, Code Reviews, Design Reviews, Client Engagement, Offshore Team Coordination, Governance Reporting, Risk Management
Job Responsibility
Job Responsibility
  • Own technical direction, architecture standards, and code quality across globally distributed engineering teams
  • Define and enforce best practices for data modeling, data pipeline design, CI/CD, and engineering governance
  • Drive Databricks and cloud platform excellence, including Medallion Architecture, Delta Lake, Unity Catalog, Spark optimization, and AWS services
  • Lead the design, development, and optimization of enterprise-scale data engineering solutions
  • Champion AI-assisted engineering practices, including Copilot adoption, context engineering, reusable skills libraries, and output validation
  • Measure and improve engineering productivity through AI efficiency gains and sprint velocity metrics
  • Mentor engineers, conduct code reviews, lead architecture discussions, and foster a culture of technical excellence
  • Collaborate with client stakeholders to translate business requirements into scalable engineering solutions
  • Provide delivery risk assessments, technical recommendations, and governance reporting insights
  • Coordinate effectively with offshore teams and global delivery organizations
What we offer
What we offer
  • Medical
  • Dental
  • 401(k)
  • Direct deposit
  • Commuter benefits
  • Fulltime
Read More
Arrow Right

Manager Data Engineer (GCP + Python)

The Data Engineer will design, develop, and maintain data solutions leveraging G...
Location
Location
India , Pune
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Python for building and deploying data processing scripts
  • Strong expertise in GCP services, especially BigQuery, Cloud Storage, Cloud Functions, Cloud Composer, and Pub/Sub
  • Experience with SQL for querying and processing data
  • Familiarity with workflow orchestration tools like Apache Airflow
  • Knowledge of version control systems (e.g., Git)
  • Excellent communication and stakeholder management skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain ETL/ELT pipelines to ingest, transform, and load large datasets into GCP-based platforms (e.g., BigQuery, Cloud Storage)
  • Optimise data pipelines for performance, reliability, and scalability
  • Develop and manage data models, schemas, and storage solutions aligned with best practices
  • Leverage GCP services such as Cloud Composer, Dataflow, Pub/Sub, and Cloud Functions to build automated workflows
  • Implement data validation, cleansing, and quality checks to maintain accuracy and integrity
  • Collaborate with data scientists, analysts, and business stakeholders to define and execute data requirements
  • Set up monitoring systems to track pipeline performance and ensure timely delivery
Read More
Arrow Right

Senior Manager, Data Engineer

The Global Commercial Analytics (GCA) team within the organization is dedicated ...
Location
Location
India , Mumbai
Salary
Salary:
Not provided
pfizer.de Logo
Pfizer
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s, Master’s, or PhD in Computer Science, Statistics, Data Science, Engineering, or a related quantitative field
  • 9+ years of experience in Data or Analytics Engineering
  • Strong Python Skills: Proven ability to write clean, performant, and maintainable Python for data engineering, with proficiency in libraries like Polars, Pandas and Numpy
  • Modern Data Stack & Systems: Extensive hands-on experience with large-scale distributed systems, including dbt, Airflow, Spark, and Snowflake
  • Data Modeling & Databases: A strong background in building and managing complex data models and warehouses, with experience across both SQL and NoSQL databases
  • Data Quality & Observability: Experience implementing and managing frameworks for data quality testing, observability, and alerting
  • Modern Software Development: Solid experience with modern software development workflows, including Git, CI/CD, and Docker, to automate analytics processes
  • Project Leadership: Experience mentoring other engineers and leading technical projects
Job Responsibility
Job Responsibility
  • Advanced Layer Development: Leads the development of core data components for our advanced analytics layer and agentic data layers, enabling next-generation analytics and AI tools
  • Data Strategy Execution: Works closely with cross-functional teams to help execute the enterprise Data Strategy, translating roadmaps into technical designs and building solutions using standard technology stacks
  • Building AI & RAG Pipelines: Designs and builds end-to-end data pipelines and products specifically to power advanced AI and Retrieval-Augmented Generation (RAG) applications for the Commercial Pharma domain
  • Enabling Advanced Analytics: Builds the clean, reliable data foundation that enables the use of statistical analysis, machine learning, and AI models like RAG to uncover patterns and insights
  • Business Impact: Delivers the high-quality, performant data that forms the basis of meaningful recommendations and drives concrete strategic decisions for brand and commercial strategy
  • Innovation: Stays abreast of analytical trends and cutting-edge applications of data science and AI, including RAG and agentic systems, actively applying new techniques and tools to improve data pipelines
  • Quality & Governance: Implements and adheres to best practices in data management, model validation, and ethical AI, maintaining high standards of quality and compliance in all developed solutions
  • Fulltime
Read More
Arrow Right

Senior Manager, Senior Data Engineer – Paid Marketing

Responsible for designing and delivering scalable data pipelines and data soluti...
Location
Location
United States , Bethesda
Salary
Salary:
100400.00 - 198900.00 USD / Year
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
July 17, 2026
Flip Icon
Requirements
Requirements
  • Strong experience building cloud-based data solutions (AWS + Snowflake preferred)
  • Hands-on expertise in data pipeline orchestration (Airflow) and modern ETL/ELT patterns
  • Advanced proficiency in SQL and data modeling for analytics and reporting use cases
  • Solid understanding of data governance, quality, and security principles
  • Experience working with large-scale, distributed data systems supporting analytics or personalization
  • Strong collaboration skills with ability to work across engineering, product, and business teams
Job Responsibility
Job Responsibility
  • Design and implement end-to-end data pipelines (ingestion, transformation, and delivery) using Airflow and Snowflake to support marketing data use cases
  • Develop and optimize data models and curated datasets to enable analytics, reporting, and downstream data products
  • Collaborate with engineering, product, and business teams to translate requirements into scalable data solutions aligned with platform standards
  • Ensure data quality, governance, security, and compliance across pipelines and datasets
  • Improve performance, reliability, and cost efficiency of Snowflake workloads and orchestration workflows
  • Contribute to platform modernization efforts, including automation, standardization, and reusable pipeline frameworks
  • Support and mentor engineers by promoting best practices in data engineering, testing, and deployment
What we offer
What we offer
  • 401(k) plan
  • stock purchase plan
  • discounts at Marriott properties
  • commuter benefits
  • employee assistance plan
  • childcare discounts
  • medical
  • dental
  • vision
  • health care flexible spending account
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Supplier Data Manager)

Akeneo is the Product Experience (PX) company and global leader in Product Infor...
Location
Location
France; United Kingdom , Paris; London; Nantes
Salary
Salary:
Not provided
akeneo.com Logo
Akeneo
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant hands-on engineering experience
  • Excellent Python or PHP skills
  • Deep strength in at least Python or PHP
  • Familiarity with cloud-native infrastructure (GCP, AWS, or Azure), Kubernetes, and infrastructure-as-code is valuable
  • A customer-centric mindset
  • Comfort with ambiguity
  • Clear communication skills
  • Comfortable embracing AI in how you work
  • A mentorship instinct
  • A pragmatic, quality-driven approach
Job Responsibility
Job Responsibility
  • Scale SDM for enterprise customers
  • Build collaboration and governance features
  • Improve AI-driven data pipelines
  • Participate in structured customer discovery
  • Ship and own what you build
  • Collaborate across the Product Cloud
What we offer
What we offer
  • Flexible working hours
  • Remote or hybrid setup (allowing 3-4 days working from home)
  • Option to Work from Anywhere for up to 30 days per year
  • UK: 25 days of annual leave
  • France: 34 days of annual leave and RTTs
  • UK: £450 home office budget and £80 monthly sustainable transportation allowance
  • France: €500 home office budget and 50% discount on public transportation pass or €45/month Sustainable Transportation Allowance
  • France: €9.5 worth of meal vouchers per working day
  • UK: 26 weeks paid maternity leave, 4 weeks paid leave for second parent, up to 20 weeks fully paid shared parental leave
  • France: 16 weeks paid maternity leave, 4 weeks paid leave for second parent
  • Fulltime
Read More
Arrow Right

Principal Engineer (Engineering Manager) — Data Platform

We are looking for an experienced technology leader to join our Core Platforms (...
Location
Location
Bulgaria , Sofia
Salary
Salary:
Not provided
ft.com Logo
Financial Times
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Demonstrable experience leading teams responsible for building and operating data platforms or distributed data systems in a cloud environment
  • Strong understanding of data engineering, pipelines, and cloud-native architectures (AWS preferred)
  • Proven ability to influence architecture, design, and delivery decisions that balance quality, speed, and sustainability
  • Experience creating a learning culture, mentoring engineers, and supporting professional growth
  • Proven skill in communication and collaboration across diverse teams and stakeholders, both technical and non-technical
  • Ability to connect engineering decisions to broader business outcomes, demonstrating strategic awareness and pragmatic judgment
  • Passion for data as a product, and for enabling others to create, own, and use data responsibly
  • Commitment to continuous improvement — both in technical delivery and in developing inclusive, high-performing teams
Job Responsibility
Job Responsibility
  • Lead the engineering and operational development of the FT’s cloud-native Data Platform, ensuring it provides scalable, secure, and high-quality data capabilities across the organisation
  • Shape and deliver the platform roadmap in alignment with FT’s data architecture, in close partnership with the Product Managers, Data and Technical Architects and other technical leaders across FT Core
  • Foster a culture of technical excellence, collaboration, and continuous improvement — supporting engineers in developing mastery of data engineering and platform operations
  • Champion best practices in modern data management, including automation, observability, cost efficiency, and platform resilience
  • Drive data product enablement, ensuring teams across the FT can easily publish, discover, and consume data through the platform
  • Collaborate with Product and Delivery peers to ensure outcomes are aligned with business goals and deliver tangible value
  • Represent the Data Platform within the wider FT data community, working closely with teams in Data & Analytics, Subscriptions, and Content
  • Mentor and develop engineers and technical leads, aligning their growth and progression with FT’s Engineering Competency Framework
  • Advocate for diversity and inclusion, helping build balanced teams that thrive on collaboration and different perspectives
What we offer
What we offer
  • Annual bonus scheme
  • 25 days paid leave
  • 24/7 Employee Assistance Program
  • Life Insurance
  • Enhanced Parental Leave policy
  • Food Allowance
  • Multisport Card
  • Comprehensive in-house training, and external training programs (subject to approval)
Read More
Arrow Right

Data Center Manager and Engineer

Implement and maintain configuration control, change management, asset tracking,...
Location
Location
United States , Columbia; Laurel
Salary
Salary:
86900.00 - 198000.00 USD / Year
boozallen.com Logo
Booz Allen Hamilton
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience as a network engineer, infrastructure engineer, or system administrator using a variety of IT devices, including power or cooling systems, PDUs, firewalls, switches, storage appliances, compute infrastructure, network and power cabling standards, fiber or copper distribution panels, or remote access or management technologies
  • Experience dealing with equipment acquisition, racking, cabling standards for copper and fiber, power, space, or cooling planning and monitoring, and physical security
  • Knowledge of networking, including DNS, TCP/IP, Ethernet, and cable termination
  • Ability to lift and carry heavy items weighing up to 60 lbs
  • TS/SCI clearance with a polygraph
  • Bachelor’s degree in a CS or IT field and 5+ years of experience with systems or network administration, or 10+ years of experience with systems or network administration in lieu of degree
  • Ability to obtain a DoD 8570.1 IAT Level II Compliant Certification within 60 days of start date
Job Responsibility
Job Responsibility
  • Implement and maintain configuration control, change management, asset tracking, and logistics coordination for a busy IT data center supporting multiple teams
  • Oversee data center services, coordinate network and hardware setups, and provide technical support
  • Assist with equipment delivery, hardware racking, and cabling
  • Support cyber operations and development efforts by providing secure, scalable, and mission-aligned operations and development or testing environments
  • Interface with program managers, engineers, and operations staff to define data center requirements and priorities, coordinate installations and changes, and minimize downtime
  • Assist with planning, and troubleshoot and solve complex infrastructure issues, including hardware, software, and networking
  • Create, maintain, improve, and document processes on the technologies you support
  • Understand all aspects of the data center and equipment or systems you support
What we offer
What we offer
  • health, life, disability, financial, and retirement benefits
  • paid leave
  • professional development
  • tuition assistance
  • work-life programs
  • dependent care
  • recognition awards program
Read More
Arrow Right