CrawlJobs Logo
Digital Media Solutions Logo Digital Media Solutions · IT - Software Development

Manager, Data Engineer

United States Employment contract 180000.00 - 200000.00 USD / Year · Job Posted May 29, 2026
Apply Position
Job Link Share

Job Description

We’re looking for a Manager, Data Engineering to lead the team responsible for the reliability, scalability, and performance of our data infrastructure. You will manage a team of data engineers and be accountable for the platforms and pipelines that power DMS’s data-driven business. This role owns the strategy and execution across high-availability transactional systems (MySQL, PostgreSQL, DynamoDB), ELT/ETL pipelines, Kafka streaming architectures, replication systems, and data warehousing infrastructure. You will partner closely with core engineering, data science, product, and infrastructure teams to ensure safe, scalable, and cost-efficient data movement across the organization.

Job Responsibility

  • Lead, mentor, and grow a team of data engineers and architects
  • Define and execute the technical roadmap for production database systems (MySQL, PostgreSQL, DynamoDB, Elastic)
  • Own the architecture and governance of binlog replication, logical replication, and CDC workflows
  • Drive strategy and reliability for ELT/ETL pipelines and Kafka-based streaming architectures
  • Set standards for performance optimization, query tuning, indexing, and database scaling across teams
  • Oversee backup, failover, disaster recovery (PITR), and incident response for all production data systems
  • Drive cost efficiency, infrastructure optimization, and monitoring across cloud-managed data services (AWS RDS, Aurora, DynamoDB)
  • Champion data integrity, security, and compliance standards across all data engineering work
  • Partner cross-functionally with backend, data science, infrastructure, and product teams to align on data platform priorities
  • Establish engineering guardrails, best practices, and documentation to enable team autonomy and quality at scale
  • Lead the evaluation and selection of next-generation data warehousing technology (Snowflake, Databricks, AWS Redshift Serverless)
  • Own the design of an upgraded data model for the warehouse in partnership with data engineers and architects
  • Oversee the end-to-end migration from the current Redshift warehouse

Requirements

  • 8+ years of data or database engineering experience, with 2+ years in an engineering management role
  • Deep hands-on experience with MySQL and/or PostgreSQL in high-availability production environments
  • Proven track record leading and developing teams of engineers in fast-paced, data-intensive environments
  • Strong expertise in binlog/logical replication and integrating OLTP systems with Kafka
  • Experience designing and supporting ELT/ETL pipelines safely at scale
  • Deep understanding of ACID principles, transaction isolation, and database internals
  • Experience with AWS-managed database services (RDS, Aurora, DynamoDB) and infrastructure cost management
  • Experience evaluating or migrating data warehouse platforms (Redshift, Snowflake, Databricks, or similar)
  • Experience designing or redesigning dimensional or analytical data models for large-scale warehouse environments
  • OLTP vs OLAP workload separation and architectural decision-making experience
  • Ability to balance performance, cost, and compliance at an organizational level
  • Strong communication skills with the ability to translate technical complexity for non-technical stakeholders

Nice to have

  • Experience with CDC implementation and large-scale database migrations
  • Infrastructure-as-code experience (Terraform)
  • Background in high-volume, transaction-intensive production environments
  • Prior experience building or scaling a data engineering function from the ground up
Digital Media Solutions - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Manager, Data Engineer

8 matching positions

Senior Manager, Data Engineering

You will build a team of talented engineers that will work cross functionally to...
Location
Location
United States , San Jose
Salary
Salary:
240840.00 - 307600.00 USD / Year
archer.com Logo
Archer Aviation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in a similar role, 2 of which are in a data leadership role
  • B.S. in a quantitative discipline such as Computer Science, Computer Engineering, Electrical Engineering, Mathematics, or a related field
  • Expertise with data engineering disciplines including data warehousing, database management, ETL processes, and ML model deployment
  • Experience with processing and storing telemetry data
  • Demonstrated experience with data governance standards and practices
  • 3+ years leading teams, including building and recruiting data engineering teams supporting diverse stakeholders
  • Experience with cloud-based data platforms such as AWS, GCP, or Azure
Job Responsibility
Job Responsibility
  • Lead and continue to build a world-class team of engineers by providing technical guidance and mentorship
  • Design and implement scalable data infrastructure to ingest, process, store, and access multiple data supporting flight test, manufacturing and supply chain, and airline operations
  • Take ownership of data infrastructure to enable a highly scalable and cost-effective solution serving the needs of various business units
  • Build and support the development of novel tools to enable insight and decision making with teams across the organization
  • Evolve data engineering and AI strategy to align with the short and long term priorities of the organization
  • Help to establish a strong culture of data that is used throughout the company and industry
  • Lead initiatives to integrate AI capabilities in new and existing tools
  • Fulltime
Read More
Arrow Right

Customer & Marketing Data Engineering Manager

This hybrid role blends marketing strategy, customer analytics, and hands-on eng...
Location
Location
United States , Springfield
Salary
Salary:
Not provided
capstonec.com Logo
Capstone IT Staffing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years in digital marketing, data analytics, or data engineering
  • 4+ years in a leadership role
  • Expertise with modern marketing and data technologies: Snowflake, SQL, Python, dbt, Airflow, Google Analytics, Tableau, Power BI
  • Strong background in connecting MarTech ecosystems (CRM, automation, attribution tools) to enterprise data platforms
  • Ability to turn marketing goals into clear technical plans and measurable results
  • Exceptional communication skills and comfort working across technical, marketing, and executive teams
  • Bachelor’s degree in Marketing, Computer Science, Data Analytics, or related field
Job Responsibility
Job Responsibility
  • Build and execute data-driven digital marketing strategies that boost customer acquisition, retention, and engagement
  • Analyze customer behavior, campaign performance, and conversion data—turning insights into action
  • Partner with Marketing and Data teams to enable personalization, targeting, and unified reporting
  • Optimize digital channels (email, social, web) to improve ROI and customer experiences
  • Integrate CRM, analytics, and marketing automation tools into enterprise data platforms
  • Lead and mentor a cross-functional team of data engineers, BI developers, and analysts
  • Oversee the development of scalable data pipelines, integrations, and analytics infrastructure (Snowflake, dbt, Airflow)
  • Roll up your sleeves to help design data models, review workflows, and troubleshoot complex technical challenges
  • Modernize outdated systems and implement forward-looking data architectures
  • Align engineering and marketing roadmaps to ensure technology fuels business outcomes
Read More
Arrow Right

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right

Vendor Data Manager

The Vendor Data Manager is a strategic and cross-functional leader, responsible ...
Location
Location
United Kingdom , Birmingham, Bristol, Dublin, Glasgow, Leeds, London, Manchester, Marlow, Newcastle
Salary
Salary:
Not provided
softcat.com Logo
Softcat
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong understanding of data analytics, data engineering, and machine learning concepts
  • Strong understanding of data governance and data quality
  • Knowledge of how data integration and ETL works
  • Solid understanding of data security and compliance or the ability to learn this
  • Knowledge or experience of MS Purview, CluedIn and PowerBI would be beneficial
  • Familiarity with agile methodologies, product road mapping, and user-centred design
  • Attention to detail
  • Experience managing data-centric products or platforms
  • Problem Solving and Analytical Thinking
  • Knowledge of Softcat's Vendor landscape or a similar company would be advantageous
Job Responsibility
Job Responsibility
  • Working with the Head of Business Partnering to develop a clear roadmap for data products aligned with business goals and user needs
  • Conduct market research and competitive analysis to identify opportunities for improvements to Softcat's vendor data
  • Master Data Management (MDM): Responsible for creating and maintaining a single, consistent and accurate source of truth for Softcat's critical vendor data
  • Data Quality Management: Responsible for the process of ensuring data is accurate, complete, consistent and timely
  • Responsible for implementing and managing security measures to protect sensitive data from unauthorised access, breaches and cyberattacks
  • Work with the data leadership team to create and maintain a comprehensive data strategy for vendor data that aligns with Softcat's business goals
What we offer
What we offer
  • Pension
  • Share incentive plan
  • Life Assurance
  • Healthcare
  • Holiday
  • Trips
  • Vouchers
  • Partner/family Benefits
  • Perklife
  • Maternity, Paternity and Adoption support
  • Fulltime
Read More
Arrow Right

Software Engineer (Data Engineering)

We are seeking a Software Engineer (Data Engineering) who can seamlessly integra...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
nstarxinc.com Logo
NStarX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years in Data Engineering and AI/ML roles
  • Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field
  • Python, SQL, Bash, PySpark, Spark SQL, boto3, pandas
  • Apache Spark on EMR (driver/executor model, sizing, dynamic allocation)
  • Amazon S3 (Parquet) with lifecycle management to Glacier
  • AWS Glue Catalog and Crawlers
  • AWS Step Functions, AWS Lambda, Amazon EventBridge
  • CloudWatch Logs and Metrics, Kinesis Data Firehose (or Kafka/MSK)
  • Amazon Redshift and Redshift Spectrum
  • IAM (least privilege), Secrets Manager, SSM
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL and ELT pipelines for large-scale data processing
  • Develop and optimize data architectures supporting analytics and ML workflows
  • Ensure data integrity, security, and compliance with organizational and industry standards
  • Collaborate with DevOps teams to deploy and monitor data pipelines in production environments
  • Build predictive and prescriptive models leveraging AI and ML techniques
  • Develop and deploy machine learning and deep learning models using TensorFlow, PyTorch, or Scikit-learn
  • Perform feature engineering, statistical analysis, and data preprocessing
  • Continuously monitor and optimize models for accuracy and scalability
  • Integrate AI-driven insights into business processes and strategies
  • Serve as the technical liaison between NStarX and client teams
What we offer
What we offer
  • Competitive salary and performance-based incentives
  • Opportunity to work on cutting-edge AI and ML projects
  • Exposure to global clients and international project delivery
  • Continuous learning and professional development opportunities
  • Competitive base + commission
  • Fast growth into leadership roles
  • Fulltime
Read More
Arrow Right

Engineering Manager, CS Data Services

The Community Support Engineering (CSE) organization ensures our hosts and guest...
Location
Location
United States
Salary
Salary:
204000.00 - 255000.00 USD / Year
airbnb.com Logo
Airbnb
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 9+ years of software engineering experience
  • 3–5+ years managing engineering teams in a fast-paced environment
  • BS/MS in CS or a related field
  • Deep understanding of distributed systems, application-layer APIs, and event-driven architectures
  • Strong proficiency with Java/Kotlin, distributed queues (Kafka, SQS), GraphQL, data processing frameworks (Spark/Flink), and datastores (Redis, ElasticSearch, Cassandra, MySQL, or similar KV/relational systems)
  • Demonstrated ability to balance long-term platform strategy with near-term product needs using sound technical judgment
  • Proven track record building reliable, scalable, high-quality systems and fostering a culture of accountability and ownership
  • Excellent communicator who can influence across teams and develop, motivate, and lead high-performing engineering organizations
  • Experience delivering large, complex technical initiatives end-to-end
  • Strong commitment to operational excellence, quality, reliability, and availability
Job Responsibility
Job Responsibility
  • Ramp up on the team’s technology, product, and business goals, including hands-on work to develop a deep technical understanding
  • Lead, mentor, and grow a high-performing engineering team in a fast-paced environment
  • Foster a team culture that emphasizes product thinking, technical depth, and customer-centric problem solving
  • Drive adoption of data services by partnering closely with teams across CSE to understand their use cases and deliver intuitive, scalable solutions
  • Set clear priorities and strategic direction in collaboration with engineering, product, machine learning, and data teams
  • Improve team processes to strengthen collaboration, execution efficiency, and delivery quality
  • Lead complex, cross-functional projects that align with business goals and deliver measurable impact
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Employee Travel Credits
  • Fulltime
Read More
Arrow Right

Data Engineering & Analytics Lead

Premium Health is seeking a highly skilled, hands-on Data Engineering & Analytic...
Location
Location
United States , Brooklyn
Salary
Salary:
Not provided
premiumhealth.org Logo
Premium Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred
  • Proven track record and progressively responsible experience in data engineering, data architecture, or related technical roles
  • healthcare experience preferred
  • Strong knowledge of data engineering principles, data integration, ETL processes, and semantic mapping techniques and best practices
  • Experience implementing data quality management processes, data governance frameworks, cataloging, and master data management concepts
  • Familiarity with healthcare data standards (e.g., HL7, FHIR, etc), health information management principles, and regulatory requirements (e.g., HIPAA)
  • Understanding of healthcare data, including clinical, operational, and financial data models, preferred
  • Advanced proficiency in SQL, data modeling, database design, optimization, and performance tuning
  • Experience designing and integrating data from disparate systems into harmonized data models or semantic layers
  • Hands-on experience with modern cloud-based data platforms (e.g Azure, AWS, GCP)
Job Responsibility
Job Responsibility
  • Collaborate with the CDIO and Director of Technology to define a clear data vision aligned with the organization's goals and execute the enterprise data roadmap
  • Serve as a thought leader for data engineering and analytics, guiding the evolution of our data ecosystem and championing data-driven decision-making across the organization
  • Build and mentor a small data team, providing technical direction and performance feedback, fostering best practices and continuous learning, while remaining a hands-on implementor
  • Define and implement best practices, standards, and processes for data engineering, analytics, and data management across the organization
  • Design, implement, and maintain a scalable, reliable, and high-performing modern data infrastructure, aligned with the organizational needs and industry best practices
  • Architect and maintain data lake/lakehouse, warehouse, and related platform components to support analytics, reporting, and operational use cases
  • Establish and enforce data architecture standards, governance models, naming conventions ,and documentation
  • Develop, optimize, and maintain scalable ETL/ELT pipelines and data workflows to collect, transform, normalize, and integrate data from diverse systems
  • Implement robust data quality processes, validation, monitoring, and error-handling frameworks
  • Ensure data is accurate, timely, secure, and ready for self-service analytics and downstream applications
What we offer
What we offer
  • Paid Time Off, Medical, Dental and Vision plans, Retirement plans
  • Public Service Loan Forgiveness (PSLF)
  • Fulltime
Read More
Arrow Right

Data Governance Engineer

The role focuses on deploying and managing enterprise-scale Data Governance prac...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of Data Governance and Data Engineering experience, with significant exposure to enabling Data availability, data discovery, quality & reliability, with appropriate security & access controls in enterprise-scale ecosystem
  • First level university degree
  • Experience working with Data governance & metadata management tools (Collibra, Databricks Unity Catalog, Atlan, etc.)
  • Subject matter expertise of consent management concepts and tools
  • Demonstrated knowledge of research methodology and the ability to manage complex data requests
  • Excellent analytical thinking, technical analysis, and data manipulation skills
  • Proven track record of development of SQL SSIS packages with ETL flow
  • Experience with AI application deployment governance a plus
  • Technologies such as MS SQL Server, Databricks, Hadoop, SAP S4/HANA
  • Experience with SQL databases and building SSIS packages
Job Responsibility
Job Responsibility
  • Drive the design and development of Data Dictionary, Lineage, Data Quality, Security & Access Control for Business-relevant data subjects & reports across business domains
  • Engage with the business users community to enable ease of Data Discovery and build trust in the data through Data Quality & Reliability monitoring with key metrics & SLAs defined
  • Supports the development and sustaining of Data subjects in the Database layer to enable BI dashboards and AI solutions
  • Drives the engagement and alignment with the HPE IT/CDO team on Governance initiatives, including partnering with functional teams across the business
  • Test, validate and assure the quality of complex AI-powered product features
  • Partner with a highly motivated and talented set of colleagues
  • Be a motivated, self-starter who can operate with minimal handholding
  • Collaborate across teams and time zones, demonstrating flexibility and accountability.
What we offer
What we offer
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Specific programs to help achieve career goals
  • Comprehensive inclusion and flexibility to manage work and personal needs.
  • Fulltime
Read More
Arrow Right