CrawlJobs Logo

Data Engineer Manager

associaonline.com Logo

Associa

Location Icon

Location:
United States , Richardson

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are seeking an experienced Data Engineering Manager to lead a high-performing team that designs, builds, and operates our enterprise data platform. This role blends hands-on technical leadership with people management, Agile delivery, and data platform architecture. You will guide the development of scalable ingestion pipelines, enforce data quality and governance, and partner with product and business stakeholders to deliver reliable data products that enable analytics and data science across the organization.

Job Responsibility:

  • Design, build, and maintain scalable data pipelines and ETL/ELT workflows using Python and SQL
  • Architect and implement data ingestion patterns for batch, streaming, and hybrid workloads
  • Develop and optimize solutions on Databricks, leveraging Spark, Delta Lake, Unity Catalog, DLT, and Workflows
  • Define and implement medallion (Bronze/Silver/Gold) architecture patterns for transformation and governance
  • Establish and enforce data quality standards, monitoring, alerting, and observability across the data platform
  • Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver reliable data products
  • Contribute to and maintain data platform architectural diagrams and extensibility guidance
  • Identify and partner with a Product Owner to establish, curate, and execute a transformation backlog
  • Co-organize and co-host Sprint ceremonies
  • lead team solutioning sessions and provide estimates
  • Lead technical decision-making and prepare demos/walk-throughs for technical and non-technical audiences
  • Coordinate with DevOps and adjacent teams on code merges, testing, and release management
  • Document, organize, and lead deployments from development through production
  • ensure best practices and guidelines are adhered to
  • Maintain and report scrum metrics and feature forecasts daily
  • proactively escalate risks and recommendations to the VP of Engineering as appropriate
  • Interview and onboard new hires
  • approve and document time off
  • conduct annual performance reviews and salary adjustment recommendations
  • Hold regular 1:1s to discover and resolve personnel issues
  • mentor and coach team members on career growth
  • Create, own, and educate others on the client sandbox solution architecture
  • establish and maintain a backlog of changes (application growth, data refreshes, and planned curations)
  • Design data staging frameworks based on real-world scenarios (e.g., month-end reconciliation, homeowner settlement/warranty deed, posting to GL, go-dark practice run—architecture only)
  • Ensure Databricks and client read-only connectivity
  • develop code that can model extensibility development

Requirements:

  • Big Data Platforms: Hands-on experience with enterprise data platforms
  • strong preference for Databricks (Unity Catalog, Delta Lake, DLT, Workflows, Spark optimization)
  • Python: Strong to expert-level proficiency including PySpark, pandas, data validation libraries (e.g., Pydantic, Great Expectations), and production-grade coding practices
  • Data Ingestion: Expert-level experience with Auto Loader, CDC, streaming ingestion, API integrations, and file-based batch processing
  • SQL: Advanced skills (complex joins, window functions, CTEs, query optimization) across analytical and OLTP workloads (SparkSQL, T-SQL or similar)
  • Platform Architecture: Understanding of lakehouse architecture, data modeling principles (Kimball, Data Vault), and data governance frameworks
  • Experience: 5+ years in data engineering or related roles, with 2+ years in a formal people-management capacity
  • Proven track record delivering production-grade data pipelines at scale and leading cross-functional initiatives
  • Experience with CI/CD for data pipelines and infrastructure-as-code practices
  • Soft Skills: Strong, proactive daily communication and ownership mindset
  • Ability to demonstrate technical functionality to technical and non-technical audiences
  • Clear risk identification, mitigation planning, and follow-through
  • People leadership with empathy, accountability, and coaching orientation

Nice to have:

  • Databricks certifications (Data Engineer Associate/Professional)
  • Experience with major cloud platforms (AWS or Azure) and native data services
  • Familiarity with orchestration tools (Airflow, Prefect, Databricks Workflows)
  • Experience driving data migration or multi-source integration programs
  • Knowledge of real-time streaming technologies (Kafka, Event Hubs, Kinesis)
  • 2+ years managing engineering teams
  • formal training or certifications in Agile/Scrum (e.g., CSM, SAFe)

Additional Information:

Job Posted:
February 13, 2026

Icon
Associa - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Engineer Manager

Senior Data Engineering Manager

Data is a big deal at Atlassian. We ingest billions of events each month into ou...
Location
Location
United States , San Francisco
Salary
Salary:
168700.00 - 271100.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • stellar people management skills and experience in leading an agile software team
  • thrive when developing phenomenal people, not just great products
  • worked closely Data Science, analytics and platform teams
  • expertise in building and maintaining high-quality components and services
  • able to drive technical excellence, pushing for innovation and quality
  • at least 10 years experience in a software development role as an individual contributor
  • 4+ years of people management experience
  • deep understanding of data challenges at scale challenges and the eco-system
  • experience with solution building and architecting with public cloud offerings such as Amazon Web Services, DynamoDB, ElasticSearch, S3, Databricks, Spark/Spark-Streaming, GraphDatabases
  • experience with Enterprise Data architectural standard methodologies
Job Responsibility
Job Responsibility
  • build and lead a team of data engineers through hiring, coaching, mentoring, and hands-on career development
  • provide deep technical guidance in a number of aspects of data engineering in a scalable ecosystem
  • champion cultural and process improvements through engineering excellence, quality and efficiency
  • work with close counterparts in other departments as part of a multi-functional team, and build this culture in your team
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Data Engineering Manager

We are looking for a talented Data Engineering Manager with over 8 years of expe...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://6sense.com Logo
6sense
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
  • Minimum of 8 years of experience in data engineering or a related field, with at least 3 years in a managerial role
  • Strong expertise in big data technologies including Apache Spark, Hadoop, Hive, and related tools
  • Proficiency in programming languages such as Python and Java
  • experience with Scala is a plus
  • Proven track record of designing and implementing scalable data systems and pipelines
  • Excellent leadership, communication, and interpersonal skills
  • Strong problem-solving and analytical abilities and a proactive approach to addressing challenges
  • Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data warehousing solutions (e.g., Snowflake, Redshift) is a plus.
Job Responsibility
Job Responsibility
  • Lead, mentor and manage a team of data engineers, and tech leads
  • Build, hire and grow the team
  • Collaborate with product managers, data analysts and other stakeholders to understand data requirements, plan and deliver high quality data solutions
  • Manage project timelines, resources, and deliverables to meet business objectives by managing all cross-functional and cross-team collaboration and dependencies
  • Design, implement, and optimize scalable data pipelines and data processing systems using big data technologies like Apache Spark and Hadoop
  • Ensure data quality, consistency, and security across all data systems
  • Relentlessly pursue goals on data coverage, data freshness, data quality and key performance & SLA metrics
  • Have high technical competence and background with track record of individual technical accomplishments
  • Play the role of the architect for the team
  • Drive continuous improvement by identifying and implementing best practices, tools and processes for development and execution, and champion their adoption
What we offer
What we offer
  • Health coverage
  • Paid parental leave
  • Generous paid time-off and holidays
  • Quarterly self-care days off
  • Stock options
  • Equipment and support for remote or onsite work
  • Learning and development initiatives including LinkedIn Learning
  • Quarterly wellness education sessions
  • ERG-hosted events.
  • Fulltime
Read More
Arrow Right

Senior Data Engineering Manager

Data is a big deal at Atlassian. We ingest billions events each month into our a...
Location
Location
United States , San Francisco
Salary
Salary:
168700.00 - 271100.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • stellar people management skills and experience in leading an agile software team
  • thrive when developing phenomenal people, not just great products
  • worked closely Data Science, analytics and platform teams
  • expertise in building and maintaining high-quality components and services
  • able to drive technical excellence, pushing for innovation and quality
  • at least 10 years experience in a software development role as an individual contributor
  • 4+ years of people management experience
  • deep understanding of data challenges at scale challenges and the eco-system
  • experience with solution building and architecting with public cloud offerings such as Amazon Web Services, DynamoDB, ElasticSearch, S3, Databricks, Spark/Spark-Streaming, GraphDatabases
  • experience with Enterprise Data architectural standard methodologies
Job Responsibility
Job Responsibility
  • build and lead a team of data engineers through hiring, coaching, mentoring, and hands-on career development
  • provide deep technical guidance in a number of aspects of data engineering in a scalable ecosystem
  • champion cultural and process improvements through engineering excellence, quality and efficiency
  • work with close counterparts in other departments as part of a multi-functional team, and build this culture in your team
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Senior Engineering Manager, Big Data

Checkr is looking for a Senior Engineering Manager to lead the Criminal Data tea...
Location
Location
United States , Denver
Salary
Salary:
201000.00 - 237000.00 USD / Year
https://checkr.com Logo
Checkr
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years as an engineering manager
  • 8+ years as an engineer
  • Exceptional verbal and written communication skills
  • Unparalleled bar for quality (data quality metrics, QC gates, data governance, automated regression test suites, data validations, etc)
  • Experience working on data products at scale and understanding the legal, human impact, and technical nuances of supporting a highly regulated product
  • Experience designing and maintaining: Real-time & batch processing data pipelines serving up billions of data points
  • Normalizing and cleansing data across a medallion lakehouse architecture
  • Systems that rely on high-volume, low-latency messaging infrastructure (e.g. Kafka or similar)
  • Highly tolerant production systems with streamlined operations (data lineage, logging, telemetry, alerting, etc.)
  • Familiarity with AWS Glue, OpenSearch, EMR, etc
Job Responsibility
Job Responsibility
  • Drive a motivating technical vision for the team
  • Partner closely with product management to solve business problems
  • Work with the team to build a world-class architecture that can scale into the next phase of Checkr’s growth
  • Hire the best talent and continue to raise the bar for the team
  • Represent the team in planning and product meetings
  • Optimize engineering processes and policies to drive velocity and quality
What we offer
What we offer
  • A fast-paced and collaborative environment
  • Learning and development allowance
  • Competitive compensation and opportunity for advancement
  • 100% medical, dental, and vision coverage
  • Up to 25K reimbursement for fertility, adoption, and parental planning services
  • Flexible PTO policy
  • Monthly wellness stipend, home office stipend
  • Fulltime
Read More
Arrow Right

Senior Engineering Manager, Big Data

Checkr is looking for a Senior Engineering Manager to lead the Criminal Data tea...
Location
Location
United States , San Francisco
Salary
Salary:
238000.00 - 280000.00 USD / Year
https://checkr.com Logo
Checkr
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years as an engineering manager
  • 8+ years as an engineer
  • Exceptional verbal and written communication skills
  • Unparalleled bar for quality (data quality metrics, QC gates, data governance, automated regression test suites, data validations, etc)
  • Experience working on data products at scale and understanding the legal, human impact, and technical nuances of supporting a highly regulated product
  • Experience designing and maintaining: Real-time & batch processing data pipelines serving up billions of data points
  • Normalizing and cleansing data across a medallion lakehouse architecture
  • Systems that rely on high-volume, low-latency messaging infrastructure (e.g. Kafka or similar)
  • Highly tolerant production systems with streamlined operations (data lineage, logging, telemetry, alerting, etc.)
  • Familiarity with AWS Glue, OpenSearch, EMR, etc
Job Responsibility
Job Responsibility
  • Drive a motivating technical vision for the team
  • Partner closely with product management to solve business problems
  • Work with the team to build a world-class architecture that can scale into the next phase of Checkr’s growth
  • Hire the best talent and continue to raise the bar for the team
  • Represent the team in planning and product meetings
  • Optimize engineering processes and policies to drive velocity and quality
What we offer
What we offer
  • A fast-paced and collaborative environment
  • Learning and development allowance
  • Competitive compensation and opportunity for advancement
  • 100% medical, dental, and vision coverage
  • Up to 25K reimbursement for fertility, adoption, and parental planning services
  • Flexible PTO policy
  • Monthly wellness stipend, home office stipend
  • Fulltime
Read More
Arrow Right

Senior Manager, Data Engineering

You will build a team of talented engineers that will work cross functionally to...
Location
Location
United States , San Jose
Salary
Salary:
240840.00 - 307600.00 USD / Year
archer.com Logo
Archer Aviation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in a similar role, 2 of which are in a data leadership role
  • B.S. in a quantitative discipline such as Computer Science, Computer Engineering, Electrical Engineering, Mathematics, or a related field
  • Expertise with data engineering disciplines including data warehousing, database management, ETL processes, and ML model deployment
  • Experience with processing and storing telemetry data
  • Demonstrated experience with data governance standards and practices
  • 3+ years leading teams, including building and recruiting data engineering teams supporting diverse stakeholders
  • Experience with cloud-based data platforms such as AWS, GCP, or Azure
Job Responsibility
Job Responsibility
  • Lead and continue to build a world-class team of engineers by providing technical guidance and mentorship
  • Design and implement scalable data infrastructure to ingest, process, store, and access multiple data supporting flight test, manufacturing and supply chain, and airline operations
  • Take ownership of data infrastructure to enable a highly scalable and cost-effective solution serving the needs of various business units
  • Build and support the development of novel tools to enable insight and decision making with teams across the organization
  • Evolve data engineering and AI strategy to align with the short and long term priorities of the organization
  • Help to establish a strong culture of data that is used throughout the company and industry
  • Lead initiatives to integrate AI capabilities in new and existing tools
  • Fulltime
Read More
Arrow Right

Customer & Marketing Data Engineering Manager

This hybrid role blends marketing strategy, customer analytics, and hands-on eng...
Location
Location
United States , Springfield
Salary
Salary:
Not provided
capstonec.com Logo
Capstone IT Staffing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years in digital marketing, data analytics, or data engineering
  • 4+ years in a leadership role
  • Expertise with modern marketing and data technologies: Snowflake, SQL, Python, dbt, Airflow, Google Analytics, Tableau, Power BI
  • Strong background in connecting MarTech ecosystems (CRM, automation, attribution tools) to enterprise data platforms
  • Ability to turn marketing goals into clear technical plans and measurable results
  • Exceptional communication skills and comfort working across technical, marketing, and executive teams
  • Bachelor’s degree in Marketing, Computer Science, Data Analytics, or related field
Job Responsibility
Job Responsibility
  • Build and execute data-driven digital marketing strategies that boost customer acquisition, retention, and engagement
  • Analyze customer behavior, campaign performance, and conversion data—turning insights into action
  • Partner with Marketing and Data teams to enable personalization, targeting, and unified reporting
  • Optimize digital channels (email, social, web) to improve ROI and customer experiences
  • Integrate CRM, analytics, and marketing automation tools into enterprise data platforms
  • Lead and mentor a cross-functional team of data engineers, BI developers, and analysts
  • Oversee the development of scalable data pipelines, integrations, and analytics infrastructure (Snowflake, dbt, Airflow)
  • Roll up your sleeves to help design data models, review workflows, and troubleshoot complex technical challenges
  • Modernize outdated systems and implement forward-looking data architectures
  • Align engineering and marketing roadmaps to ensure technology fuels business outcomes
Read More
Arrow Right

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy