CrawlJobs Logo

Data Engineering Manager

https://6sense.com Logo

6sense

Location Icon

Location:
India, Bengaluru

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are looking for a talented Data Engineering Manager with over 8 years of experience in the field. The ideal candidate will have extensive expertise in big data technologies such as Apache Spark and Hadoop, and possess strong programming skills in Python. Experience with Scala is a plus. As an Engineering Manager, you will lead and mentor a team of data engineers, oversee the design and implementation of data systems, and collaborate with cross-functional teams to ensure that our data infrastructure meets the highest standards of performance and reliability.

Job Responsibility:

  • Lead, mentor and manage a team of data engineers, and tech leads
  • Build, hire and grow the team
  • Collaborate with product managers, data analysts and other stakeholders to understand data requirements, plan and deliver high quality data solutions
  • Manage project timelines, resources, and deliverables to meet business objectives by managing all cross-functional and cross-team collaboration and dependencies
  • Design, implement, and optimize scalable data pipelines and data processing systems using big data technologies like Apache Spark and Hadoop
  • Ensure data quality, consistency, and security across all data systems
  • Relentlessly pursue goals on data coverage, data freshness, data quality and key performance & SLA metrics
  • Have high technical competence and background with track record of individual technical accomplishments
  • Play the role of the architect for the team
  • Drive continuous improvement by identifying and implementing best practices, tools and processes for development and execution, and champion their adoption
  • Create clear career paths for team members and help them grow with regular coaching and mentoring
  • Perform regular performance evaluation and share and seek feedback
  • Stay up-to-date with industry trends and emerging technologies to drive innovation.

Requirements:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
  • Minimum of 8 years of experience in data engineering or a related field, with at least 3 years in a managerial role
  • Strong expertise in big data technologies including Apache Spark, Hadoop, Hive, and related tools
  • Proficiency in programming languages such as Python and Java
  • experience with Scala is a plus
  • Proven track record of designing and implementing scalable data systems and pipelines
  • Excellent leadership, communication, and interpersonal skills
  • Strong problem-solving and analytical abilities and a proactive approach to addressing challenges
  • Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data warehousing solutions (e.g., Snowflake, Redshift) is a plus.

Nice to have:

  • Experience with Scala is a plus
  • Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data warehousing solutions (e.g., Snowflake, Redshift) is a plus.
What we offer:
  • Health coverage
  • Paid parental leave
  • Generous paid time-off and holidays
  • Quarterly self-care days off
  • Stock options
  • Equipment and support for remote or onsite work
  • Learning and development initiatives including LinkedIn Learning
  • Quarterly wellness education sessions
  • ERG-hosted events.

Additional Information:

Job Posted:
March 26, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Icon
View All Jobs In This Company
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Engineering Manager

New

Sr. Manager- Data Engineering

Adtalem is a data driven organization. The Data Engineering team builds data sol...
Location
Location
United States , Lisle
Salary
Salary:
96404.10 - 169021.85 USD / Year
adtalem.com Logo
Adtalem Global Education
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field
  • Master's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field
  • 8+ years experience in data engineering solutions such as data platforms, data ingestion, data management, or publication/analytics
  • 3+ years leadership experience building and managing a high performing teams
  • 2+ years experience in Google Cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows
  • Progressively responsible experience starting as Data Engineer and advancement in complexity, and level of responsibility
  • Must be highly analytical having the proven ability to develop and reverse complex engineering solutions
  • Critical thinking and advanced problem-solving skills are core behaviors among the team
  • Excellent oral/written communication and presentation skills
  • Experience in objectively evaluating current processes for opportunities to optimize inter departmental communication, collaboration, and end-to-end process performance
Job Responsibility
Job Responsibility
  • Design and build trusted, reliable and timely datasets, metrics and data pipelines that are critical to the direction of the company
  • Build and lead a high-performing data engineering team in a hands-on technical capacity
  • Be responsible for shaping how we acquire, collect and leverage data
  • Define and manage SLA's for all data sets and processes running in production
  • Work closely with Product Managers, Analysts, Data Scientists to develop and own data-driven systems
  • Develop data democratization layer for self-served reporting
  • Assist development team in troubleshooting, coding, testing, implementation, and documenting solutions
  • Support, grow, mentor and inspire new and existing team members
  • Be a key leader of the Data and Analytics team, working to propel the business towards being more data-driven
  • Performs other duties as assigned
What we offer
What we offer
  • Health, dental, vision, life and disability insurance
  • 401k Retirement Program + 6% employer match
  • Participation in Adtalem’s Flexible Time Off (FTO) Policy
  • 12 Paid Holidays
  • Eligible to participate in an annual incentive program
  • Fulltime
Read More
Arrow Right
New

Data Engineering Support Engineer / Manager

Wissen Technology is hiring a seasoned Data Engineering Support Engineer / Manag...
Location
Location
India , Mumbai; Pune
Salary
Salary:
Not provided
votredircom.fr Logo
Wissen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor of Technology or master's degree in computer science, Engineering, or related field
  • 8-12 years of work experience
  • Python, SQL
  • Familiarity with data engineering
  • Experience with AWS data and analytics services or similar cloud vendor services
  • Strong problem solving and communication skills
  • Ability to organise and prioritise work effectively
Job Responsibility
Job Responsibility
  • Incident and user management for data and analytics platform
  • Development and maintenance of Data Quality framework (including anomaly detection)
  • Implementation of Python & SQL hotfixes and working with data engineers on more complex issues
  • Diagnostic tools implementation and automation of operational processes
  • Work closely with data scientists, data engineers, and platform engineers in a highly commercial environment
  • Support research analysts and traders with issue resolution
  • Fulltime
Read More
Arrow Right

Customer & Marketing Data Engineering Manager

This hybrid role blends marketing strategy, customer analytics, and hands-on eng...
Location
Location
United States , Springfield
Salary
Salary:
Not provided
capstonec.com Logo
Capstone IT Staffing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years in digital marketing, data analytics, or data engineering
  • 4+ years in a leadership role
  • Expertise with modern marketing and data technologies: Snowflake, SQL, Python, dbt, Airflow, Google Analytics, Tableau, Power BI
  • Strong background in connecting MarTech ecosystems (CRM, automation, attribution tools) to enterprise data platforms
  • Ability to turn marketing goals into clear technical plans and measurable results
  • Exceptional communication skills and comfort working across technical, marketing, and executive teams
  • Bachelor’s degree in Marketing, Computer Science, Data Analytics, or related field
Job Responsibility
Job Responsibility
  • Build and execute data-driven digital marketing strategies that boost customer acquisition, retention, and engagement
  • Analyze customer behavior, campaign performance, and conversion data—turning insights into action
  • Partner with Marketing and Data teams to enable personalization, targeting, and unified reporting
  • Optimize digital channels (email, social, web) to improve ROI and customer experiences
  • Integrate CRM, analytics, and marketing automation tools into enterprise data platforms
  • Lead and mentor a cross-functional team of data engineers, BI developers, and analysts
  • Oversee the development of scalable data pipelines, integrations, and analytics infrastructure (Snowflake, dbt, Airflow)
  • Roll up your sleeves to help design data models, review workflows, and troubleshoot complex technical challenges
  • Modernize outdated systems and implement forward-looking data architectures
  • Align engineering and marketing roadmaps to ensure technology fuels business outcomes
Read More
Arrow Right

Senior Manager, Data Engineering

You will build a team of talented engineers that will work cross functionally to...
Location
Location
United States , San Jose
Salary
Salary:
240840.00 - 307600.00 USD / Year
archer.com Logo
Archer Aviation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in a similar role, 2 of which are in a data leadership role
  • B.S. in a quantitative discipline such as Computer Science, Computer Engineering, Electrical Engineering, Mathematics, or a related field
  • Expertise with data engineering disciplines including data warehousing, database management, ETL processes, and ML model deployment
  • Experience with processing and storing telemetry data
  • Demonstrated experience with data governance standards and practices
  • 3+ years leading teams, including building and recruiting data engineering teams supporting diverse stakeholders
  • Experience with cloud-based data platforms such as AWS, GCP, or Azure
Job Responsibility
Job Responsibility
  • Lead and continue to build a world-class team of engineers by providing technical guidance and mentorship
  • Design and implement scalable data infrastructure to ingest, process, store, and access multiple data supporting flight test, manufacturing and supply chain, and airline operations
  • Take ownership of data infrastructure to enable a highly scalable and cost-effective solution serving the needs of various business units
  • Build and support the development of novel tools to enable insight and decision making with teams across the organization
  • Evolve data engineering and AI strategy to align with the short and long term priorities of the organization
  • Help to establish a strong culture of data that is used throughout the company and industry
  • Lead initiatives to integrate AI capabilities in new and existing tools
  • Fulltime
Read More
Arrow Right

Senior Data Engineering Manager

Lead and mentor data engineering team to scale data platform, establish best pra...
Location
Location
United States , Work at Home, Illinois
Salary
Salary:
130295.00 - 260590.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
January 19, 2026
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in Computer Science, Data Science, or related field
  • 7+ years of experience in data engineering
  • 5+ years in technical leadership or management role
  • Experience building and leading high-performing data engineering teams
  • Deep expertise with cloud platforms (AWS, Azure, or GCP)
  • Experience with big data frameworks (Apache Spark, Hadoop)
  • Experience with data warehousing solutions (Snowflake, Redshift, BigQuery)
  • Experience with workflow orchestration tools (Airflow, Dagster)
  • Solid experience with SQL, Python, PySpark
  • Excellent communication, interpersonal, and leadership skills
Job Responsibility
Job Responsibility
  • Lead, mentor, and grow team of 6-8 data engineers
  • Manage hiring, training, and professional development
  • Conduct performance reviews and provide feedback
  • Own technical vision and roadmap for data platform
  • Lead design, development, and maintenance of data pipelines and data warehouses
  • Drive best practices in data modeling, ETL/ELT processes, and data governance
  • Oversee implementation of new data technologies and architectures
  • Partner with product managers, data scientists, analysts, and other engineering teams
  • Ensure data platform meets standards for performance, security, and data quality
  • Establish culture of operational excellence including monitoring and incident response
What we offer
What we offer
  • Affordable medical plan options
  • 401(k) plan with matching company contributions
  • Employee stock purchase plan
  • Wellness screenings
  • Tobacco cessation and weight management programs
  • Confidential counseling and financial coaching
  • Paid time off
  • Flexible work schedules
  • Family leave
  • Dependent care resources
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineering Manager

We are seeking an experienced Senior Data Platform Engineering Manager to lead a...
Location
Location
United States , Work at, Illinois
Salary
Salary:
130295.00 - 260590.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
January 19, 2026
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering, platform management, or a related role, with a strong focus on cloud data technologies
  • Proven experience managing and leading technical teams
  • Deep, hands-on experience with the Azure Databricks platform, including its administration, cluster management, job orchestration, and key features like Delta Lake and Unity Catalog
  • Relevant certifications such as Microsoft Certified: Azure Solutions Architect Expert, Databricks Certified Data Engineer Professional, and Databricks Certified Platform Administrator
  • A strong understanding of distributed computing principles and the architecture of large-scale data systems
  • Exceptional analytical and problem-solving skills with a track record of diagnosing and resolving complex, platform-level issues
  • Excellent communication, documentation, and presentation skills, with the ability to influence technical and business stakeholders
  • Proficiency in Terraform, Python, Apache Spark/PySpark, SQL, and Shell scripting
  • Leading the efforts of 7 platform engineers
  • Preferred: Familiarity with healthcare data and healthcare insurance feeds, Data Analytics, and ML/AI
Job Responsibility
Job Responsibility
  • Own the strategic vision and roadmap for the Azure Databricks platform, aligning it with company-wide data and business goals
  • Lead, mentor, and build a high-performing team of data engineers and platform specialists
  • Act as the primary point of contact for platform-related issues and opportunities, communicating effectively with executive leadership and technical teams
  • Ensure new data engineering team members are onboarded consistently with best practices
  • Advocate for best practices, create reusable patterns and libraries, and provide expert-level technical support and training to data engineering teams
  • Ensure the platform's operational health, including performance, security, and cost management
  • Oversee platform maintenance, upgrades, and migrations to ensure reliability and minimize downtime
  • Establish and enforce best practices for development, data governance, quality, and security on the platform
  • Drive the continuous enhancement of the platform by introducing new tools, features, and capabilities
  • Evaluate and integrate new data technologies to improve efficiency, scalability, and performance
What we offer
What we offer
  • Affordable medical plan options, a 401(k) plan (including matching company contributions), and an employee stock purchase plan
  • No-cost programs for wellness screenings, tobacco cessation, and weight management programs
  • Confidential counseling and financial coaching
  • Paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, and retiree medical access
  • Award target in the company’s equity award program
  • Fulltime
Read More
Arrow Right

Senior Engineering Manager, Big Data

Checkr is looking for a Senior Engineering Manager to lead the Criminal Data tea...
Location
Location
United States , San Francisco
Salary
Salary:
238000.00 - 280000.00 USD / Year
https://checkr.com Logo
Checkr
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years as an engineering manager
  • 8+ years as an engineer
  • Exceptional verbal and written communication skills
  • Unparalleled bar for quality (data quality metrics, QC gates, data governance, automated regression test suites, data validations, etc)
  • Experience working on data products at scale and understanding the legal, human impact, and technical nuances of supporting a highly regulated product
  • Experience designing and maintaining: Real-time & batch processing data pipelines serving up billions of data points
  • Normalizing and cleansing data across a medallion lakehouse architecture
  • Systems that rely on high-volume, low-latency messaging infrastructure (e.g. Kafka or similar)
  • Highly tolerant production systems with streamlined operations (data lineage, logging, telemetry, alerting, etc.)
  • Familiarity with AWS Glue, OpenSearch, EMR, etc
Job Responsibility
Job Responsibility
  • Drive a motivating technical vision for the team
  • Partner closely with product management to solve business problems
  • Work with the team to build a world-class architecture that can scale into the next phase of Checkr’s growth
  • Hire the best talent and continue to raise the bar for the team
  • Represent the team in planning and product meetings
  • Optimize engineering processes and policies to drive velocity and quality
What we offer
What we offer
  • A fast-paced and collaborative environment
  • Learning and development allowance
  • Competitive compensation and opportunity for advancement
  • 100% medical, dental, and vision coverage
  • Up to 25K reimbursement for fertility, adoption, and parental planning services
  • Flexible PTO policy
  • Monthly wellness stipend, home office stipend
  • Fulltime
Read More
Arrow Right

Senior Engineering Manager, Big Data

Checkr is looking for a Senior Engineering Manager to lead the Criminal Data tea...
Location
Location
United States , Denver
Salary
Salary:
201000.00 - 237000.00 USD / Year
https://checkr.com Logo
Checkr
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years as an engineering manager
  • 8+ years as an engineer
  • Exceptional verbal and written communication skills
  • Unparalleled bar for quality (data quality metrics, QC gates, data governance, automated regression test suites, data validations, etc)
  • Experience working on data products at scale and understanding the legal, human impact, and technical nuances of supporting a highly regulated product
  • Experience designing and maintaining: Real-time & batch processing data pipelines serving up billions of data points
  • Normalizing and cleansing data across a medallion lakehouse architecture
  • Systems that rely on high-volume, low-latency messaging infrastructure (e.g. Kafka or similar)
  • Highly tolerant production systems with streamlined operations (data lineage, logging, telemetry, alerting, etc.)
  • Familiarity with AWS Glue, OpenSearch, EMR, etc
Job Responsibility
Job Responsibility
  • Drive a motivating technical vision for the team
  • Partner closely with product management to solve business problems
  • Work with the team to build a world-class architecture that can scale into the next phase of Checkr’s growth
  • Hire the best talent and continue to raise the bar for the team
  • Represent the team in planning and product meetings
  • Optimize engineering processes and policies to drive velocity and quality
What we offer
What we offer
  • A fast-paced and collaborative environment
  • Learning and development allowance
  • Competitive compensation and opportunity for advancement
  • 100% medical, dental, and vision coverage
  • Up to 25K reimbursement for fertility, adoption, and parental planning services
  • Flexible PTO policy
  • Monthly wellness stipend, home office stipend
  • Fulltime
Read More
Arrow Right
Welcome to CrawlJobs.com –
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Australia Jobs Canada Jobs Poland Jobs Ireland Jobs Spain Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2025 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy