Data Engineering Lead Jobs

New

Lead Data Engineer

Embark on an exciting journey into the realm of software product development wit...

Location

India , Noida

Salary:

Not provided

3Pillar Global

Expiration Date

Until further notice

Requirements

Demonstrated expertise with a minimum of 8 years of relevant experience in data engineering with experience of leading and managing a technical support or data engineering team
Ability to function as a player-coach — leading while also contributing hands-on
Proficiency in Python for data engineering, ETL/ELT workflows, and automation tasks
Solid understanding of data governance, security, and performance optimization practices
Experience designing, creating and maintaining data pipelines in AWS environments, with strong exposure to AWS Data services like S3, Glue, Lambda, and Step Functions, and other related services
Data Architecture: Expert-level understanding of ETL, data warehouse design, and pipeline optimization
Database Expertise: Deep experience with Teradata, Change Data Capture (CDC) processes, and data synchronization
Integration: Experience with Lambda-based integrations, such as triggering SAS or RMJ events
Strong communication skills and ability to translate complex technical concepts for business stakeholders
Resilience: Ability to make critical, autonomous decisions and lead a team in a high-pressure environment

Job Responsibility

Team Management: Manage the on-site team of 3-4 Data Engineers
Roster & Scheduling: Create, manage, and maintain team rosters and schedules to ensure full 8-hour coverage, 7 days a week, including rotational weekend and holiday coverage
Availability: Must be able to work a day shift and manage a team that provides 7-day-a-week coverage, including weekends and holidays on rotation
Coverage Assurance: Handle all team leave requests (planned and unplanned). You are responsible for ensuring coverage is always maintained, especially during medical or other unexpected absences
Performance & SLAs: Act as the primary operational point of contact, ensuring the team executes all tasks efficiently, makes sound decisions, and adheres to all agreed-upon SLAs
Final Escalation Point: Serve as the final technical escalation point for the team
personally handle the most critical job failures and system issues
Expert RCA: Lead all high-priority Root Cause Analysis (RCA) efforts, documenting solutions and implementing permanent fixes to prevent recurrence
Strategic Improvement: Drive the team's efforts in performance tuning and AWS Glue cost optimization
Automation Strategy: Define and lead the development of new automation jobs (using Glue, Lambda, and Step Functions) to reduce manual support tasks

Fulltime

New

Lead Data Engineer

We're looking for a Lead Data Engineer to build the data infrastructure that pow...

Location

United States

Salary:

185000.00 - 225000.00 USD / Year

Zora

Expiration Date

Until further notice

Requirements

7+ years of experience in data engineering, with at least 2 years in a technical leadership role
Strong proficiency in Python and SQL for building production data pipelines, complex data transformations and evolving data platforms, shared infrastructure, and internal tooling with engineering best practices.
Strong experience in designing, building, and maintaining cloud-based data pipelines using orchestration tools such as Airflow, Dagster, Prefect, Temporal, or similar.
Hands-on experience with cloud data platforms (AWS, GCP, or Azure) and modern data stack tools
Deep understanding of data warehousing concepts and experience with platforms like Snowflake, BigQuery, Redshift, or similar
Strong software engineering fundamentals including testing, CI/CD, version control, and writing maintainable, documented code
Track record of optimizing data systems for performance, reliability, and cost efficiency at scale
Excellent communication skills and ability to collaborate with cross-functional teams including product, engineering, and design

Job Responsibility

Design and build scalable data pipelines to ingest, process, and transform blockchain data, trading events, user activity, and market signals at high volume and low latency
Architect and maintain data infrastructure that powers real-time trading analytics, P&L calculations, leaderboards, market cap tracking, and liquidity monitoring across the platform
Own ETL/ELT processes that transform raw onchain data from multiple blockchains into clean, reliable, and performant datasets used by product, engineering, analytics, and ML teams
Build and optimize data models and schemas that support both operational systems (serving live trading data) and analytical use cases (understanding market dynamics and user behavior)
Establish data quality frameworks including monitoring, alerting, testing, and validation to ensure pipeline reliability and data accuracy at scale
Collaborate with backend engineers to design event schemas, data contracts, and APIs that enable real-time data flow between systems
Partner with product and analytics teams to understand data needs and translate them into robust engineering solutions
Provide technical leadership by mentoring engineers, conducting code reviews, establishing best practices, and driving architectural decisions for the data platform
Optimize performance and costs of data infrastructure as we scale to handle exponentially growing trading volumes

What we offer

Remote-First Culture: Work from anywhere in the world!
Competitive Compensation: Including salary, pre-IPO stock options, token compensation, and additional financial incentives
Comprehensive Benefits: Robust healthcare options, including fully covered medical, dental, and vision for employees
Retirement Contributions: Up to 4% employer match on your 401(k) contributions
Health & Wellness: Free memberships to One Medical, Teladoc, and Health Advocate
Unlimited Time Off: Flexible vacation policies, company holidays, and recharge weeks to prioritize wellness
Home Office Reimbursement: To cover home office items, monthly home internet, and monthly cell phone (if applicable)
Ease of Life Reimbursement: To cover everything from an Uber home in the rain, childcare, or meal delivery
Career Development: Access to mentorship, training, and opportunities to grow your career
Inclusive Environment: A culture dedicated to diversity, equity, inclusion, and belonging

Fulltime

New

Lead Data Engineer

Sparteo is an independent suite of AI-powered advertising technologies built on ...

Location

Salary:

Not provided

Sparteo

Expiration Date

Until further notice

Requirements

Proficiency in distributed data systems
Proficient in clustering, various table types, and data types
Strong understanding of materialized views concepts
Skilled in designing table sorting keys
Solid programming skills in Python, Java, or Scala
Expertise in database technologies (SQL, NoSQL)
You are comfortable using AI-assisted development tools (e.g., GitHub Copilot, Tabnine)
Proven experience leading data teams in fast-paced environments
Ability to mentor junior engineers and foster a culture of growth and collaboration
Data-driven decision-making abilities aligned with Sparteo's focus on results and improvement

Job Responsibility

Data Infrastructure Design and Optimization
Lead the design, implementation, and optimization of data architectures to support massive data pipelines
Ensure the scalability, security, and performance of the data infrastructure
Collaborate with software and data scientists to integrate AI-driven models into data workflows
Leadership and Team Management
Manage and mentor a team of 2 data engineers, fostering a culture of continuous improvement
Oversee project execution and delegate responsibilities within the team
Guide technical decisions and promote best practices in data engineering
Collaboration and Cross-Functional Engagement
Work closely with product managers, developers, and analytics teams to define data needs and ensure alignment with business objectives

What we offer

A convivial and flexible working environment, with our telecommuting culture integrated into the company's organization
A friendly and small-sized team that you can find in our offices near Lille or in Paris
Social gatherings and company events organized throughout the year
Sparteo is experiencing significant growth both in terms of business and workforce, especially internationally
Additional benefits include an advantageous compensation system with non-taxable and non-mandatory overtime hours, as well as a Swile restaurant ticket card

Fulltime

New

Lead Data Engineer

As a Lead Data Engineer at Rearc, you'll play a pivotal role in establishing and...

Location

India , Bengaluru

Salary:

Not provided

Rearc

Expiration Date

Until further notice

Requirements

10+ years of experience in data engineering, data architecture, or related fields
Extensive experience in writing and testing Java and/or Python
Proven experience with data pipeline orchestration using platforms such as Airflow, Databricks, DBT or AWS Glue
Hands-on experience with data analysis tools and libraries like Pyspark, NumPy, Pandas, or Dask
Proficiency with Spark and Databricks is highly desirable
Proven track record of leading complex data engineering projects, including designing and implementing scalable data solutions
Hands-on experience with ETL processes, data warehousing, and data modeling tools
In-depth knowledge of data integration tools and best practices
Strong understanding of cloud-based data services and technologies (e.g., AWS Redshift, Azure Synapse Analytics, Google BigQuery)
Strong strategic and analytical skills

Job Responsibility

Understand Requirements and Challenges: Collaborate with stakeholders to deeply understand their data requirements and challenges
Implement with a DataOps Mindset: Embrace a DataOps mindset and utilize modern data engineering tools and frameworks, such as Apache Airflow, Apache Spark, or similar, to build scalable and efficient data pipelines and architectures
Lead Data Engineering Projects: Take the lead in managing and executing data engineering projects, providing technical guidance and oversight to ensure successful project delivery
Mentor Data Engineers: Share your extensive knowledge and experience in data engineering with junior team members, guiding and mentoring them to foster their growth and development in the field
Promote Knowledge Sharing: Contribute to our knowledge base by writing technical blogs and articles, promoting best practices in data engineering, and contributing to a culture of continuous learning and innovation

New

Lead Data Engineer

As a Lead Data Engineer at Rearc, you'll play a pivotal role in establishing and...

Location

United States

Salary:

Not provided

Rearc

Expiration Date

Until further notice

Requirements

10+ years of experience in data engineering, data architecture, or related technical fields
Proven ability to design, build, and optimize large-scale data ecosystems
Strong track record of leading complex data engineering initiatives
Deep hands-on expertise in ETL/ELT design, data warehousing, and data modeling
Extensive experience with data integration frameworks and best practices
Advanced knowledge of cloud-based data services and architectures (AWS Redshift, Azure Synapse Analytics, Google BigQuery, or equivalent)
Strong strategic and analytical thinking
Proficiency with modern data engineering frameworks (Databricks, Spark, lakehouse technologies like Delta Lake)
Exceptional communication and interpersonal skills

Job Responsibility

Engage deeply with stakeholders to understand data needs, business challenges, and technical constraints
Translate stakeholder needs into scalable, high-quality data solutions
Implement with a DataOps mindset using tools like Apache Airflow, Databricks/Spark, Kafka
Build reliable, automated, and efficient data pipelines and architectures
Lead and execute complex projects
Provide technical direction and set engineering standards
Ensure alignment with customer goals and company principles
Mentor and develop data engineers
Promote knowledge sharing and thought leadership
Contribute to internal and external content

What we offer

Comprehensive health benefits
Generous time away and flexible PTO
Maternity and paternity leave
Access to educational resources with reimbursement for continued learning
401(k) plan with company contribution

New

Data Engineering & Analytics Lead

Premium Health is seeking a highly skilled, hands-on Data Engineering & Analytic...

Location

United States , Brooklyn

Salary:

Not provided

Premium Health

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred
Proven track record and progressively responsible experience in data engineering, data architecture, or related technical roles
healthcare experience preferred
Strong knowledge of data engineering principles, data integration, ETL processes, and semantic mapping techniques and best practices
Experience implementing data quality management processes, data governance frameworks, cataloging, and master data management concepts
Familiarity with healthcare data standards (e.g., HL7, FHIR, etc), health information management principles, and regulatory requirements (e.g., HIPAA)
Understanding of healthcare data, including clinical, operational, and financial data models, preferred
Advanced proficiency in SQL, data modeling, database design, optimization, and performance tuning
Experience designing and integrating data from disparate systems into harmonized data models or semantic layers
Hands-on experience with modern cloud-based data platforms (e.g Azure, AWS, GCP)

Job Responsibility

Collaborate with the CDIO and Director of Technology to define a clear data vision aligned with the organization's goals and execute the enterprise data roadmap
Serve as a thought leader for data engineering and analytics, guiding the evolution of our data ecosystem and championing data-driven decision-making across the organization
Build and mentor a small data team, providing technical direction and performance feedback, fostering best practices and continuous learning, while remaining a hands-on implementor
Define and implement best practices, standards, and processes for data engineering, analytics, and data management across the organization
Design, implement, and maintain a scalable, reliable, and high-performing modern data infrastructure, aligned with the organizational needs and industry best practices
Architect and maintain data lake/lakehouse, warehouse, and related platform components to support analytics, reporting, and operational use cases
Establish and enforce data architecture standards, governance models, naming conventions ,and documentation
Develop, optimize, and maintain scalable ETL/ELT pipelines and data workflows to collect, transform, normalize, and integrate data from diverse systems
Implement robust data quality processes, validation, monitoring, and error-handling frameworks
Ensure data is accurate, timely, secure, and ready for self-service analytics and downstream applications

What we offer

Paid Time Off, Medical, Dental and Vision plans, Retirement plans
Public Service Loan Forgiveness (PSLF)

Fulltime

New

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...

Location

India , Chennai, Madurai, Coimbatore

Salary:

Not provided

OptiSol Business Solutions

Expiration Date

Until further notice

Requirements

Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
Excellent Python programming skills with data engineering libraries and frameworks
Advanced SQL capabilities including window functions, CTEs, and performance tuning
Solid understanding of distributed processing using Spark/PySpark
Experience designing and implementing scalable ETL/ELT workflows
Good understanding of data modeling concepts (dimensional, star, snowflake)
Familiarity with GenAI/LLM-based integration for data workflows
Experience working with Git, CI/CD, and Agile delivery frameworks
Strong communication skills for interacting with clients, stakeholders, and internal teams

Job Responsibility

Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations

What we offer

Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
Hands-on exposure to modern data stacks and emerging AI technologies
Collaboration with experts across Data, AI/ML, and cloud practices
Access to structured learning, certifications, and leadership mentoring
Competitive compensation with fast-track career growth and visibility

Fulltime

New

Lead Data Engineer

Our client, a leading energy company based in Edinburgh, Scotland, is seeking a ...

Location

United Kingdom , Edinburgh

Salary:

Not provided

Net Talent

Expiration Date

Until further notice

Requirements

Proven experience as a Data Engineer, with a focus on Python development and data pipeline architecture
Hands-on experience with Snowflake data warehousing platform
Experience working in a data management environment, ideally within a major client or enterprise setting
Strong understanding of data modelling, ETL/ELT processes, and data security standards
Demonstrated leadership capabilities, with experience mentoring or managing junior team members
Excellent communication skills and the ability to collaborate across various departments
Problem-solving mindset with a passion for innovative data solutions and continuous learning

Job Responsibility

Design, develop, and maintain scalable data pipelines and architectures to support business analytics and reporting needs
Lead and mentor a team of data engineers, ensuring best practices in data engineering methodologies and tools
Collaborate with cross-functional teams including data analysts, data scientists, and business stakeholders to understand data requirements
Implement data security, governance, and compliance standards across all data solutions
Utilise Snowflake for data warehousing solutions, ensuring optimal performance and security
Develop automation scripts and optimise data workflows for efficiency and reliability
Monitor and troubleshoot data pipelines to resolve issues promptly, ensuring data integrity and availability

What we offer

Excellent package on offer
supportive work environment
competitive salary
opportunities for professional development
collaborative culture that fosters growth and innovation

Fulltime

Data Engineering Lead

3Pillar Global

Location:
India

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Requirements:

Additional Information:

Job Posted:
December 14, 2025

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Data Engineering Lead

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Data Engineering & Analytics Lead

Senior Data Engineer – Data Engineering & AI Platforms

Lead Data Engineer

Data Engineering Lead

3Pillar Global

Location:India

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Requirements:

Additional Information:

Job Posted:December 14, 2025

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Data Engineering Lead

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Data Engineering & Analytics Lead

Senior Data Engineer – Data Engineering & AI Platforms

Lead Data Engineer

Location:
India

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
December 14, 2025