CrawlJobs Logo
Metyis Logo Metyis · IT - Software Development

Data Engineering Lead

India, Gurgaon · Job Posted February 24, 2026
Apply Position
Job Link Share

Job Description

The next step of your career starts here, where you can bring your own unique mix of skills and perspectives to a fast-growing team. Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering AI & Data, Digital Commerce, Marketing & Design solutions and Advisory services. At Metyis, our long-term partnership model brings long-lasting impact and growth to our business partners and clients through extensive execution capabilities. With our team, you can experience a collaborative environment with highly skilled multidisciplinary experts, where everyone has room to build bigger and bolder ideas. Being part of Metyis means you can speak your mind and be creative with your knowledge. Imagine the things you can achieve with a team that encourages you to be the best version of yourself. We are Metyis. Partners for Impact.

Job Responsibility

  • Independently lead & manage execution of data engineering projects
  • Engineer complete technical solutions to solve concrete business challenges in the areas of digital marketing, eCommerce, Business Intelligence and self-service analytics
  • Collect functional and non-functional requirements, consider technical environments, business constraints and enterprise organizations
  • Support our clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs, web services, training and scoring machine learning models
  • Troubleshoot and quality check work done by team members
  • Collaborate closely with partners, strategy consultants and data scientists in a flat and agile organization where personal initiative is highly valued
  • Share data engineering knowledge by giving technical trainings
  • Communicate and interact with clients at the executive level
  • Guide and mentor team members

Requirements

  • 7-10 years of professional hands-on experience
  • A broad practice in multiple software engineering fields
  • Experience on managing & leading data engineering / warehousing projects
  • Must have experience on Python, SQL and Distributed programming languages, preferable Spark
  • Experience working on Cloud, Azure is a plus
  • Experience working setting up data lakes using entire Big Data and DWH ecosystem
  • Experience on data workflows and ETL, Apache Airflow is a plus
  • Comfortable with Unix OS type systems, Bash and Linux
  • Basic knowledge of webservices and APIs
  • Basic knowledge of Containers and Docker as platform
  • Experience using Version Control, Testing and development cycle, preferable git (Gitlab or GitHub)
  • Knowledge of security practices
  • Software development practices (Agile)
  • A Strong Focus On Data Processing
  • Object oriented programming
  • Data workflows, monitoring, architecture and security
  • Databases: theory and practice
  • Distributed data processing
  • Concepts of functional programming
  • Enterprise data warehousing, business intelligence and ETL principles
  • Good written and oral communication skills in English language

Nice to have

  • Experience working on Cloud, Azure is a plus
  • Experience on data workflows and ETL, Apache Airflow is a plus

What we offer

  • Interact with C-level at our clients on regular basis to drive their business towards impactful change
  • Lead your team in creating new business solutions
  • Seize opportunities at the client and at Metyis in our entrepreneurial environment
  • Become part of a fast-growing international and diverse team
Metyis - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineering Lead

8 matching positions

Data Engineering Lead

Role: Data Engineering Lead. Location: New York, NY. FTE ONLY. Must Have Technic...
Location
Location
United States , New York
Salary
Salary:
138000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • AWS Data Engineering Services (EMR/Glue, Redshift, Aurora, S3, Lambda)
  • Spark
  • Python
  • Collibra
  • Snowflake/Databricks
  • Tableau
  • 4–15 years of professional data engineering experience
  • Strong Python, SQL, and Spark (PySpark) skills, and/or Kafka
  • Snowflake (Snowpipe, Tasks, Streams) as a complementary warehouse
  • Databricks (Delta formats, workflows, cataloging) or equivalent Spark platforms
Job Responsibility
Job Responsibility
  • Ingest and model data from APIs, files/SFTP, and relational sources
  • implement layered architectures (raw/clean/serving) using PySpark/SQL and dbt, Python
  • Design and operate pipelines with Prefect (or Airflow), including scheduling, retries, parameterization, SLAs, and well documented runbooks
  • Build on cloud data platforms, leveraging S3/ADLS/GCS for storage and a Spark platform (e.g., Databricks or equivalent) for compute
  • manage jobs, secrets, and access
  • Publish governed data services and manage their lifecycle with Azure API Management (APIM) authentication/authorization, policies, versioning, quotas, and monitoring
  • Enforce data quality and governance through data contracts, validations/tests, lineage, observability, and proactive alerting
  • Optimize performance and cost via partitioning, clustering, query tuning, job sizing, and workload management
  • Uphold security and compliance (e.g., PII handling, encryption, masking) in line with firm standards
  • Collaborate with stakeholders (analytics, AI engineering, and business teams) to translate requirements into reliable, production ready datasets
  • Fulltime
Read More
Arrow Right

Data Engineering Lead

We’re looking for a Lead Data Engineer who is ready to both lead and build. This...
Location
Location
Salary
Salary:
Not provided
5CA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Located in Albania, Bosnia and Herzegovina, Bulgaria, Greece, Hungary, Kosovo, North Macedonia, Poland, Romania, Serbia, South Africa, or Tunisia
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field
  • Minimum 7 years’ experience in data engineering
  • At least 2 years of leadership experience managing or mentoring engineers
  • Proven experience in designing, building, and maintaining scalable ETL/ELT pipelines and data platforms
  • Proficiency in SQL, Python, and data modelling techniques
  • Experience with cloud-based data architectures (e.g., Azure, AWS, or GCP)
  • Strong understanding of data governance, quality frameworks, and security best practices
  • Experience integrating data from multiple sources, including APIs and third-party systems
  • Familiarity with modern data tools and technologies (e.g., Databricks, Snowflake, Apache Spark, Airflow, Microsoft Fabric)
Job Responsibility
Job Responsibility
  • Lead the strategy, design, and implementation of scalable, high-performance data pipelines, platforms, and architectures
  • Manage the Data Engineering team’s backlog, priorities, and capacity to ensure timely delivery of high-quality outputs
  • Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver fit-for-purpose solutions
  • Oversee and contribute to the development of ETL/ELT processes, data models, and data integration frameworks
  • Ensure data quality, consistency, and governance across all systems and datasets
  • Monitor and optimise data infrastructure for performance, scalability, and cost efficiency
  • Define and enforce engineering best practices, coding standards, and security guidelines
  • Evaluate and adopt new technologies, tools, and frameworks that can improve data engineering capabilities
  • Provide technical leadership and mentorship to data engineers, fostering a high-performance culture
  • Troubleshoot complex data issues and drive root cause analysis and remediation
What we offer
What we offer
  • A position at a fast-paced international company with ambitious gaming, e-commerce, and tech clients
  • A diverse and inclusive culture with people from 80+ countries, speaking 25+ languages - where we celebrate everyone's uniqueness
  • Innovative digital tools, and continuous opportunities for learning and development
  • Various learning and career development initiatives throughout the year
  • Fun employee engagement activities and participation in 5CA employee-led communities such as 5CA Connect, Pride, 5CA Gamers, Women of 5CA, to name a few
  • Fulltime
Read More
Arrow Right

Data Engineering Lead

The next step of your career starts here, where you can bring your own unique mi...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
metyis.com Logo
Metyis
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-10 years of professional hands-on experience
  • A broad practice in multiple software engineering fields
  • Experience on managing & leading data engineering / warehousing projects
  • Must have experience on Python, SQL and Distributed programming languages, preferable Spark
  • Experience working on Cloud, Azure is a plus
  • Experience working setting up data lakes using entire Big Data and DWH ecosystem
  • Experience on data workflows and ETL, Apache Airflow is a plus
  • Comfortable with Unix OS type systems, Bash and Linux
  • Basic knowledge of webservices and APIs
  • Basic knowledge of Containers and Docker as platform
Job Responsibility
Job Responsibility
  • Independently lead & manage execution of data engineering projects
  • Engineer complete technical solutions to solve concrete business challenges in the areas of digital marketing, eCommerce, Business Intelligence and self-service analytics
  • Collect functional and non-functional requirements, consider technical environments, business constraints and enterprise organizations
  • Support our clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs, web services, training and scoring machine learning models
  • Troubleshoot and quality check work done by team members
  • Collaborate closely with partners, strategy consultants and data scientists in a flat and agile organization where personal initiative is highly valued
  • Share data engineering knowledge by giving technical trainings
  • Communicate and interact with clients at the executive level
  • Guide and mentor team members
What we offer
What we offer
  • Interact with C-level at our clients on regular basis to drive their business towards impactful change
  • Lead your team in creating new business solutions
  • Seize opportunities at the client and at Metyis in our entrepreneurial environment
  • Become part of a fast-growing international and diverse team
Read More
Arrow Right

Data Engineering Lead

We are looking for a highly skilled Data Engineering Manager to join our Data En...
Location
Location
United States
Salary
Salary:
215000.00 - 240000.00 USD / Year
yipitdata.com Logo
YipitData
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional experience in Data Engineering or equivalent technical roles (e.g., data architecture, big data development, or ETL engineering)
  • 2+ years of managerial experience, including mentoring, team leadership, and supporting delivery
  • Strong expertise in SQL and distributed data systems
  • Proficiency with PySpark and Databricks for processing and scaling large datasets
  • Hands-on experience with Airflow for pipeline orchestration (Dagster/dbt a plus)
  • Proven track record of delivering in fast-paced, deadline-driven environments with minimal oversight
  • Strong problem-solving skills and ability to translate business needs into scalable technical solutions
  • Excellent communication and collaboration skills with both technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Own the design, build, and optimization of end-to-end data pipelines that power our vendor universe
  • Establish and enforce best practices in data modeling, orchestration, and system reliability
  • Collaborate with product, engineering, and business stakeholders to translate requirements into robust, scalable data solutions
  • Work extensively with Databricks and Airflow for large-scale data processing and orchestration
  • Troubleshoot and resolve complex pipeline issues to ensure reliability and performance
  • Contribute to the team’s technical strategy, helping drive improvements in scalability, performance, and efficiency
  • Lead, mentor, and support engineers through challenges, code reviews, and project execution
What we offer
What we offer
  • flexible work hours
  • flexible vacation
  • a generous 401K match
  • parental leave
  • team events
  • wellness budget
  • learning reimbursement
  • equity
  • Fulltime
Read More
Arrow Right

Data Engineering Lead

Data Engineering Lead (Contract) to take technical ownership of an enterprise Az...
Location
Location
United Kingdom , Hampshire
Salary
Salary:
Not provided
eutopiaonline.com Logo
Eutopia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • hands-on experience
  • technical ownership of an enterprise Azure data platform
  • building, leading, and solving real production challenges
  • experience with Azure Databricks
  • experience with SQL data models
  • experience with Power BI
  • experience with Terraform (Infrastructure as Code)
  • experience with CI/CD using GitHub Actions
  • responsible for stabilising, optimising, and evolving a business-critical platform
Job Responsibility
Job Responsibility
  • take technical ownership of an enterprise Azure data platform
  • building, leading, and solving real production challenges from day one
  • take ownership of a live Azure-based data platform
  • responsible for stabilising, optimising, and evolving it
Read More
Arrow Right

Data Engineering Lead (Ab Initio), Vice President

Are you a senior data engineering expert ready to make an impact at a global fin...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Software development experience in a Banking or Financial Technology environment
  • Extensive, hands-on experience developing complex ETL applications using the Ab Initio tool kit (GDE, Control Centre, Metadata Hub, etc.)
  • Deep expertise in RDBMS (preferably Oracle) and the ability to write advanced SQL to analyse and resolve complex data issues
  • Strong proficiency in UNIX environments and shell scripting
  • Proven experience across the full Software Development Lifecycle (SDLC) and deep familiarity with Agile methodologies and tools like Jira
  • Exceptional analytical and problem-solving skills, with the ability to take ownership, manage risks, and drive tasks to completion
  • Excellent communication and collaboration skills, with the ability to work effectively with business users and cross-functional teams
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Design, develop, and optimize complex, high-performance ETL applications using the full Ab Initio tool kit (GDE, Control Centre, Metadata Hub) to meet business and functional requirements
  • Collaborate closely with business users, financial analysts, and cross-functional technology teams to understand requirements, provide effort estimates, and ensure timely delivery of solutions
  • Drive all phases of the software development lifecycle (SDLC) within an Agile methodology, including preparing handover documents, performing unit/SIT testing, and supporting UAT and production implementations
  • Utilize your SQL and RDBMS knowledge to investigate and analyze complex data issues, ensuring the integrity and reliability of financial data within the Oracle ledger
  • Innovate and improve processes by designing and creating automated utilities that enhance system performance and efficiency
  • Take ownership of technical issues by monitoring processes, resolving testing defects, and managing bug tracking in Jira
What we offer
What we offer
  • Generous holiday allowance starting at 27 days plus bank holidays
  • increasing with tenure
  • A discretional annual performance related bonus
  • Private medical insurance packages to suit your personal circumstances
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Senior Squad Lead – Data Engineering

As Senior Squad Lead – Data Engineering, key responsibilities will include: Lead...
Location
Location
United Kingdom , Newcastle
Salary
Salary:
130000.00 GBP / Year
t2mresourcing.com Logo
T2M Resourcing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Leading a pod/squad of 6 Data Engineers building data intensive application and pipelines
  • Broad experience in platform, deployment and hosting (AWS, Azure or GCP), as well as tools like Airflow, Spark and Databricks
  • Curious leader, with high EQ, who enjoys solving stakeholder problems
  • Track record of performant pod or squad leadership
  • Must be eligible for or already hold SC clearance
  • Sole UK nationals only
Job Responsibility
Job Responsibility
  • Leading a pod/squad of 6 Data Engineers building data intensive application and pipelines
  • Working on a range of defence applications from data analytics and Intelligence platforms, defence AI, drones to command-and-control systems
  • Fulltime
Read More
Arrow Right

Data Engineering Lead - Reporting and Analytics - Vice President

Are you looking for a career move that will put you at the heart of a global fin...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience in building high scalable, reliable dashboards covering suite of industry products like Tableau, AG Grid, Oracle and Java
  • Well versed with Front end - React, Angular and Back end Tech stack
  • Experience in all aspects of Data using Python for Reconciliations, Data Comparison, Data Quality and Data Security for SAAS or Cloud based platform
  • Relevant experience in leading development for enterprise scale platforms, products, or frameworks preferably using Unix/SQL/Oracle/NoSql/Netezza/Teradata
  • Strong experience in managing development activities for applications with huge Data and complex rules/transformations
  • Demonstrated experience in collaborating with different teams to ensure proactive Cross application/downstream impact analysis, responsible for creating test plans and strategy across multiple business critical applications in Finance
  • Experience with existing Citi applications, implementations and Configurations
Job Responsibility
Job Responsibility
  • Leading the buildout of Engineering tools, real time dashboards using Tableau, AG Grid, Java, Unix and Oracle
  • Build AI capabilities for all qualified used cases
  • Performing initiatives related to Development, Functional Testing, SIT, User Acceptance Testing (UAT) process and product rollout into production
  • You will be a specialist who works with technology project managers, UAT professionals and users to design and implement appropriate scripts/plans for an application testing strategy/approach
  • Responsibilities may also include software quality assurance testing
  • Analyses trends at an organizational level to improve data related processes
  • follows and analyses AI industry trends and how to fit those in Citi ecosystem
  • Responsible for handling day-to-day staff management issues, including resource management and allocation of work within the team/project
What we offer
What we offer
  • Generous holiday allowance starting at 27 days plus bank holidays
  • increasing with tenure
  • A discretional annual performance related bonus
  • Private medical insurance packages to suit your personal circumstances
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right