CrawlJobs Logo

Azure Data Engineer - Lead Consultant

India · Job Posted January 05, 2026
Apply Position
Job Link Share

Job Responsibility

  • Provide leadership and guidance to the data engineering team, including mentoring, coaching, and fostering a collaborative work environment
  • Set clear goals, assign tasks, and manage resources to ensure successful project delivery
  • Work closely with developers to support them and improve data engineering processes
  • Support team members with troubleshooting and resolving complex technical issues and challenges
  • Provide technical expertise and direction in data engineering, guiding the team in selecting appropriate tools, technologies, and methodologies
  • Stay updated with the latest advancements in data engineering and ensure the team follows best practices and industry standards
  • Collaborate with stakeholders to understand project requirements, define scope, and create project plans
  • Support project managers to ensure that projects are executed effectively, meeting timelines, budgets, and quality standards
  • Monitor progress, identify risks, and implement mitigation strategies
  • Act as a trusted advisor for the customer
  • Oversee the design and architecture of data solutions, collaborating with data architects and other stakeholders
  • Ensure data solutions are scalable, efficient, and aligned with business requirements
  • Provide guidance in areas such as data modeling, database design, and data integration
  • Align coding standards, conduct code reviews to ensure proper code quality level
  • Identify and introduce quality assurance processes for data pipelines and workflows
  • Optimize data processing and storage for performance, efficiency and cost savings
  • Evaluate and implement new technologies to improve data engineering processes on various aspects (CICD, Quality Assurance, Coding standards)
  • Act as main point of contact to other teams/contributors engaged in the project
  • Maintain technical documentation of the project, control validity and perform regular reviews of it
  • Ensure compliance with security standards and regulations

Requirements

  • A bachelor's or master’s degree in computer science, Information Systems, or a related field is typically required
  • Additional certifications in cloud are advantageous
  • Minimum of 6+ years of experience in data engineering or a related field
  • Strong technical skills in data engineering, including proficiency in programming languages such as Python, SQL, Pyspark
  • Experience in profiling tool such as Pandas
  • Familiarity with Azure cloud platform viz. Azure Databricks, Data Factory, Data Lake, Azure SQL etc., and experience in implementing data solutions in a cloud environment
  • Expertise in working with various data tools and technologies, such as ETL frameworks, data pipelines, and data warehousing solutions
  • Proven experience in leading and managing a team of data engineers, providing guidance, mentorship, and technical support
  • In-depth knowledge of data management principles and best practices, including data governance, data quality, and data integration
  • Strong project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results within designated deadlines
  • Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues
  • Knowledge of data security and privacy regulations, and the ability to ensure compliance within data engineering projects
  • Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams, stakeholders, and senior management
  • Continuous learning mindset, staying updated with the latest advancements and trends in data engineering and related technologies

What we offer

  • Stable employment
  • “Office as an option” model
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Internal Gallup Certified Strengths Coach to support your growth
  • Grow as we grow as a company
  • A diverse, inclusive, and values-driven community
  • Autonomy to choose the way you work
  • Create our community together
  • Activities to support your well-being and health
  • Plenty of opportunities to donate to charities and support the environment
  • Modern office equipment

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Azure Data Engineer - Lead Consultant

8 matching positions

Azure Data Engineer- Lead Consultant

Location
Location
India
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A bachelor's or master's degree in Computer Science, Information Systems, or a related field is typically required
  • Minimum of 8 years of experience in data engineering or a related field
  • Strong technical skills in data engineering, including proficiency in programming languages such as Python, SQL, Pyspark
  • Familiarity with Azure cloud platform viz. Azure Databricks, Data Factory, Data Lake etc., and experience in implementing data solutions in a cloud environment
  • Expertise in working with various data tools and technologies, such as ETL frameworks, data pipelines, and data warehousing solutions
  • In-depth knowledge of data management principles and best practices, including data governance, data quality, and data integration
  • Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues
  • Knowledge of data security and privacy regulations, and the ability to ensure compliance within data engineering projects
  • Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams, stakeholders, and senior management
  • Continuous learning mindset, staying updated with the latest advancements and trends in data engineering and related technologies
Job Responsibility
Job Responsibility
  • Provide leadership and guidance to the data engineering team, including mentoring, coaching, and fostering a collaborative work environment
  • Set clear goals, assign tasks, and manage resources to ensure successful project delivery
  • Work closely with developers to support them and improve data engineering processes
  • Support team members with troubleshooting and resolving complex technical issues and challenges
  • Provide technical expertise and direction in data engineering, guiding the team in selecting appropriate tools, technologies, and methodologies
  • Stay updated with the latest advancements in data engineering and ensure the team follows best practices and industry standards
  • Collaborate with stakeholders to understand project requirements, define scope, and create project plans
  • Support project managers to ensure that projects are executed effectively, meeting timelines, budgets, and quality standards
  • Monitor progress, identify risks, and implement mitigation strategies
  • Act as a trusted advisor for the customer
What we offer
What we offer
  • Stable employment
  • 100% remote
  • Flexibility regarding working hours
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Grow as we grow as a company
  • A diverse, inclusive, and values-driven community
  • Fulltime
Read More
Arrow Right

Technical Support Engineer - Azure Data Factory / Data Integration

Within CE&S, the Customer Service & Support (CSS) organization builds trust and ...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology (IT), or related field AND 1+ years of technical support, technical consulting experience, or information technology experience
  • OR 3+ years of technical support, technical consulting experience, or information technology experience
  • OR equivalent experience
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics / Microsoft Fabric Pipeline
  • Data Lake
  • Relational Database Management System (Microsoft SQL Server / Oracle Database / MySQL / IBM Db2 / SAP)
  • Big Data or Analytics Products (Spark / Azure HDInsight / Azure Data Lake Analytics / Azure Synapse Analytics / Databricks / Google BigQuery)
  • Pipeline and ETL/ELT Skills
  • Building and orchestrating pipelines (ADF / Synapse / Fabric)
Job Responsibility
Job Responsibility
  • Response and Resolution: You own, investigate and solve customer technical issues. You collaborate within and across teams, leveraging troubleshooting tools and practices
  • Readiness: You lead or participate in building communities with peer delivery roles and, where appropriate, share your knowledge
  • You develop specific technical and professional proficiency to enable you to resolve customer issues, through training and readiness
  • Product/Process Improvement: You identify potential product defects and escalate appropriately to resolve, contributing to Microsoft product improvements
  • Fulltime
Read More
Arrow Right

Data Engineer – Lead

Data Engineer – Lead
Location
Location
India , Bengaluru Urban
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Pipelines, Dataflows Gen2, Notebooks, and Power BI integration
  • Expertise in ETL/ELT, data pipelines, distributed data processing, and cloud-scale data engineering
  • Strong SQL, Python, PySpark, and data modeling skills
  • Experience with Lakehouse, Warehouse, and Medallion Architecture
  • Understanding of Delta tables, dimensional modeling, star schema, facts, dimensions, and curated analytical datasets
  • Experience integrating structured, semi-structured, file-based, API-based, enterprise application, and cloud data sources
  • Experience with data quality, reconciliation, logging, monitoring, and error-handling frameworks
  • Experience leading technical teams and coordinating onshore/offshore delivery
  • Experience with Git, CI/CD, Azure DevOps, branching, code reviews, and release management
  • Good to Have: Experience with Azure Data Factory, Synapse, Databricks, ADLS Gen2, Azure SQL, Microsoft Purview, or related Azure services
Job Responsibility
Job Responsibility
  • Lead the design and implementation of scalable data pipelines and data processing frameworks in Microsoft Fabric
  • Define data engineering standards, development practices, naming conventions, coding guidelines, and reusable technical patterns
  • Lead implementation of Bronze, Silver, and Gold layers in the Medallion Architecture
  • Oversee ingestion, transformation, orchestration, validation, and publication of data from multiple enterprise, clinical, operational, and cloud-based sources
  • Guide development of Fabric Pipelines, Dataflows Gen2, Notebooks, Lakehouse tables, Warehouse objects, and curated datasets
  • Ensure scalability, performance, reliability, maintainability, security, monitoring, and optimization of data solutions
  • Define standards for data quality, reconciliation, logging, error handling, auditability, and lineage
  • Conduct technical design reviews, code reviews, performance reviews, and deployment readiness reviews
  • Mentor and guide data engineering teams across onshore/offshore locations
  • Collaborate with architects, platform engineers, BI teams, QA teams, AI/ML teams, functional consultants, and stakeholders
Read More
Arrow Right

Staff/Senior Software Consultant - Data Engineer

We are hiring for a Senior Data Engineer at 10Pearls responsible for designing, ...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional data engineering experience, including ownership of production pipelines that other teams depended on
  • ETL / ELT: deep experience with Airflow (DAG design, sensors, retries, backfills) and Airbyte (or equivalents like Fivetran, Meltano, or custom connectors)
  • Data warehousing: strong hands-on experience with Snowflake and/or BigQuery, including performance tuning, partitioning/clustering, and cost optimization
  • Transactional databases: solid SQL Server experience covering schema design, indexing, query tuning, and CDC patterns
  • Real-time data: production experience with Firebase / Firestore or comparable real-time stores, and at least one streaming or message-bus technology (Kafka, Azure Service Bus, Pub/Sub, Kinesis)
  • Programming: advanced SQL plus strong Python for data engineering
  • comfortable building reusable, tested, well-documented code
  • Modeling: fluency with dimensional and modern warehouse modeling, and with transformation frameworks such as dbt
  • Cloud storage: hands-on experience with Azure Storage (Blob/ADLS)
  • comfort with AWS S3 or GCS is a plus
Job Responsibility
Job Responsibility
  • Analyze large, complex datasets to extract key insights that inform strategic decision-making
  • Develop and maintain data models, dashboards, and reports to support business objectives
  • Apply statistical techniques and predictive modeling to drive business forecasts and performance analysis
  • Collaborate with data consultant teams to build scalable, reliable data pipelines and optimize data flows
  • Ensure data quality and integrity through best practices in data governance and validation processes
  • Partner with cross-functional teams (engineering, product, marketing) to understand data requirements and deliver customized insights
  • Present findings and actionable recommendations to senior leadership and non-technical stakeholders
  • Lead, mentor, and provide guidance to junior data analysts and team members
  • Manage multiple data projects, prioritize deliverables, and meet tight deadlines with high quality output
  • Implement CI/CD pipelines and version control for data workflows to ensure seamless deployment and collaboration
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

We’re looking for a highly skilled Lead Data Engineer to provide technical leade...
Location
Location
United Kingdom
Salary
Salary:
70000.00 GBP / Year
zebrapeople.com Logo
Zebra People
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong consultancy background across ETL/ELT, data warehousing and big‑data solutions
  • hands‑on delivery experience
  • proven leadership/mentoring in an onshore–offshore model
  • Proficiency with ETL tools and cloud data services (AWS preferred — e.g., Glue
  • with exposure to Azure Data Factory)
  • experience implementing CI/CD for data
  • knowledge of Informatica tools is beneficial
  • Experience working with major databases such as Postgres, Redshift, Oracle, SQL Server or Snowflake
  • strong SQL capability
  • working knowledge of Python/PySpark
Job Responsibility
Job Responsibility
  • Provide technical leadership across data engineering, delivery execution and project governance
  • Interpret detailed technical requirements and deliverables across multiple projects
  • Act as subject‑matter expert in data‑engineering technologies
  • Contribute to effective solution design
  • Mentor, support and guide developers
  • Balance involvement across various initiatives to provide direction, technical leadership and oversight
  • Fulltime
Read More
Arrow Right

Team Lead - Data Engineer

Looking for stable projects with modern tech and room to grow? We are Clouds on ...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
cloudsonmars.com Logo
Clouds on Mars Sp. z o. o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience delivering data engineering solutions in a consulting or multi-client project environment
  • Strong technical expertise with the Microsoft Azure ecosystem (Data Factory, Synapse, Fabric), Databricks, and Power BI
  • Solid background in ETL/ELT design, data integration, data modeling, and performance optimization
  • Proven people management experience, including performance evaluation, coaching, and career development
  • Excellent communication skills and ability to engage with both technical and business stakeholders
  • Fluency in English and Polish
Job Responsibility
Job Responsibility
  • Design and deliver scalable ETL/ELT pipelines, data models, and reporting solutions using technologies such as Azure Data Factory, Synapse, Fabric, Databricks, and Power BI
  • Architect modern data platforms (data warehouse, data lake, or lakehouse) with performance, scalability, and reliability in mind
  • Collaborate with technical stakeholders to translate business requirements into robust, production-ready data solutions
  • Contribute to CI/CD processes, code quality standards, automated testing, and documentation
  • Act as a senior technical contributor across one or more client projects in a consulting setting
  • Act as direct people manager for a team of data engineers, responsible for performance reviews, development planning, and career coaching
  • Conduct regular 1:1s, provide feedback, and support skills growth through mentoring and learning opportunities
  • Balance and allocate team members across multiple projects, ensuring workload clarity and capacity planning
  • Foster a healthy, collaborative team culture by promoting open communication, continuous improvement, and psychological safety
  • Monitor team morale and resolve delivery blockers that affect individual or team performance
What we offer
What we offer
  • Flexible working hours
  • Private health insurance (UNUM up to PLN 350,000, advanced up to PLN 500,000)
  • Co-funding for PZU, Medicover or LuxMed medical packages
  • Multisport card
  • Access to training platforms (MS certificates, SQL BI, internal Delivery Excellence Workshops)
  • Breakfasts, fruit, snacks, and always-chilled drinks in the office
  • Anniversary gifts and quarterly integration budgets
  • Paid referral program (up to PLN 8,000)
  • „It’s good to stay with us” – PLN 2,500 voucher after 3 years with the company
  • Fulltime
Read More
Arrow Right

Senior Azure Data Engineer

Seeking a Lead AI DevOps Engineer to oversee design and delivery of advanced AI/...
Location
Location
Poland
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 6 years of professional experience in the Data & Analytics area
  • 1+ years of experience (or acting as) in the Senior Consultant or above role with a strong focus on data solutions build in Azure and Databricks/Synapse/(MS Fabric is nice to have)
  • Proven experience in Azure cloud-based infrastructure, Databricks and one of SQL implementation (e.g., Oracle, T-SQL, MySQL, etc.)
  • Proficiency in programming languages such as SQL, Python, PySpark is essential (R or Scala nice to have)
  • Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders
  • Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps)
  • Experience in leading and managing a team of data engineers, providing guidance, mentorship, and technical support
  • Knowledge of data management principles and best practices, including data governance, data quality, and data integration
  • Good project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results within designated deadlines
  • Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues
Job Responsibility
Job Responsibility
  • Act as a senior member of the Data Science & AI Competency Center, AI Engineering team, guiding delivery and coordinating workstreams
  • Develop and execute a cloud data strategy aligned with organizational goals
  • Lead data integration efforts, including ETL processes, to ensure seamless data flow
  • Implement security measures and compliance standards in cloud environments
  • Continuously monitor and optimize data solutions for cost-efficiency
  • Establish and enforce data governance and quality standards
  • Leverage Azure services, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions
  • Work with cross-functional teams to understand requirements and provide data solutions
  • Maintain comprehensive documentation for data architecture and solutions
  • Mentor junior team members in cloud data architecture best practices
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Workation
  • Great Place to Work® certified employer
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
Read More
Arrow Right

Lead Data Engineer

The Lead Data Engineer is responsible for building and leading our data engineer...
Location
Location
Salary
Salary:
Not provided
basicagency.com Logo
BASIC/DEPT®
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience in data engineering with a proven track record of leading complex data initiatives
  • Strong technical leadership experience, with the ability to guide and develop engineering teams
  • Deep expertise in designing and implementing data architectures, data pipelines, and ETL processes
  • Hands-on experience with cloud platforms (GCP, AWS, Azure) and their data-specific services
  • Proficiency in Python, SQL, and data orchestration tools (e.g., Airflow, DBT)
  • Experience with modern data warehouse technologies (BigQuery, Snowflake, Redshift, etc.)
  • Strong understanding of data modeling, data governance, and data quality principles
  • Excellent communication skills with the ability to translate complex technical concepts for business stakeholders
  • Strategic thinking with the ability to develop and execute technical roadmaps
  • Experience working in an agency or consulting environment is highly advantageous
Job Responsibility
Job Responsibility
  • Lead the strategic development of our data engineering proposition and capabilities
  • Set technical standards and best practices for data engineering across EMEA
  • Guide and mentor data engineers, fostering a culture of technical excellence and innovation
  • Design and implement scalable, reliable data architectures and pipelines for enterprise clients
  • Serve as the technical authority on client engagements, providing expert guidance
  • Build and grow a high-performing data engineering team
  • Work closely with the broader Data & AI practice to deliver integrated solutions
  • Support business development efforts through technical expertise in client pitches
  • Stay ahead of emerging technologies and methodologies in the data engineering space
What we offer
What we offer
  • A reputation for doing good
  • Awesome clients
  • The opportunity for possibility with training, development and certifications
  • Global annual DEPT® Cares Month in which employees come together and donate their skills to support local charities
  • Additionally
  • each office has its long list of local benefits
Read More
Arrow Right