CrawlJobs Logo
NTT DATA Logo NTT DATA · IT - Software Development

Data Engineer Senior Consultant

India, Bangalore · Job Posted May 20, 2026
Apply Position
Job Link Share

Job Description

The Data Engineer will play a crucial role in migrating data from on-prem DataLake to AWS LakeHouse. This position requires a minimum of 3-5 years of experience in data engineering, with strong skills in Python and SQL. The candidate will engage with stakeholders to ensure data integrity and will be responsible for translating legacy data patterns for compatibility with modern tools. A Bachelor's or Master's degree in a relevant field is required.

Job Responsibility

  • Perform end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
  • Pipeline Migration: Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Data Transfer: Executing the physical migration of underlying datasets while ensuring data integrity
  • Stakeholder Engagement: Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners to ensure migrated assets meet business requirements
  • Consumption Pattern Migration: Code Conversion - Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg
  • Usage analysis: Understand usage patterns to deliver the required data products
  • Data Reconciliation & Quality: Work with reconciliation frameworks to build confidence that migrated data is functionally equivalent to that already used within production flows
  • Work with other internal data management platform and have an aptitude for learning new workflows and language constructs as necessary

Requirements

  • Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
  • Ability to troubleshoot (SQL) and basic scripting experience
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices & K8s deployment experience
  • Temporal Data Modeling: Managing state changes over time (e.g., SCD Type 2)
  • Schema Management: Expertise in Schema Evolution (Ref: Iceberg Apache) and enforcement strategies
  • Performance Optimization: Advanced knowledge of data partitioning and clustering
  • Architectural Theory: Balancing Normalization vs. Denormalization and the strategic use of Natural vs. Surrogate Keys
NTT DATA - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer Senior Consultant

8 matching positions

Data Engineer Senior Consultant

Location
Location
India , Pune
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in cloud-based data engineering
  • Specializing in Snowflake and AWS ecosystem
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable ETL/ELT pipelines using AWS Glue, Snowflake, and SQL-based frameworks
  • Build and manage data ingestion frameworks using APIs, batch, and streaming mechanisms
  • Design efficient data transformation logic using SQL / PL-SQL and Snowflake capabilities
  • Implement incremental and real-time data processing pipelines
  • Develop and maintain cloud-native data platforms leveraging AWS S3, Glue, Redshift/Snowflake integration
  • Architect and optimize data lakes and data warehouses
  • Ensure high performance, cost efficiency, and scalability of data solutions
  • Design, build, and optimize Snowflake data warehouse solutions
  • Implement data modeling, partitioning, clustering, and performance tuning
  • Work with secure data sharing, governance, and data optimization techniques
Read More
Arrow Right

Data Engineer Senior Consultant

We are currently seeking a Data Engineer Senior Consultant to join our team in B...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–8+ years of experience as a Data Engineer with strong hands‑on expertise in Azure (Data Factory, Databricks, Data Lake Storage, SQL, Synapse preferred).
  • Proven ability to build production‑grade ETL/ELT pipelines supporting complex, multi‑regional business processes.
  • Experience designing or implementing rules engines (Drools, ODM, or similar).
  • Strong SQL skills and experience with data modeling, data orchestration, and pipeline optimization.
  • Experience working in Agile Scrum teams and collaborating across global regions (U.S. and India preferred).
  • Ability to partner closely with analysts and business stakeholders to translate rules into technical solutions.
  • Excellent debugging, optimization, and engineering problem‑solving skills.
  • Minimum Skills Required: SQL, Python, Azure Data Factory, Databricks, Azure Synapse
Job Responsibility
Job Responsibility
  • ETL Engineering & Data Pipeline Development
  • Business Rules Engine Development
  • Data Modeling & Modern Architecture Implementation
  • Cross‑Functional Collaboration
  • Quality, Performance & Reliability
  • Fulltime
Read More
Arrow Right

Gcp Data Engineer- Senior Consultant

Location
Location
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 9+ years’ experience as DE - Python, GCP, BigQuery
  • Object oriented programming, Python and SQL
  • Strong knowledge in cloud computing platforms - Google Cloud - Candidate should be able to design, build, and deploy data pipelines in the cloud, to ingest data from various sources like databases, APIs or streaming platforms
  • Experience in composer or Apache Airflow and knowledge of Dataplex is a plus
  • Experience in dq checks implementation, any frameworks like Clouddq, Pydeequ
  • Good Knowledge of Dq dimensions
  • Experience working with GCP cloud-based infrastructure & systems
  • Programming skills (SQL, Python, other scripting)
  • Proficient in data modelling techniques and database optimization
  • Knowledge of query optimization, indexing, and performance tuning is necessary for efficient data retrieval and processing
Job Responsibility
Job Responsibility
  • Modelling the data from various sources and technologies
  • Troubleshooting and supporting the most complex and high impact problems, to deliver new features and functionalities
  • Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems
  • Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval
  • Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency
  • Identifying and resolving issues related to data processing, storage, or infrastructure
  • Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations
  • Train and mentor junior data engineers, providing guidance and knowledge transfer
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Internal Gallup Certified Strengths Coach to support your growth
  • Fulltime
Read More
Arrow Right

Azure Data Engineer- Senior Consultant

Location
Location
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A Bachelor's or master's degree in computer science, Information Systems, or a related field is typically required. Additional certifications in cloud are advantageous
  • Minimum of 9+ years of experience in data engineering or a related field
  • Strong technical skills in data engineering, including proficiency in programming languages such as Python, SQL, Pyspark
  • Familiarity with Azure cloud platform viz. Azure Databricks, Data Factory, Data Lake etc., and experience in implementing data solutions in a cloud environment
  • Expertise in working with various data tools and technologies, such as ETL frameworks, data pipelines, and data warehousing solutions
  • In-depth knowledge of data management principles and best practices, including data governance, data quality, and data integration
  • Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues
  • Knowledge of data security and privacy regulations, and the ability to ensure compliance within data engineering projects
  • Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams, stakeholders, and senior management
  • Continuous learning mindset, staying updated with the latest advancements and trends in data engineering and related technologies
Job Responsibility
Job Responsibility
  • Provide technical expertise and direction in data engineering, guiding the team in selecting appropriate tools, technologies, and methodologies
  • Stay updated with the latest advancements in data engineering and ensure the team follows best practices and industry standards
  • Collaborate with stakeholders to understand project requirements, define scope, and create project plans
  • Support project managers to ensure that projects are executed effectively, meeting timelines, budgets, and quality standards
  • Monitor progress, identify risks, and implement mitigation strategies
  • Oversee the design and architecture of data solutions, collaborating with data architects and other stakeholders
  • Ensure data solutions are scalable, efficient, and aligned with business requirements
  • Provide guidance in areas such as data modeling, database design, and data integration
  • Align coding standards, conduct code reviews to ensure proper code quality level
  • Identify and introduce quality assurance processes for data pipelines and workflows
What we offer
What we offer
  • Stable employment
  • 100% remote
  • Flexibility regarding working hours
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Grow as we grow as a company
  • A diverse, inclusive, and values-driven community
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, build, and opt...
Location
Location
Bulgaria , Sofia
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake
  • Strong programming skills in Python and SQL
  • Proven experience building batch and streaming data pipelines and production-grade data platforms
  • Solid understanding of data modeling, data quality, and governance principles
  • Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP
  • Familiarity with modern data platforms such as Databricks and Snowflake
  • Experience with lakehouse architectures and distributed data systems
  • Strong understanding of scalability, reliability, and performance considerations in data pipelines
  • Strong problem-solving skills focused on scalability and reliability
  • Collaborative approach to working in cross-functional teams
Job Responsibility
Job Responsibility
  • Design and implement scalable data platforms and pipelines across cloud environments using technologies such as Spark and Delta Lake
  • Build ingestion, transformation, and curation workflows for both structured and unstructured data
  • Implement modern data architectures including lakehouse patterns and medallion layering
  • Deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems
  • Enable data pipelines for GenAI use cases including LLMs, RAG pipelines, and vector-based data flows
  • Design scalable logical and physical data models for analytical and operational use cases
  • Orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents
  • Apply modern architecture patterns including event-driven and streaming architectures
  • Ensure adherence to best practices in data governance, lineage, quality, and access control
  • Establish strong data observability
What we offer
What we offer
  • Flexibility with hybrid work options and 25 vacation days
  • Co-subsidized transportation & Multisport cards
  • Premium health insurance
  • Training policy for technical and other skills-related events, courses and certifications
  • Personal career development roadmap guided by performance evaluations
  • Self-care program offering psychological consultations & discussions
  • Cozy office space
  • Exciting team events and company gatherings
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, build, and opt...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake
  • Strong programming skills in Python and SQL
  • Proven experience building batch and streaming data pipelines and production-grade data platforms
  • Solid understanding of data modeling, data quality, and governance principles
  • Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP
  • Familiarity with modern data platforms such as Databricks and Snowflake
  • Experience with lakehouse architectures and distributed data systems
  • Strong understanding of scalability, reliability, and performance considerations in data pipelines
  • Strong problem-solving skills focused on scalability and reliability
  • Collaborative approach to working in cross-functional teams
Job Responsibility
Job Responsibility
  • Design and implement scalable data platforms and pipelines across cloud environments (Azure/Fabric, AWS, GCP, Databricks, Snowflake)
  • Develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
  • Build ingestion, transformation, and curation workflows for both structured and unstructured data
  • Implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold)
  • Deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems
  • Enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows), as well as agent-based architectures and intelligent workflows
  • Design scalable logical and physical data models for analytical and operational use cases
  • Orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents
  • Apply modern architecture patterns including event-driven and streaming architectures
  • Ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC)
What we offer
What we offer
  • Flexibility, with remote and hybrid work options (country-dependent)
  • Career advancement, with international mobility and professional development programs
  • Learning and development, with access to cutting-edge tools, training and industry experts
  • Fulltime
Read More
Arrow Right

Senior Consultant - Data & AI

Microsoft Industry Solutions - Global Center for Innovation and Delivery Center ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience
  • Bachelor's degree in computer science engineering or equivalent work experience
  • Customer facing Project delivery leadership experience involving solution design, project envisioning, planning, development and deployment of complex solutions with minimum of 5 plus years
  • Data Architecture & Platform Engineering
  • AI-First Delivery
  • Engineering Excellence & DataOps
  • AI / ML & Intelligent Systems
  • Innovation & Technical Thought Leadership
  • Team Leadership & Mentorship
  • Soft Skills & Mindset
Job Responsibility
Job Responsibility
  • Lead technical delivery of complex, cloud native and AI enabled engagements, contributing as a hands-on individual contributor and, where required, leading engineering teams to ensure high-quality, predictable outcomes
  • Define and drive the technology strategy for large and complex customer engagements, ensuring solutions are scalable, secure, compliant, and aligned to business objectives, architectural best practices, and Microsoft reference architectures
  • Design, develop, and deploy solutions on Microsoft Azure, accelerating customer value through the effective use of Microsoft technologies, platforms, and delivery methodologies while meeting quality, time, and cost constraints
  • Identifies the best practice approach for a project, across a wide scope of technical issues, and develops or reuses intellectual capital (IP) with customers, world-wide, and programs and initiatives across Microsoft
  • Identifies dependencies and risks that go beyond the immediate scope and timeframe for a complex project
  • Develops contingency plans, risk-mitigation implementation criteria, and alternative strategies to manage short- and long-term risks and manages technical escalations
  • Collaborates, as appropriate, with peers and cross-functional teams to scale the business with existing high-stake or strategic customers, by articulating/developing value propositions for strategic Microsoft products and services
  • Drives AI-First data engineering principles and mindset in the team to make the best of AI tools and services while helping in orchestration, transformation, and operationalization of AI/ML-powered data solutions
  • Continuously upskill self to become strong Full stack data engineer, inspire their team as much, to be able to build future-ready skills, collaborate with other specialist teams, product teams, and customers to co-create innovative solutions and help the customers tackle some of their biggest challenges
  • Drives new ways of thinking, across the division and subsidiary, to improve quality, engineering productivity, and responsiveness to feedback and changing priorities
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Senior Data Engineer - UKRAINE - REMOTE. We are looking for an experienced Senio...
Location
Location
Ukraine
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake
  • strong programming skills in Python and SQL
  • proven experience building batch and streaming data pipelines and production-grade data platforms
  • solid understanding of data modeling, data quality, and governance principles
  • experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP
  • familiarity with modern data platforms such as Databricks and Snowflake
  • experience with lakehouse architectures and distributed data systems
  • strong understanding of scalability, reliability, and performance considerations in data pipelines
  • strong problem-solving skills focused on scalability and reliability
  • collaborative approach to working in cross-functional teams
Job Responsibility
Job Responsibility
  • Build & Data Platform Engineering: design and implement scalable data platforms and pipelines across cloud environments
  • develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
  • build ingestion, transformation, and curation workflows for both structured and unstructured data
  • implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold)
  • Enable AI, GenAI & Data Products: deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems
  • enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows) and agent-based architectures and intelligent workflows
  • Data Modeling, Orchestration & Automation: design scalable logical and physical data models for analytical and operational use cases
  • orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents
  • Architecture, Governance & Observability: apply modern architecture patterns including event-driven and streaming architectures
  • ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC)
What we offer
What we offer
  • Mental and physical health: Medical insurance
  • Sports reimbursement budget
  • Home office support
  • A number of free psychological and legal consultations
  • Maternity and paternity leave support
  • Personal and professional development: Internal workshops and learning initiatives
  • English language classes compensation
  • Professional certifications reimbursement
  • Participation in professional local and global communities
  • Growth Framework to manage expectations and define the steps to move towards the selected career
  • Fulltime
Read More
Arrow Right