CrawlJobs Logo
NTT DATA Logo NTT DATA · IT - Software Development

Data Engineer

India, Bangalore · Job Posted April 23, 2026
Apply Position
Job Link Share

Job Description

The Data Engineer will be responsible for end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse. This role requires a minimum of 3-5 years of hands-on experience in data engineering, with proficiency in Python, Kafka, and Snowflake. The candidate will engage with stakeholders to ensure data integrity and quality during the migration process.

Job Responsibility

  • Perform end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
  • Pipeline migration including refactoring and migrating extraction logic and job scheduling
  • Data Transfer executing physical migration of underlying datasets while ensuring data integrity
  • Stakeholder Engagement acting as a technical liaison to internal clients
  • Code Conversion translating and optimizing legacy SQL and Spark-based consumption patterns for compatibility with Snowflake and Iceberg
  • Usage analysis to understand usage patterns to deliver required data products
  • Data Reconciliation and Quality with a rigorous approach to data validation
  • Work with other internal data management platform

Requirements

  • Bachelor or Master degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
  • Ability to troubleshoot (SQL) and basic scripting experience
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices and K8s deployment experience
  • Demonstrated understanding of Temporal Data Modeling, Schema Management, Performance Optimization, Architectural Theory
  • Experience with Kafka, ANSI SQL, FTP, Apache Spark
  • Experience with JSON, Avro, Parquet
  • Experience with Hadoop (HDFS/Hive), Snowflake, Apache Iceberg, Sybase IQ
NTT DATA - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

Robert Half is seeking a Contract Data Engineer to support our client's data and...
Location
Location
United States , Nashville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Data Engineer or in a similar role
  • Strong proficiency in SQL and Python (or similar languages)
  • Experience with cloud platforms (AWS, Azure, GCP)
  • Hands-on experience with ETL / ELT tools (Airflow, dbt, Fivetran, Matillion, Glue, ADF, etc.)
  • Experience with data warehousing platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Familiarity with streaming and big data tools (Kafka, Spark, Databricks, Hadoop) is a plus
  • Strong understanding of data modeling, performance tuning, and pipeline optimization
  • Experience with version control systems (Git) and agile development practices
  • Excellent problem-solving, analytical, and communication skills
Job Responsibility
Job Responsibility
  • Data Pipeline Development: Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources
  • Data Architecture: Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs
  • Cloud Data Platforms: Work within cloud environments such as AWS, Azure, or GCP to deploy and manage data solutions
  • Data Warehousing: Design and support enterprise data warehouses using platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Big Data Processing: Develop solutions using big data technologies such as Spark, Databricks, Kafka, and Hadoop when required
  • Performance Optimization: Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency
  • Data Quality & Reliability: Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability
  • Collaboration: Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions
  • Documentation: Maintain detailed documentation for pipelines, data flows, and system architecture
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Data Engineer

Our client is seeking a skilled Data Engineer to support the design, development...
Location
Location
United States , Miami
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Systems, Engineering or related field
  • 3+ years of experience in a Data Engineer or similar role
  • Strong hands-on experience with SQL, Python and Snowflake
  • Experience developing and maintaining ETL workflows
  • Knowledge of data modeling concepts and best practices
  • Experience with Selenium for web automation or web scraping support
  • Strong analytical, problem-solving and troubleshooting skills
  • Ability to work independently and collaboratively in a team environment
Job Responsibility
Job Responsibility
  • Design, build and maintain scalable ETL pipelines to support data integration and reporting needs
  • Develop and optimize complex queries using SQL
  • Use Python to support data processing, transformation and automation tasks
  • Work within Snowflake to manage, transform and optimize cloud-based data solutions
  • Assist with automation efforts, including Selenium web scripting for web-based data extraction and process automation
  • Create and maintain logical and physical data models
  • Ensure data quality, integrity and consistency across multiple data sources
  • Collaborate with business stakeholders, analysts and technical teams to gather requirements and deliver data solutions
  • Monitor and troubleshoot data workflows and automation scripts
  • Document processes, workflows and technical specifications
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Data Engineer

Join us as a Data Engineer at Bettys and Taylors Group - Our family business is ...
Location
Location
United Kingdom , Harrogate
Salary
Salary:
49500.00 - 60500.00 GBP / Year
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
June 17, 2026
Flip Icon
Requirements
Requirements
  • Proven experience designing and building data pipelines and ETL/ELT processes using Microsoft Fabric or comparable cloud data platforms
  • Strong technical skills in SQL, DAX, M (Power Query), KQL and Python / PySpark for data engineering and analysis
  • Experience with data modelling techniques (e.g. star schema, dimensional modelling) and data warehousing concepts
  • Hands-on experience with Power BI, including dataset creation, semantic modelling, performance optimisation and building well-designed reports
  • Familiarity with CI/CD practices, version control (e.g. Git) and DevOps approaches for data engineering
  • Understanding of data governance, quality management, security and privacy, including GDPR and ISO27001 considerations
  • Excellent communication skills, with the ability to work confidently across technical and non-technical teams
  • A willingness to coach, mentor and upskill others, and a strong commitment to continuous learning
Job Responsibility
Job Responsibility
  • Design, develop and maintain scalable data pipelines using Microsoft Fabric and related technologies
  • Transform and curate data from multiple sources into structured, governed datasets
  • Optimise data pipeline performance and adhere to engineering standards such as CI/CD and version control
  • Collaborate on enterprise data models, Power BI solutions, and provision data for analytics and machine learning
  • Ensure data quality, compliance with governance standards, and support ITIL processes
What we offer
What we offer
  • A discretionary profit-share bonus scheme paid quarterly (11.9% average over the last three years)
  • Freshly cooked hot meals while at work, along with free drinks and snacks
  • Discounts on Bettys & Taylors products
  • A range of health benefits, including a health cash plan, health assessments, flu jabs and more
  • Wellbeing support, including an Employee Assistance Programme (free and independent service offering free counselling and health and wellbeing resources)
  • The option to buy and (in some cases) sell additional holidays
  • On-the-job learning
  • External training programmes
  • Apprenticeship opportunities
  • Internal 1:1 coaching schemes
  • Fulltime
!
Read More
Arrow Right

Data Engineer

A healthcare company based in the Midwest is looking to hire a remote Data Engin...
Location
Location
United States , Detroit
Salary
Salary:
85000.00 - 95000.00 USD / Year
strategicemployment.com Logo
Strategic Employment Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 1+ years in stakeholder-facing Data Engineering/Data Analytics position
  • Consulting experience
  • Databricks, Foundry, or Snowflake
  • Python, PySpark, TypeScript
Job Responsibility
Job Responsibility
  • work closely with stakeholders on low code data engineering solutions
  • Fulltime
Read More
Arrow Right

Data Engineer

Wells Fargo is seeking a Data Engineer to design, build and optimize scalable da...
Location
Location
India , BENGALURU
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • Strong experience in EDL pipelines using Spark & BigQuery on GCP
  • Hands-on expertise in GCP services (BigQuery, Dataflow, GCS, IAM) and cloud-native architecture
  • Solid understanding of enterprise data governance, data quality
  • Exposure to AI/ML or GenAI use cases, including integration with data platforms and awareness of AI governance standards
Job Responsibility
Job Responsibility
  • Participate in data warehouses across multiple databases and identify opportunity for developing table schemas within the Technology and Date area
  • Review and analyze basic data management business, operational, or technical assignments or challenges that require research, evaluation, and selection of alternatives and exercise independent judgment to guide medium risk deliverables
  • Present recommendations for resolving more complex data management situations and exercise independent judgment while developing expertise in the business data policies, procedures and compliance requirements
  • Collaborate and consult with technology colleagues, internal partners and stakeholders, including internal and external customers if applicable
  • Design and build scalable, production-grade data pipelines on GCP supporting analytics and AI workloads
  • Develop and manage secure, compliant cloud data platforms aligned with enterprise policies and controls
  • Optimize data processing for performance, cost efficiency, and reliability (Spark + BigQuery workloads)
  • Collaborate with AI/analytics teams to enable feature engineering, model consumption, and AI-driven insights
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays where you will spearhead the evolution of...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience in developing complex/medium/easy datasets using SQL tools (SQL/Snowflake)
  • Solid working knowledge of writing SQL queries
  • Working Knowledge on scripts (.bteq ) in Unix/ linux environments.
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models.
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness
  • Wellness rooms
  • gyms and mental health support
  • Collaborative areas
  • Access to on-site cafeterias, fitness centers, and tech-equipped workstations
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays, responsible for supporting the successfu...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in ETL / data processing / data warehousing / data engineering / RDBMS / PySpark
  • Experience in Data Processing and ETL in On-prem and Cloud based systems
  • Preferred AWS cloud development, with a strong understanding of AWS services (e.g., EC2, S3, Lambda, RDS, DynamoDB, etc.)
  • Proficient in at least one Python programming language
  • Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform etc.
  • Experience with CI/CD tools and pipelines (Jenkins, GitLab CI, etc.) for automation and deployment
  • Good understanding of cloud security best practices and experience with IAM, VPC, security groups, and encryption mechanisms
  • Good knowledge of monitoring, logging, and troubleshooting tools (e.g., CloudWatch, CloudTrail)
  • Experience with version control systems (Git, GitHub, Bitbucket)
  • Strong communication skills and ability to work in a collaborative team environment
Job Responsibility
Job Responsibility
  • supporting the successful delivery of location strategy projects to plan, budget, agreed quality and governance standards
  • spearhead the evolution of our digital landscape, driving innovation and excellence
  • harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

At Schwab, you’re empowered to make an impact on your career. Here, innovative t...
Location
Location
United States , Austin
Salary
Salary:
90000.00 - 145000.00 USD / Year
schwab.com Logo
Charles Schwab
Expiration Date
June 15, 2026
Flip Icon
Requirements
Requirements
  • Bachelors’ degree in Engineering/Technology
  • 8+ years of professional experience in development, support, and maintenance of ETL and database applications
  • Deep understanding of Data Warehousing and Data Modeling concepts
  • 3+ years of hands-on experience with Informatica’s Intelligent Data Management Cloud(IDMC)/Informatica Intelligent Cloud Services (IICS)
  • 2+years of hands-on experience with GCP technologies (GCS, BigQuery, Dataproc)
  • 1+years of experience with Control M
  • Strong SQL Knowledge
  • Experience with Shell, Python, PERL and other scripting languages
  • Familiar and comfortable with agile development techniques
  • Familiarity with SCM and DevOps tool suites and CI/CD best practices
Job Responsibility
Job Responsibility
  • Creation and maintenance of enterprise data assets, reporting, and data analytics that support business leaders in decision making, regulatory reporting, and continuous process improvement
  • Working closely with business and other stakeholders to understand the needs and implementation
  • Planning, estimation, scheduling, prioritization, and coordination of technical activities related to system development
  • Performing ETL design, development, data management and data analysis
  • Creating data model, performance tuning, load plan etc. Making sure that deliverables fulfill both functional and non-functional requirements
  • Provide guidance and technical oversight to junior engineers and vendor contractors, ensuring high-quality execution and fostering professional growth within the team
  • Engaging with both onshore and offshore teams to ensure the timely delivery of high-quality data engineering solutions
  • Ensuring system alignment to Architecture policies and best practices
  • ensure that process methodologies are followed in system development
  • Identifying opportunities for system reuse and system simplification
What we offer
What we offer
  • 401(k) with company match and Employee stock purchase plan
  • Paid time for vacation, volunteering, and 28-day sabbatical after every 5 years of service for eligible positions
  • Paid parental leave and family building benefits
  • Tuition reimbursement
  • Health, dental, and vision insurance
  • Bonus or incentive opportunities
  • Fulltime
!
Read More
Arrow Right