Data Engineer Advisor Job at NTT DATA

Data Engineer Advisor

We are seeking an Expert Data Engineer with ~7+ years of experience in cloud-bas...

Location

India , Pune

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

~7+ years of experience in cloud-based data engineering
Snowflake
AWS ecosystem
AWS Glue
SQL-based frameworks
APIs
batch and streaming mechanisms
SQL / PL-SQL
AWS S3
Redshift/Snowflake integration

Job Responsibility

Design, develop, and maintain scalable ETL/ELT pipelines using AWS Glue, Snowflake, and SQL-based frameworks
Build and manage data ingestion frameworks using APIs, batch, and streaming mechanisms
Design efficient data transformation logic using SQL / PL-SQL and Snowflake capabilities
Implement incremental and real-time data processing pipelines
Develop and maintain cloud-native data platforms leveraging AWS S3, Glue, Redshift/Snowflake integration
Architect and optimize data lakes and data warehouses
Ensure high performance, cost efficiency, and scalability of data solutions
Design, build, and optimize Snowflake data warehouse solutions
Implement data modeling, partitioning, clustering, and performance tuning
Work with secure data sharing, governance, and data optimization techniques

Fulltime

Data Engineer Advisor

We are seeking a Data Engineer responsible for designing, building, and maintain...

Location

Mexico , Guadalajara

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Strong foundation in software engineering with proficiency in SQL and Python
ETL/ELT tools and frameworks
Experience with database platforms: RDBMS: PostgreSQL, SQL Server, MySQL, Oracle
NoSQL: MongoDB, Neo4j
Hands-on experience building multi-source data pipelines (e.g., Qlik, AWS Glue)
Experience working with cloud platforms, preferably AWS
Solid understanding of data warehousing concepts
Solid understanding of data quality and data governance practices
Programming experience in Java or C++
Familiarity with machine learning frameworks (TensorFlow, PyTorch, scikit-learn)

Job Responsibility

Design, develop, and maintain data pipelines and ETL/ELT processes
Integrate data from multiple sources into centralized data platforms
Ensure data quality, integrity, and consistency across systems
Build and optimize data models and data warehousing solutions
Support analytics and reporting by delivering clean, curated datasets
Collaborate with cross-functional teams including data scientists, analysts, and software engineers
Monitor and troubleshoot data workflows and pipeline performance

Fulltime

Data Engineer Advisor

NTT DATA strives to hire exceptional, innovative and passionate individuals who ...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Experience with Big Data Technologies or Cloud Technologies building data pipelines
DevOPs Experience (source control, continuous integration, deployments, etc.)
Experience with containerization and related technologies (e.g. Docker, Kubernetes)
Experience in other open-sources like Druid, Elastic Search, Logstash etc
Advanced knowledge of the Hadoop ecosystem and Big Data technologies
Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
System level understanding - Data structures, algorithms, distributed storage & compute
Exposure and / or development experience in Microservices Architectures best practices
Experience around REST APIs, services, and API authentication schemes
Knowledge in RDBMS and NoSQL technologies

Job Responsibility

Given the input from the Data Scientist and Data Modeler, create the data pipeline to ingest, cleanse and standardize the data so that it can be ready for analysis
Once the data is processed, apply the machine learning algorithm as prescribed by the Data Scientist with the production performance readiness
Once the result is processed, activate the models through either Micro Services, Reporting, Dashboard, or emails

Data Engineer Advisor

The Data Engineer Advisor will lead the migration of SAP data to the Databricks ...

Location

India , Delhi

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science or a related field
Strong knowledge of SAP BW, ECC, and related modules
Experience with SAP data extraction and transformation
Proficiency in Databricks, PySpark, and Delta Lake
Familiarity with Azure Data Lake Storage (ADLS) and orchestration tools like Airflow
Hands-on experience with Qlik Replicate, Informatica, or similar tools
Understanding of Unity Catalog, RBAC, and data governance frameworks
Strong analytical, problem-solving, and communication skills

Job Responsibility

Design and implement migration plans for SAP data to Azure Databricks using tools like Qlik Replicate, ADF, and Airflow
Convert SAP BW data models and ETL jobs into PySpark workflows on Databricks
Develop Bronze, Silver, and Gold layers following Medallion Architecture for structured ingestion and transformation
Ensure accurate mapping of SAP tables and business objects to Databricks Delta tables
Implement data quality checks, lineage tracking, and governance using Unity Catalog
Optimize ingestion pipelines for large SAP datasets to minimize latency and maximize throughput
Conduct performance tuning for queries and transformations
Work closely with SAP SMEs, data architects, and business analysts to validate requirements
Produce comprehensive documentation for migrated jobs and provide support during UAT and hypercare phases
Ensure compliance with enterprise security policies and manage RBAC for Databricks workspaces

Fulltime

Data Engineer - Big Data, Python, Databricks

The Applications Development Intermediate Programmer Analyst is an intermediate ...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

4 - 6 years of relevant experience in the Financial Service industry
Intermediate level experience in Applications Development role
Proficient in Big DataTechnologies - Cloudera, Hive, Python, Java/PySpark, Data Bricks
Proficient in Data analysis and data modelling
Good understanding of ETL concepts
Consistently demonstrates clear and concise written and verbal communication
Demonstrated problem-solving and decision-making skills
Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Bachelor's degree/University degree or equivalent experience

Job Responsibility

Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
Apply fundamental knowledge of programming languages for design specifications
Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
Serve as advisor or coach to new or lower level analysts
Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
Has the ability to operate with a limited level of direct supervision
Can exercise independence of judgement and autonomy
Acts as SME to senior stakeholders and /or other team members

Fulltime

Data Engineer (Big Data, Python, Databricks) - Assistant Vice President

The Applications Development Senior Programmer Analyst is an intermediate level ...

Location

India , Chennai, Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

5-8 years of relevant handson experience in Big Data technologies like Cloudera, Python, HQL, Java/PySpark
Knowledge on Machine Learning, AI would be added advantage
Experience in systems analysis, data analysis and programming of software applications
Experience in managing and implementing successful projects
Working knowledge of consulting/project management techniques/methods
Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Bachelor’s degree/University degree or equivalent experience

Job Responsibility

Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
Ensure essential procedures are followed and help define operating standards and processes
Serve as advisor or coach to new or lower level analysts
Has the ability to operate with a limited level of direct supervision
Can exercise independence of judgement and autonomy
Acts as SME to senior stakeholders and /or other team members

Fulltime

Distinguished Data Engineer - Enterprise Data Technology

Distinguished Data Engineers are individual contributors who strive to be divers...

Location

United States , McLean; San Francisco

Salary:

269100.00 - 335100.00 USD / Year

Capital One

Expiration Date

Until further notice

Requirements

Bachelor’s Degree
At least 7 years of experience in data engineering
At least 3 years of experience in data architecture
At least 2 years of experience building applications in AWS
At least 5 years of experience of Python, SQL or Scala
At least 3 years of experience developing AI and ML algorithms or technologies

Job Responsibility

Lead the design and implementation of highly scalable, fault-tolerant, and cost-effective data architectures that seamlessly integrate Databricks (for complex processing,ML) and Snowflake (for warehousing,ETL)
Drive performance engineering and optimization for large-scale data ingestion and processing workloads across the Databricks,Snowflake,AWS data pipeline
Provide technical leadership for the design, development, testing and deployment of agentic workflows across Capital One
Deep technical experts and thought leaders that help accelerate adoption of the very best engineering practices, while maintaining knowledge on industry innovations, trends and practices
Evangelists, both internally and externally, helping to elevate the Distinguished Engineering community and establish themselves as a go-to resource on given technologies and technology-enabled capabilities
Build awareness, increase knowledge and drive adoption of modern technologies, sharing consumer and engineering benefits to gain buy-in
Strike the right balance between lending expertise and providing an inclusive environment where others’ ideas can be heard and championed
leverage expertise to grow skills in the broader Capital One team
Promote a culture of engineering excellence, using opportunities to reuse and innersource solutions where possible
Operate as a trusted advisor for a specific technology, platform or capability domain, helping to shape use cases and implementation in an unified manner

What we offer

comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)

Fulltime

Data Engineer Big Data Technology

The Applications Development Intermediate Programmer Analyst is an intermediate ...

Location

Singapore , Singapore

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

4-6 years of hands-on experience in Hadoop, Scala, Java, Spark, Hive, Kafka, Impala, Unix Scripting and other Big data frameworks
4+ years of experience with relational SQL and NoSQL databases: Oracle, MongoDB, HBase
Strong proficiency in Python and Spark Java with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc) and Scala and SQL
Data Integration, Migration & Large Scale ETL experience (Common ETL platforms such as PySpark/DataStage/)
4-6 years of relevant experience in the Financial Service industry
Experienced in working with large and multiple datasets and data warehouses
Experience building and optimizing ‘big data’ data pipelines, architectures, and datasets
Strong analytic skills and experience working with unstructured datasets
Ability to effectively use complex analytical, interpretive, and problem-solving techniques
Experience with Confluent Kafka, Redhat JBPM, CI/CD build pipelines and toolchain – Git, BitBucket, Jira

Job Responsibility

Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
Apply fundamental knowledge of programming languages for design specifications
Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
Serve as advisor or coach to new or lower level analysts
Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
Has the ability to operate with a limited level of direct supervision
Can exercise independence of judgement and autonomy
Acts as SME to senior stakeholders and /or other team members
Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

Fulltime

Select Country

Data Engineer Advisor

Job Description

Job Responsibility

Requirements

Looking for more opportunities?

Data Engineer Advisor

Data Engineer Advisor

Data Engineer Advisor

Data Engineer Advisor

Data Engineer Advisor

Data Engineer - Big Data, Python, Databricks

Data Engineer (Big Data, Python, Databricks) - Assistant Vice President

Distinguished Data Engineer - Enterprise Data Technology

Data Engineer Big Data Technology

Our AI answers in your language