CrawlJobs Logo

Hadoop/Spark Lead Data Engineer

https://www.wellsfargo.com/ Logo

Wells Fargo

Location Icon

Location:
India, Hyderabad

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

Wells Fargo is Seeking a Lead Data Engineer. In this role, you will lead complex initiatives with broad impact and act as key participant in large scale software planning for the Technology area. You will design, develop, and run tooling to discover problems in data and applications and report the issues to engineering and product leadership. You will review and analyze complex software enhancement initiatives for business, operational or technical improvements that require in depth evaluation of multiple factors including intangibles or unprecedented factors. You will make decisions in complex and multi-faceted data engineering situations requiring understanding of software package options and programming language and compliance requirements that influence and lead Technology to meet deliverables and drive organizational change. You will strategically collaborate and consult with internal partners to resolve highly risky data engineering challenges.

Job Responsibility:

  • Lead complex initiatives with broad impact and act as key participant in large scale software planning for the Technology area
  • Design, develop, and run tooling to discover problems in data and applications and report the issues to engineering and product leadership
  • Review and analyze complex software enhancement initiatives for business, operational or technical improvements that require in depth evaluation of multiple factors including intangibles or unprecedented factors
  • Make decisions in complex and multi-faceted data engineering situations requiring understanding of software package options and programming language and compliance requirements that influence and lead Technology to meet deliverables and drive organizational change
  • Strategically collaborate and consult with internal partners to resolve highly risky data engineering challenges

Requirements:

  • 5+ years of Database Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 5+ years of experience in building and leading data driven application design and implementation using Hadoop/Spark/Scala with very good experience in any of relational databases Teradata/Oracle Exadata
  • Designing, Developing and maintaining data pipelines using Apache Spark/Hadoop/MapReduce/HBase in MapR or other Hadoop distributions
  • Optimizing Spark Jobs for performance, scalability and resource utilization in shared infrastructure
  • Experience in Python/Scala/Java Programming languages
  • Experience with one of the cloud providers (AWS, GCP, Azure) preferably in GCP in the data area
  • Experience in data storage service, Google Clouse Storage, data processing Google Cloud Dataflow and data warehousing like Redshift/Azure Synapse/Google Big query
  • Designing and building Data Lake/Datawarehouse solution with experience in data modeling and ETL process using Teradata/Oracle relation databases
  • Experience in building Semantic model and reporting Application using Power BI
  • Experience in Abinitio/Talend ETL tool

Additional Information:

Job Posted:
August 11, 2025

Expiration:
September 07, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.