CrawlJobs Logo

Hadoop Data Engineer/ Senior Software Engineer

https://www.hsbc.com Logo

HSBC

Location Icon

Location:
India, Pune

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Job offer has expired

Job Description:

Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

Job Responsibility:

  • Expertise in Scala-Spark/Python-Spark development and should be able to Work with Agile application dev team to implement data strategies
  • Design and implement scalable data architectures to support the bank's data needs
  • Develop and maintain ETL (Extract, Transform, Load) processes
  • Ensure the data infrastructure is reliable, scalable, and secure
  • Oversee the integration of diverse data sources into a cohesive data platform
  • Ensure data quality, data governance, and compliance with regulatory requirements
  • Monitor and optimize data pipeline performance
  • Troubleshoot and resolve data-related issues promptly
  • Implement monitoring and alerting systems for data processes
  • Troubleshoot and resolve technical issues optimizing system performance ensuring reliability
  • Create and maintain technical documentation for new and existing system ensuring that information is accessible to the team
  • Implementing and monitoring solutions that identify both system bottlenecks and production issues

Requirements:

  • Experience in data engineering or related field and hands-on experience of building and maintenance of ETL Data pipelines
  • Good experience in Designing and Developing Spark Applications using Scala or Python
  • Good experience with database technologies (SQL, NoSQL), data warehousing solutions, and big data technologies (Hadoop, Spark)
  • Proficiency in programming languages such as Python, Java, or Scala
  • Optimization and Performance Tuning of Spark Applications
  • GIT Experience on creating, merging and managing Repos
  • Perform unit testing and performance testing
  • Good understanding of ETL processes and data pipeline orchestration tools like Airflow, Control-M
  • Strong problem-solving skills and ability to work under pressure
  • Excellent communication and interpersonal skills
What we offer:
  • Continuous professional development
  • Flexible working
  • Opportunities to grow within an inclusive and diverse environment

Additional Information:

Job Posted:
June 11, 2025

Expiration:
June 15, 2025

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.