Spark Tech Lead, HSBC

Spark Tech Lead

HSBC

Location:
India, Pune

Category:
IT - Software Development

Contract Type:
Employment contract

Salary:

Not provided

Save Job

Job offer has expired

Job Description:

HSBC is seeking an experienced professional for the role of Spark Tech Lead. The role involves leading Python-Spark development, managing cloud and on-premises application delivery, and creating software deployment strategies. Key responsibilities include implementing data strategies, system monitoring, managing a team, and developing CI/CD pipelines.

Job Responsibility:

Work with Agile application dev team to implement data strategies, build data flows and conceptual data models
Own end to end On-premises and Cloud (GCP, AWS) Application Delivery
Create short-term plans to deliver environments to support sprint-based development
Implementing and monitoring solutions that identify both system bottlenecks and production issues
Plan and prioritize own time effectively, aware of responsibilities and committed to delivering these efficiently
Manage a small team as tech specialists
Create software deployment strategies that allow DevOps engineers to successfully deploy sites/software in any environment
Forecast environment requirements based on anticipated future demand from multiple application development teams

Requirements:

Minimum 8 years of hands-on experience of building and maintenance of ETL Data pipelines
Good experience in Designing and Developing Spark Applications using PySpark
Experience on Delta Lake (delta.io) for enterprise grade implementation
Optimization and Performance Tuning of Spark Applications
Proficiency in writing SQL scripts
Hands-on Experience in Python Programming
Experience of building and setting up CI/CD pipelines for Pyspark
Strong communication skills

What we offer:

Continuous professional development
Flexible working
Opportunities to grow within an inclusive and diverse environment

Additional Information:

Job Posted:
August 12, 2025

Expiration:
August 17, 2025

Employment Type:

Fulltime

Work Type:

On-site work

View All Jobs In This Company

Job Link Share:

Welcome to CrawlJobs.com –
Your Global Job Discovery Platform

At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.