Tech Lead – Scala/Spark, Citi

Citi

Location:
India, Chennai

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

We are seeking a Spark, Big Data - ETL Tech Lead for Commercial Card’s Global Data Repository development team. The successful candidate will interact with the Development Project Manager, the development, testing, and production support teams, as well as other departments within Citigroup (such as the System Administrators, Database Administrators, Data Centre Operations, and Change Control groups) for TTS platforms.

Job Responsibility:

Lead the design and implementation of large-scale data processing pipelines using Apache Spark on BigData Hadoop Platform
Develop and optimize Spark applications for performance and scalability
Responsible for providing technical leadership of multiple large scale/complex global software solutions
Integrate data from various sources, including Couchbase, Snowflake, and HBase, ensuring data quality and consistency
Experience of developing teams of permanent employees and vendors from 5 – 15 developers in size
Build and sustain strong relationships with the senior business leaders associated with the platform
Design, code, test, document and implement application release projects as part of development team
Work with onsite development partners to ensure design and coding best practices
Work closely with Program Management and Quality Control teams to deliver quality software to agreed project schedules
Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns
Compliance with Citi's System Development Lifecycle and Information Security requirements
Oversee development scope, budgets, time line documents
Monitor, update and communicate project timelines and milestones
obtain senior management feedback
understand potential speed bumps and client’s true concerns/needs
Stay updated with the latest trends and technologies in big data and cloud computing
Mentor and guide junior developers, providing technical leadership and expertise

Requirements:

Bachelor’s or master’s degree in computer science, Information Technology, or equivalent
Minimum 10 years of Proven experience in developing and managing big data solutions using Apache Spark. Having strong hold on Spark-core, Spark-SQL & Spark Streaming
Minimum 6 years of experience in leading globally distributed teams successfully
Strong programming skills in Scala, Java, or Python
Hands on experience on Technologies like Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume etc.
Proficiency in SQL and experience with relational (Oracle/PL-SQL) and NoSQL databases like mongoDB
Demonstrated people and technical management skills
Demonstrated excellent software development skills. Strong experiences in implementation of complex file transformations like positional, xmls
Experience in building enterprise system with focus on recovery, stability, reliability, scalability and performance
Experience in working on Kafka, JMS / MQ applications
Experience in working multiple OS (Unix, Linux, Win)
Familiarity with data warehousing concepts and ETL processes
Experience in performance tuning of large technical solutions with significant volumes
Knowledge of data modeling, data architecture, and data integration techniques
Knowledge on best practices for data security, privacy, and compliance

Nice to have:

Experience in Java, Spring, ETL Tools like Talend, Ab Initio is a plus
Experience of migrating functionality from ETL tools to Spark
Experience/knowledge on Cloud technologies AWS, GCP
Experience in Financial industry
ETL Certification, Project Management Certification
Experience with Commercial Cards applications and processes would be advantageous
Experience with Agile methodology

Additional Information:

Job Posted:
April 26, 2025

Employment Type:

Fulltime

Work Type:

On-site work

View All Jobs In This Company

Job Link Share:

Tech Lead – Scala/Spark