Scala/Spark Developer, Citi

Citi

Location:
India, Chennai

Category:
IT - Software Development

Contract Type:
Employment contract

Salary:

Not provided

Save Job

Apply Position

Job Description:

We are seeking a Spark, Big Data - ETL Tech Lead for Commercial Card’s Global Data Repository development team. This position requires exceptional technical leadership and communication skills for scalable global data applications development. The candidate will work closely with Project Managers, Quality Control teams, and other departments to ensure timely delivery of high-quality software solutions in a dynamic, globally distributed environment.

Job Responsibility:

Lead the design and implementation of large-scale data processing pipelines using Apache Spark on BigData Hadoop Platform
Develop and optimize Spark applications for performance and scalability
Responsible for providing technical leadership of multiple large scale/complex global software solutions
Integrate data from various sources, including Couchbase, Snowflake, and HBase, ensuring data quality and consistency
Experience of developing teams of permanent employees and vendors from 5-15 developers in size
Build and sustain strong relationships with the senior business leaders associated with the platform
Design, code, test, document and implement application release projects as part of development team
Work with onsite development partners to ensure design and coding best practices
Work closely with Program Management and Quality Control teams to deliver quality software to agreed project schedules
Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns
Compliance with Citi's System Development Lifecycle and Information Security requirements
Oversee development scope, budgets, timeline documents
Monitor, update and communicate project timelines and milestones
Obtain senior management feedback
Understand potential speed bumps and client’s true concerns/needs
Stay updated with the latest trends and technologies in big data and cloud computing
Mentor and guide junior developers, providing technical leadership and expertise.

Requirements:

Bachelor’s or master’s degree in computer science, Information Technology, or equivalent
Minimum 10 years of proven experience in developing and managing big data solutions using Apache Spark, having strong hold on Spark-core, Spark-SQL & Spark Streaming
Minimum 6 years of experience in leading globally distributed teams successfully
Strong programming skills in Scala, Java, or Python
Hands on experience on technologies like Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume
Proficiency in SQL and experience with relational (Oracle/PL-SQL) and NoSQL databases like MongoDB
Demonstrated people and technical management skills
Demonstrated excellent software development skills and implementation of complex file transformations like positional, XMLs
Experience in building enterprise systems with focus on recovery, stability, reliability, scalability, and performance
Experience in working on Kafka, JMS / MQ applications
Experience in working multiple OS (Unix, Linux, Windows)
Familiarity with data warehousing concepts and ETL processes
Experience in performance tuning of large technical solutions with significant volumes
Knowledge of data modeling, data architecture, and data integration techniques
Knowledge of best practices for data security, privacy, and compliance.

Nice to have:

Experience in Java, Spring, ETL tools like Talend, Ab Initio
Experience of migrating functionality from ETL tools to Spark
Experience or knowledge on Cloud technologies AWS, GCP
Experience in financial industry
ETL certification, Project management certification
Experience with Commercial Cards applications and processes
Experience with Agile methodology.

What we offer:

Equal opportunity employer policies
Diversity, teamwork, and collaboration work environment
Accessibility accommodations for employees
Global benefits provided by Citi.

Additional Information:

Job Posted:
May 22, 2025

Employment Type:

Fulltime

Work Type:

On-site work

View All Jobs In This Company

Job Link Share:

Scala/Spark Developer