Lead Spark Scala Engineer, Citi

Lead Spark Scala Engineer

Citi

Location:
India, Pune

Category:
IT - Software Development

Contract Type:
Employment contract

Salary:

Not provided

Save Job

Apply Position

Job Description:

This position is under ICG TTS Operations Technology (OpsTech) Group to help the implementation of next generation Digital Automation Platform and Imaging Workflow Technologies. The overall objective of this role is to contribute to applications, systems analysis, and programming activities.

Job Responsibility:

Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization
Provide technical leadership and guidance to a team of data engineers, fostering a culture of technical excellence, collaboration, and continuous improvement
Conduct rigorous code reviews, establish coding standards, and enforce best practices for Spark Scala development, data governance, and data quality
Identify and resolve performance bottlenecks in Spark applications through advanced tuning techniques (e.g., shuffling, partitioning, memory management, caching)

Requirements:

Hands on knowledge of SPARK, Py-Spark, scala, Java
Hands on knowledge of RDBMS like MS-SQL/Oracle
Knowledge of CI/CD tools like LightSpeed, uDeploy
Profound understanding of Spark's architecture (RDDs, DataFrames, Datasets), execution model, and optimization techniques
Extensive experience with Spark SQL, Spark Streaming, and Spark Core
Proven ability to design and build complex data pipelines (ETL/ELT)
Expert-level proficiency in Scala programming, including functional programming paradigms and object-oriented design
Strong hands-on experience with the broader Hadoop ecosystem (HDFS, YARN, Hive, Kafka, etc.) and related big data technologies
Solid understanding of relational databases (SQL, schema design) and NoSQL databases
Excellent communication, interpersonal, and leadership skills
Exceptional analytical and problem-solving abilities

Additional Information:

Job Posted:
August 01, 2025

Employment Type:

Fulltime

Work Type:

On-site work

View All Jobs In This Company

Job Link Share:

Welcome to CrawlJobs.com –
Your Global Job Discovery Platform

At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.