Big Data Engineer, Citi

Big Data Engineer

Citi

Location:
India, Chennai

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

Responsible for designing, developing, and optimizing data processing solutions using Big Data technologies, building efficient data pipelines for large datasets, and enabling batch and real-time data streaming and processing.

Job Responsibility:

Develop Spark applications using Scala or Python (Pyspark) for data transformation, aggregation, and analysis
Develop and maintain Kafka-based data pipelines, including designing Kafka Streams and setting up Kafka Clusters
Create and optimize Spark applications using Scala or PySpark
Integrate Kafka with Spark for real-time processing
Collaborate with data teams to design and implement data solutions
Tune and optimize Spark and Kafka clusters
Write clean, functional, and optimized code, adhering to coding standards and best practices
Troubleshoot and resolve issues related to Kafka and Spark applications
Maintain documentation for Kafka configurations, Spark jobs, and other processes
Stay updated on technology trends in functional programming, big data, and related technologies.

Requirements:

Proficiency in Hadoop ecosystem big data tech stack (HDFS, YARN, MapReduce, Hive, Impala)
Proficiency in Spark (Scala, Python) for data processing and analysis
Proficiency in Kafka for real-time data ingestion and processing
Experience with ETL processes and data ingestion tools
Deep hands-on expertise in Pyspark, Scala, Kafka
Expertise in programming languages such as Scala, Python, or Java for developing Spark applications
Proficiency in SQL for data querying and analysis
Knowledge of data warehousing concepts
Familiarity with Linux/Unix operating systems
Strong problem-solving and analytical skills
Experience with version control systems.

Additional Information:

Job Posted:
July 26, 2025

Employment Type:

Fulltime

Work Type:

Hybrid work

View All Jobs In This Company

Job Link Share:

Welcome to CrawlJobs.com –
Your Global Job Discovery Platform

At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.