CrawlJobs Logo
Citi Logo Citi · IT - Software Development

Spark Developer

India, Chennai Employment contract · Job Posted November 21, 2025
Apply Position
Job Link Share

Job Description

ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role requires deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems. Developer will collaborate with data engineers, analysts, and business stakeholders to process, transform, and drive insights and data-driven decisions.

Job Responsibility

  • design and implement of Spark applications to process and transform large datasets in HDFS
  • develop ETL pipelines in Spark using Python for data ingestion, cleaning, aggregation, and transformations
  • optimize Spark jobs for efficiency, reducing run time and resource usage
  • finetune memory management, caching, and partitioning strategies for optimal performance
  • load data from different sources into HDFS, ensuring data accuracy and integrity
  • integrate Spark applications with Hadoop frameworks like Hive, Sqoop etc.
  • troubleshoot and debug Spark job failures, monitor job logs, and Spark UI to identify issues

Requirements

  • 2-5 years of relevant experience
  • experience in programming/debugging used in business applications
  • working knowledge of industry practice and standards
  • comprehensive knowledge of specific business area for application development
  • working knowledge of program languages
  • consistently demonstrates clear and concise written and verbal communication
  • expertise in handling complex large-scale warehouse environments
  • hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities
  • bachelor's degree in a quantitative field (such as engineering, computer science) or equivalent experience
Citi - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Spark Developer

8 matching positions

New

Senior Java Spark Developer

Job Overview Who are we looking for: Senior Application Developer with strong an...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Senior Application Developer with strong analytical and technical ability with experience in technologies like Java Spark, Hive, Oracle. Able to work independently with some supervision, should have strong communication skills
  • Should have 8-13 years of hands on experience in Java Spark development with strong understanding of Bigdata, Hive and Oracle, Autosys
  • Quick learner of new tools and technologies
  • Advance level of experience in Java Spark and Bigdata
  • Experience in REST API, Hive, Oracle and Autosys
  • Good exposure to Unix & Shell programming
  • Experience in Regulatory Reporting
  • Technical experience with activities involving heavy reliance on data analysis skills, including data conversions, systems integration, reporting, business intelligence, or data warehousing very helpful
Job Responsibility
Job Responsibility
  • Technical Expertise: Proficient in Java Spark, REST API, SQL, Unix, shell scripting, and Spring Boot, enabling the development of robust and scalable solutions
  • Regulatory & Functional Knowledge: Possesses a deep understanding of Singapore Local Regulatory Guidelines and is adept at navigating complex regulatory changes
  • Critical Thinking & Innovation: Demonstrates strong analytical skills, consistently proposing innovative solutions to enhance existing components and build new functionalities
  • Leadership & Team Building: Has proven capability in leadership, including stabilizing projects during crises, building high-performing teams
  • Should have strong working experience of Agile environment
  • Fulltime
Read More
Arrow Right
New

Java Spark Developer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
  • Should have skills in Big-Data/SPARK
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Senior Databricks & Apache Spark Developer - Vice President

We are looking for a highly skilled Senior Databricks Engineer to contribute to ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years in data engineering or distributed systems
  • Strong expertise in Apache Spark (JavaSpark / PySpark), Databricks on AWS, and Delta Lake
  • Experience with AWS services and large‑scale distributed data processing
  • Experience modernizing or refactoring legacy data platforms into cloud‑based architectures
  • Strong background in Spark performance tuning and large‑scale batch optimization
  • Ability to translate architecture into implementable designs
  • Understanding of data modeling and pipeline orchestration patterns
  • Strong problem‑solving mindset for complex distributed systems
  • Comfortable working in time‑bound, high‑impact environments
  • Proactive, accountable, and collaborative
Job Responsibility
Job Responsibility
  • Platform Engineering & Modernization: Refactor and modernize existing Spark pipelines to Databricks native architectures
  • Eliminate legacy Hadoop dependencies and adopt cloud native AWS patterns
  • Enhance and extend existing processing logic using optimized Spark (JavaSpark / PySpark) on Databricks
  • Databricks Native Development: Build and optimize solutions using Databricks features, including Delta Lake, Databricks Workflows for orchestration and Auto scaling and job clusters
  • Design & Solution Engineering: Contribute to low and mid level architecture and design
  • Translate high level architecture into detailed technical designs
  • Define data models, pipeline patterns, and reusable components
  • Ensure solutions are scalable, maintainable, and production ready
  • Performance Optimization & Simplification: Analyze, improve Spark job performance and simplify complex or over engineered pipelines into standardized, efficient patterns
  • Engineering Standards & Best Practices: Follow and contribute to Databricks and Spark engineering standards
  • Fulltime
Read More
Arrow Right

Lead Java Spark Developer

The Applications Development Manager is an intermediate management level positio...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8 to 11 years of strong experience in Java/J2EE, Spring, Hibernate with expertise in design, development, performance tuning, troubleshooting and deployment
  • Working Experience in Java-Spark & Big Data
  • Strong knowledge of Microservices and eco-system
  • Working knowledge of Containerization using Docker/Kubernetes
  • Good understanding of tomcat, and Linux or Unix operating systems
  • Should be well versed with designing and architecting solutions with latest tech advancements
  • Familiar with standard SDLC and Agile processes
  • Hands on working experience and ability to motivate and lead the team
  • Experience with latest technology in areas of Distributed Computing and Big Data ecosystem(Spark, Hadoop etc.)
  • Solid understanding of SOA concepts, RESTful API design
Job Responsibility
Job Responsibility
  • Works as Java Team lead for suite of applications under Market Risk reporting platform
  • Should own the responsibility of the Module in Market Risk and synergies with team to deliver
  • Should be able to lead a team to deliver complex system designs
  • Understand requirements and code and unit test required components
  • Support acceptance tests and production test
  • Report progress on work and work collaboratively with the existing global team
  • Keep abreast of latest technological happenings in his work area and bring relevant ideas/concept to the table
  • Fulltime
Read More
Arrow Right

Python and Spark Developer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Pune; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of relevant experience in the Financial Service industry
  • Must have skills – Python and Spark
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Java Spark Developer

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Chennai; Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5 to 7 years of Application development experience through full lifecycle
  • Commendable in Data Structures and Algorithms
  • Core Application Development of complex size encompassing all areas of Java/J2EE
  • Thorough knowledge and hands on experience in PySpark and any of the following technologies - Hadoop, Map Reduce Framework, YARN, Unix, Java Spark, Impala, Cassandra on Mesos
  • Implemented or part complex project execution in Big Data Spark eco system, where processing volumes of data thorough understanding of distributed processing and integrated applications
  • Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns
  • Exposure to ETL and BI tools recommended
  • Work in an agile environment following through the best practices of agile Scrum
  • Expertise in designing and optimizing the software solutions for performance and stability
  • Expertise in troubleshooting and problem solving
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower-level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Senior Java Spark Developer - Assistant Vice President

Senior Application Developer with strong analytical and technical ability with e...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-13 years of hands on experience in Java Spark development with strong understanding of Bigdata, Hive and Oracle, Autosys
  • Advance level of experience in Java Spark and Bigdata
  • Experience in REST API, Hive, Oracle and Autosys
  • Good exposure to Unix & Shell programming
  • Experience in Regulatory Reporting
  • Technical experience with activities involving heavy reliance on data analysis skills, including data conversions, systems integration, reporting, business intelligence, or data warehousing very helpful
  • Good to have investment bank regulatory understanding
  • Should have strong working experience of Agile environment
  • Proficient in Java Spark, REST API, SQL, Unix, shell scripting, and Spring Boot
  • Possesses a deep understanding of Singapore Local Regulatory Guidelines and is adept at navigating complex regulatory changes
Job Responsibility
Job Responsibility
  • Technical Expertise: Proficient in Java Spark, REST API, SQL, Unix, shell scripting, and Spring Boot, enabling the development of robust and scalable solutions
  • Regulatory & Functional Knowledge: Possesses a deep understanding of Singapore Local Regulatory Guidelines and is adept at navigating complex regulatory changes
  • Critical Thinking & Innovation: Demonstrates strong analytical skills, consistently proposing innovative solutions to enhance existing components and build new functionalities
  • Leadership & Team Building: Has proven capability in leadership, including stabilizing projects during crises, building high-performing teams
  • Fulltime
Read More
Arrow Right

Java Spark Developer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant experience in the Financial Service industry
  • Strong experience in Java and spark
  • Experience using database technologies
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications.
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision.
  • Can exercise independence of judgement and autonomy.
  • Acts as SME to senior stakeholders and /or other team members.
  • Fulltime
Read More
Arrow Right