CrawlJobs Logo
Citi Logo Citi · IT - Software Development

Bigdata Developer With Spark

India, Pune · Job Posted June 02, 2026
Apply Position
Job Link Share

Job Description

Citi are recruiting a Full Stack Data Engineer, reporting to the Engineering Lead, to join the Engineering team for an internal compliance and surveillance line of business. You will be responsible for implementing Data Engineering solutions for Independent Compliance Risk Managers using Big Data Tools. The role requires deep technical knowledge and expertise in software development, including programming languages, frameworks, and best practices. Actively contributes to the implementation of critical features and complex technical solutions. Write clean, efficient, and maintainable code that meets the highest standards of quality. Stay up-to-date with emerging technologies, tools, and industry trends. Evaluate their potential impact on the organization and provide recommendations for technology adoption and innovation.

Job Responsibility

  • Design & develop Data engineering solutions using Big Data Technologies
  • Design & Develop and test software applications that leverages LLM Models & AI Capabilities
  • Provide technical walk-throughs to various stakeholders
  • Be able to work independently as well as within a team
  • Works directly with end-users or a projects team to translate business requirements into technical specifications to drive Semantic layer and report
  • Prioritize technical issue resolution
  • Works closely with management to prioritize business needs and stay up to date with the goals of the organization as they evolve
  • Also work with other departments to find new ways to improve opportunities
  • Requirement gathering & understanding, effort estimation, technical design, project planning and monitoring
  • Understand and analyze the data to find patterns and valuable business insights
  • Required to review the day to day delivery work with the team, ensuring a robust process implementation, identifying project/program delivery risks and work on risk mitigation

Requirements

  • 5+ years development and system design experience
  • More than 2 years of experience in BigData technologies like spark, hive, python
  • Strong Python programming skill
  • Strong experience in building ETL/data engineering solutions
  • Demonstrated experience with LLM Model, prompt engineering & AI workflow
  • Proven proactive problem solving & trouble shooting skills
  • Strong Knowledge in Spark, Python
  • Strong experience in Hive/SQL, PL/SQL
  • Good Understanding of Big data Ecosystem
  • Good Understanding of ETL & DW Concepts, Unix Scripting
  • Good understanding of SDLC

Nice to have

  • Previous Experience working with OpenAI, Google AI or similar LLM Providers
  • Experience integrating AI/ML Models or APIs into Production Applications
  • Familiarity with Large language Models, APIs, Prompt Engineering & AI workflow Design
  • Background in NLP and ML
  • Cloud Computing AWS/Azure
Citi - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Bigdata Developer With Spark

8 matching positions

Bigdata Developer with PySpark

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
  • Strong understanding of Core Java and Object-Oriented Programming (OOP) concepts
  • Proficiency in Python, specifically for PySpark development
  • Hands-on experience or familiarity with Apache Spark (PySpark), Hadoop, and related ecosystem components like Hive and Sqoop
  • Basic knowledge of SQL and relational databases
Job Responsibility
Job Responsibility
  • Develop and maintain data pipelines: Design, develop, and optimize scalable ETL (Extraction, Transformation, Loading) pipelines using PySpark to process large datasets
  • Coding and software engineering: Write clean, efficient, well-documented code primarily in Python (PySpark) and Java, often utilizing frameworks like Spring Boot
  • Collaboration and communication: Work with cross-functional teams, including senior developers, data engineers, analysts, and business partners, to understand data requirements and ensure seamless integration of solutions
  • Troubleshooting and optimization: Debug and resolve data processing issues and performance bottlenecks in Spark applications and other big data technologies
  • Full lifecycle involvement: Participate in the entire software development lifecycle (SDLC), from requirements analysis and design to testing, deployment, and operations, often using Agile/Scrum methodologies
  • Data integrity and quality: Ensure data quality and integrity throughout the data lifecycle
  • Fulltime
Read More
Arrow Right
New

Java Bigdata Developer

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3-5 years of relevant experience
  • Experience in programming/debugging used in business applications
  • Working knowledge of industry practice and standards
  • Comprehensive knowledge of specific business area for application development
  • Working knowledge of program languages
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor's degree/University degree or equivalent experience
  • Good knowledge on JavaSpark
  • Experience in Bigdata and Hive
  • Good understanding and hands on in AI tools like co-pilot etc.
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements
  • Identify and analyze issues, make recommendations, and implement solutions
  • Utilize knowledge of business processes, system processes, and industry standards to solve complex issues
  • Analyze information and make evaluative judgements to recommend solutions and improvements
  • Conduct testing and debugging, utilize script tools, and write basic code for design specifications
  • Assess applicability of similar experiences and evaluate options under circumstances not covered by procedures
  • Develop working knowledge of Citi’s information systems, procedures, standards, client server application development, network operations, database administration, systems administration, data center operations, and PC-based applications
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
  • Fulltime
Read More
Arrow Right

BigData Developer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
  • Big Data resource
  • Worked on Py-Spark for at least 5 years
  • worked on T-SQL and SQL server
  • Data warehousing design and implementation
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Big Data resource
  • Worked on Py-Spark for at least 5 years
  • Fulltime
Read More
Arrow Right

Applications Development Sr Programmer Analyst (Sr. BigData Developer)

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant experience
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
  • Strong Experience in Apache Hadoop, Spark, Hive, Impala, Yarn, Talend, Hue
  • Spark Calculators based on business logic/rules
  • Programming skills with Scala, Java, J2EE, Python, Unix/Linux shell, Spark RD
  • Understanding of OOP and Functional design approach
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Senior Java Spark Developer - Assistant Vice President

Senior Application Developer with strong analytical and technical ability with e...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-13 years of hands on experience in Java Spark development with strong understanding of Bigdata, Hive and Oracle, Autosys
  • Advance level of experience in Java Spark and Bigdata
  • Experience in REST API, Hive, Oracle and Autosys
  • Good exposure to Unix & Shell programming
  • Experience in Regulatory Reporting
  • Technical experience with activities involving heavy reliance on data analysis skills, including data conversions, systems integration, reporting, business intelligence, or data warehousing very helpful
  • Good to have investment bank regulatory understanding
  • Should have strong working experience of Agile environment
  • Proficient in Java Spark, REST API, SQL, Unix, shell scripting, and Spring Boot
  • Possesses a deep understanding of Singapore Local Regulatory Guidelines and is adept at navigating complex regulatory changes
Job Responsibility
Job Responsibility
  • Technical Expertise: Proficient in Java Spark, REST API, SQL, Unix, shell scripting, and Spring Boot, enabling the development of robust and scalable solutions
  • Regulatory & Functional Knowledge: Possesses a deep understanding of Singapore Local Regulatory Guidelines and is adept at navigating complex regulatory changes
  • Critical Thinking & Innovation: Demonstrates strong analytical skills, consistently proposing innovative solutions to enhance existing components and build new functionalities
  • Leadership & Team Building: Has proven capability in leadership, including stabilizing projects during crises, building high-performing teams
  • Fulltime
Read More
Arrow Right

Senior Java -Spark-Bigdata Engineer-Assistant Vice President

The Applications Development Senior Programmer Analyst is a senior-level positio...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-10 years of relevant experience in Data Engineering or a similar role, preferably within the Financial Services industry
  • Senior-level experience in an Applications Development or Data Engineering role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
  • Hands-on expertise in Java (8+), Spring Boot, Python, and PySpark for building high-performance data applications
  • Extensive experience with the BigData ecosystem, including Apache Spark for large-scale data processing
  • Solid understanding of Data Warehouse concepts, design principles, and best practices
  • Strong proficiency with both relational SQL databases and NoSQL databases (e.g., MongoDB, Couchbase)
Job Responsibility
Job Responsibility
  • Utilize expert knowledge of data engineering principles, big data technologies, and software development best practices to design and implement robust data solutions
  • Collaborate with business stakeholders, data scientists, and other technology teams to understand data requirements and deliver effective solutions
  • Apply deep expertise in programming languages like Python and Java for building high-performance data processing applications
  • Ensure data solutions are secure, scalable, and adhere to the firm's security and architectural standards
  • Mentor and guide junior engineers, fostering a culture of technical excellence and continuous learning
  • Lead the analysis of complex data-related issues, identify root causes, and implement sustainable solutions
  • Operate with a high degree of autonomy and independence, exercising sound judgment and decision-making
  • Act as a Subject Matter Expert (SME) in big data technologies for senior stakeholders and other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Senior Java Spark Developer

Senior Application Developer with strong analytical and technical ability with e...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Senior Application Developer with strong analytical and technical ability
  • 8-13 years of hands on experience in Java Spark development
  • Strong understanding of Bigdata, Hive and Oracle, Autosys
  • Advance level of experience in Java Spark and Bigdata
  • Experience in REST API, Hive, Oracle and Autosys
  • Good exposure to Unix & Shell programming
  • Experience in Regulatory Reporting
  • Technical experience with activities involving heavy reliance on data analysis skills, including data conversions, systems integration, reporting, business intelligence, or data warehousing
  • Strong communication skills
  • Able to work independently with some supervision
Job Responsibility
Job Responsibility
  • Technical Expertise: Proficient in Java Spark, REST API, SQL, Unix, shell scripting, and Spring Boot, enabling the development of robust and scalable solutions
  • Regulatory & Functional Knowledge: Possesses a deep understanding of Singapore Local Regulatory Guidelines and is adept at navigating complex regulatory changes
  • Critical Thinking & Innovation: Demonstrates strong analytical skills, consistently proposing innovative solutions to enhance existing components and build new functionalities
  • Leadership & Team Building: Has proven capability in leadership, including stabilizing projects during crises, building high-performing teams
  • Fulltime
Read More
Arrow Right

Senior Bigdata Developer

The Data Analytics Senior Analyst is a seasoned professional role. Applies in-de...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Database Development & Architecture:Design, develop, and maintain complex database solutions across MongoDB, Oracle, and other SQL databases. Create optimal data models, schemas, and stored procedures to support high-throughput applications.
  • Data Pipeline Construction:Build and manage resilient, scalable ETL/ELT pipelines using Python to process and integrate large volumes of data from diverse source systems into our core data platforms.
  • Big Data Engineering:Engineer and implement solutions within our Big Data ecosystem (e.g., Hadoop, Spark, Hive, Kafka) to handle large-scale data processing, batch analytics, and real-time data streams.
  • Python Development:Write high-quality, production-ready Python code for data manipulation, API development, and automation. Utilize a range of libraries and frameworks relevant to data engineering (e.g., Pandas, PySpark, SQLAlchemy, PyMongo).
  • Performance Optimization:Proactively monitor, troubleshoot, and optimize the performance of our databases and data pipelines. Focus on query tuning, indexing strategies, and resource management to ensure low-latency data access.
  • Data Quality and Integrity:Implement data quality checks, validation rules, and monitoring frameworks within the data pipelines to ensure the accuracy, consistency, and reliability of our KYC data.
  • Collaboration:Work closely with application developers, data scientists, and data analysts to understand their data requirements and provide robust, well-documented data solutions and services.
  • Technical Leadership:Provide subject matter expertise on database and data engineering best practices. Mentor junior engineers and contribute to a culture of technical excellence.
  • Education:Bachelor’s/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Applies in-depth disciplinary knowledge, contributing to the development of new techniques and the improvement of processes and work-flows.
  • Coordinates and contribute to the objectives of data science initiatives and overall business through leveraging in-depth understanding of how areas collectively integrate within the sub-function.
  • Assumes informal/formal leadership role through coaching and training of new recruits.
  • Significantly influences decisions, work, and performance of all teams through advice, counsel and/or facilitating services to others in the business.
  • Conducts strategic data analysis, identifies insights and implications and make strategic recommendations, develops data displays that clearly communicate complex analysis.
  • Mines and analyzes data from various banking platforms to drive optimization and improve data quality.
  • Delivers analytics initiatives to address business problems with the ability to identify data required, assess time & effort required and establish a project plan.
  • Consults with business clients to identify system functional specifications. Applies comprehensive understanding of how multiple areas collectively integrate to contribute towards achieving business goals.
  • Consults with users and clients to solve complex system issues/problems through in-depth evaluation of business processes, systems and industry standards
  • recommends solutions.
  • Fulltime
Read More
Arrow Right