CrawlJobs Logo
Citi Logo Citi · IT - Software Development

PySpark Developer

India, Pune · Job Posted February 08, 2026
Apply Position
Job Link Share

Job Description

At Citi we’re not just building technology, we’re building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with laser focused on evolving the ways of doing things. As one of the world’s most global banks we’re changing how the world does business.

Job Responsibility

Design, develop, and maintain efficient, scalable ETL pipelines using Python and PySpark

Requirements

  • 5-8 years of experience with strong experience on PySpark Developer
  • Proficiency in Python and extensive experience with the PySpark library
  • Bachelor’s degree/University degree or equivalent experience
Citi - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

PySpark Developer

8 matching positions

PySpark Developer

PySpark Developer with 5-10 years experience in data engineering practice. Respo...
Location
Location
United States , Irving
Salary
Salary:
140000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PySpark Developer with 5-10 years experience in data engineering practice
  • Strong experience in Apache Spark framework including good understanding of core concepts, performance optimization and industry best practices
  • Proficient in PySpark with hands-on coding experience and ability to implement complex business level transformations
  • Familiarity with unit testing, object-oriented programming (OOPS) concepts and interpreting test results
  • Proficient to write complex and efficient SQL queries to extract the business critical insights from large-scale data
  • Experience with scheduling of the transformation jobs as per business requirement
  • Perform root-cause analysis and troubleshoot errors on data pipelines, evaluating data quality issues, and implementing corrective fixes
Job Responsibility
Job Responsibility
  • Responsible for designing, developing and maintaining scalable data pipelines, optimizing data workflows and ensuring the integrity and availability of data for business intelligence
  • Collaborate with the stakeholders and analysts to understand data requirement and deliver robust, creative and innovative solutions
  • Fulltime
Read More
Arrow Right

Pyspark Developer

At Citi we’re not just building technology, we’re building the future of banking...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years relevant experience in Big Data Analytics OR Big Data OR Cloud Engineering
  • Hands on experience over SQL, Python, Pyspark, with Spark components
  • 3-7 years of experience as Big Data Engineer to develop, optimize, and manage large-scale data processing systems and analytics platforms
  • 2 years of experience in distributed data processing & near real-time data analytics using PySpark
  • ETL Experience with any relevant tool
  • Strong understanding of PySpark execution plans, partitioning & optimization techniques
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
What we offer
What we offer
  • Programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Empower our employees to manage their financial well-being and help them plan for the future
  • Provide access to an array of learning and development resources to help broaden and deepen your skills and knowledge as your career progresses
  • Fulltime
Read More
Arrow Right

Python and PySpark Developer

We are seeking a motivated and detail‑oriented Python / PySpark Developer to sup...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Basic to intermediate proficiency in Python
  • 4 -7 years of experience
  • Exposure to Apache Spark / PySpark (internship or project experience is acceptable)
  • Understanding of fundamental programming and data structures
  • Basic knowledge of SQL and relational databases
  • Familiarity with data processing concepts and ETL fundamentals
  • Awareness of Linux/Unix command line is a plus
  • Understanding of coding best practices and version control (Git)
  • Basic debugging and problem‑solving skills
  • Exposure to unit testing concepts is a plus
Job Responsibility
Job Responsibility
  • Assist in developing and maintaining data pipelines using Python and PySpark
  • Support ETL/ELT workflows for batch data processing
  • Write clean, readable, and well‑structured Python code following best practices
  • Perform basic data transformations, aggregations, and validations
  • Debug and troubleshoot pipeline issues with guidance from senior developers
  • Work with structured and semi‑structured data formats (CSV, JSON, Parquet, etc.)
  • Assist in integrating data from databases, APIs, and cloud storage systems
  • Help ensure data quality and consistency within pipelines
  • Support migration of legacy scripts to modern data platforms
  • Collaborate with team members on development tasks and code reviews
  • Fulltime
Read More
Arrow Right

Big Data Pyspark Developer

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years of experience with software building and platform engineering
  • Experience in Data Engineering, focused on Big Data ecosystems
  • Knowledge in Hadoop, Pyspark, YARN, Hive, Impala, Spark, and Spark SQL with extensive high volume of data processing pipeline development
  • Programming Expert level and hand on experience in Python
  • Familiarity with data formats like Avro, Parquet, CSV, JSON
  • Hands-on experience in writing SQL queries
  • Experienced with Unix based operating systems and shell scripting
  • Experience with source code management tools such as Bitbucket, Git etc.
  • Strong computer science fundamentals in data structures, algorithms, databases, and operating systems
  • Reverse Engineering, ability to read spaghetti SQL or old scripts and document the business logic before moving it
Job Responsibility
Job Responsibility
  • Formulate and define systems scope and project objectives through research activities
  • Analyze business client needs and document requirements by utilizing business analysis procedures and concepts
  • Assess applicability of previous or similar experiences and evaluate options under circumstances not covered by procedures or precedents
  • Identify risk and consider business implications of the application of technology to the current business environment
  • Create and prepare reports, metrics and presentations
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
What we offer
What we offer
  • Programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Access to an array of learning and development resources to help broaden and deepen your skills and knowledge as your career progresses
  • Fulltime
Read More
Arrow Right

Python Developer (PySpark)

We are looking for a skilled Python Developer with hands-on experience in PySpar...
Location
Location
India , Bangalore South
Salary
Salary:
Not provided
votredircom.fr Logo
Wissen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 2 to 4 Years
  • BE/BTech/BCA/MCA or equivalent degree in Computer Science, IT, or related field
Job Responsibility
Job Responsibility
  • Develop and maintain applications/scripts using Python and PySpark
  • Work on data processing, transformation, and optimization of large datasets
  • Develop scalable ETL/data pipeline solutions
  • Collaborate with business and technical teams to understand requirements
  • Write clean, efficient, and reusable code following best practices
  • Perform debugging, troubleshooting, and performance tuning
  • Manage code repositories and version control using GitHub
  • Participate in code reviews and Agile development activities
  • Ensure proper documentation and adherence to coding standards
  • Fulltime
Read More
Arrow Right

Python PySpark Developer

Key Responsibilities: • Designing and developing robust PySpark applications for...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
overturerede.in Logo
Overture Rede
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s/Master’s degree in Computer Science, Engineering, Proven experience (3-10 years) in Python development with a focus on PySpark
  • Strong understanding of distributed computing principles and experience with Apache Spark
  • Proficiency in SQL and experience with relational databases (MySQL, PostgreSQL, etc.)
  • Experience with data serialization formats such as JSON, Parquet, Avro
  • Excellent problem-solving skills and ability to work independently or as part of a team
  • Good communication skills with the ability to effectively collaborate with stakeholders
Job Responsibility
Job Responsibility
  • Designing and developing robust PySpark applications for large-scale data processing
  • Building and optimizing data ingestion, transformation, and storage processes
  • Implementing efficient algorithms and data structures for distributed computing
  • Collaborating with cross-functional teams to integrate data-driven solutions into business processes
  • Troubleshooting performance bottlenecks and ensuring high availability and reliability of data pipelines
  • Writing and optimizing SQL queries for data extraction and manipulation
  • Fulltime
Read More
Arrow Right

Senior Java PySpark Developer

We are seeking a seasoned Senior Lead Data Engineer with a dual-threat backgroun...
Location
Location
United States , Irving
Salary
Salary:
160000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional experience in Java, PySpark/Python development
  • Strong understanding of Python frameworks such as Django, Flask, or FastAPI
  • Expertise in building Java RESTful APIs and microservices architecture
  • Solid understanding of software design patterns, algorithms, and data structures
  • Hands-on experience with Big Data Environment
  • Familiarity with CI/CD pipelines and version control systems (e.g., Git)
  • Strong debugging and problem-solving skills
  • Excellent communication and collaboration skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust, scalable, and high-performance applications using Java, PySpark/Python
  • Lead the architecture and design of complex software systems and ensure adherence to best practices
  • Collaborate with product managers, designers, and other developers to define project requirements and deliverables
  • Optimize and refactor existing codebases for performance, scalability, and maintainability
  • Mentor junior developers and provide technical guidance to the team
  • Integrate third-party APIs, libraries, and tools into applications
  • Write unit tests, perform code reviews, and ensure high code quality
  • Work with DevOps teams to deploy and monitor applications in production environments
  • Stay updated with the latest trends and advancements in Java and Python and related technologies
  • Fulltime
Read More
Arrow Right

Senior Java PySpark Developer

Senior Java PySpark Developer – Assistant Vice President is an intermediate leve...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7 to 12 years of Application development experience through full lifecycle SME for UI architecture patterns - Micro Frontend, NX
  • Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns. Experience on Microservices, Spring boot
  • The candidate should be commendable in Data Structures and Algorithms. He should have worked on Core Application Development of complex size encompassing all areas of Java/J2EE
  • She/He must have thorough knowledge and hands on experience in PySpark and any of the following technologies - Hadoop, Map Reduce Framework, YARN, Unix, Java Spark, Impala, Cassandra on Mesos. Cloudera certification (CCDH) is an added advantage
  • She/He should have implemented or part complex project execution in Big Data Spark eco system, where processing volumes of data thorough understanding of distributed processing and integrated applications
  • Exposure to ETL and BI tools will be good
  • Work in an agile environment following through the best practices of agile Scrum
  • Expertise in designing and optimizing the software solutions for performance and stability
  • Expertise in troubleshooting and problem solving
  • Expertise in Test driven development
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower-level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right