CrawlJobs Logo

Pyspark Developer

https://www.citi.com/ Logo

Citi

Location Icon

Location:
India, Pune

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. We are seeking an experienced and highly skilled PySpark Developer to design, develop, and maintain robust and scalable data processing solutions. The ideal candidate will have a strong background in big data technologies, particularly Apache Spark with Python (PySpark), and a deep understanding of data warehousing, ETL/ELT processes, and cloud platforms.

Job Responsibility:

  • Proficiency in designing and building robust data pipelines, data ingestion, transformation, and processing workflows
  • Leading and mentoring a team of data engineers or analysts, fostering best practices, and ensuring the delivery of high-quality data products
  • Working closely with product partners and business analysts, to understand requirements and deliver impactful analytical solutions

Requirements:

  • 8 years of experience in software development with a focus on data engineering
  • 3+ years of experience with PySpark for data processing, ETL (Extract, Transform, Load) operations, data manipulation, and building distributed computing solutions on large datasets
  • Proficiency in designing and building robust data pipelines, data ingestion, transformation, and processing workflows
  • Solid understanding of data modeling principles, database design, and strong SQL skills for data querying and analysis
  • Ability to analyze data, identify patterns, uncover insights, and translate business needs into actionable data solutions
  • Leading and mentoring a team of data engineers or analysts, fostering best practices, and ensuring the delivery of high-quality data products
  • Working closely with product partners and business analysts, to understand requirements and deliver impactful analytical solutions
  • Strong understanding of data processing concepts and techniques
  • Proficiency in SQL and experience with relational databases
  • Experience with cloud platforms such as AWS, Azure, or GCP is a plus
  • Familiarity with data warehousing concepts and technologies
  • Experience with big data technologies such as Hadoop, Hive, or Impala is a plus
  • Excellent problem-solving and communication skills
  • Ability to work independently and as part of a team
  • Understanding of microservices architecture principles and design patterns
  • Experience with DevOps practices and tools
  • Bachelor’s degree/University degree or equivalent experience

Nice to have:

  • Experience with cloud platforms such as AWS, Azure, or GCP is a plus
  • Familiarity with data warehousing concepts and technologies
  • Experience with big data technologies such as Hadoop, Hive, or Impala is a plus

Additional Information:

Job Posted:
August 22, 2025

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.