CrawlJobs Logo
Citi Logo Citi · IT - Software Development

Python and PySpark Developer

India, Chennai · Job Posted June 16, 2026
Apply Position
Job Link Share

Job Description

We are seeking a motivated and detail‑oriented Python / PySpark Developer to support the development and maintenance of scalable data processing solutions. The ideal candidate should have foundational experience in Python and exposure to Apache Spark (PySpark), along with a strong willingness to learn and grow in a distributed data engineering environment. You will work under the guidance of senior engineers and collaborate with data teams to build reliable data pipelines and contribute to analytics and reporting solutions.

Job Responsibility

  • Assist in developing and maintaining data pipelines using Python and PySpark
  • Support ETL/ELT workflows for batch data processing
  • Write clean, readable, and well‑structured Python code following best practices
  • Perform basic data transformations, aggregations, and validations
  • Debug and troubleshoot pipeline issues with guidance from senior developers
  • Work with structured and semi‑structured data formats (CSV, JSON, Parquet, etc.)
  • Assist in integrating data from databases, APIs, and cloud storage systems
  • Help ensure data quality and consistency within pipelines
  • Support migration of legacy scripts to modern data platforms
  • Collaborate with team members on development tasks and code reviews
  • Participate in knowledge‑sharing and training sessions
  • Learn and adopt new tools, frameworks, and best practices
  • Assist in documenting data workflows and technical processes

Requirements

  • Basic to intermediate proficiency in Python
  • 4 -7 years of experience
  • Exposure to Apache Spark / PySpark (internship or project experience is acceptable)
  • Understanding of fundamental programming and data structures
  • Basic knowledge of SQL and relational databases
  • Familiarity with data processing concepts and ETL fundamentals
  • Awareness of Linux/Unix command line is a plus
  • Understanding of coding best practices and version control (Git)
  • Basic debugging and problem‑solving skills
  • Exposure to unit testing concepts is a plus

Nice to have

  • Exposure to big data tools (Hive, Hadoop ecosystem, or similar)
  • Familiarity with cloud platforms (AWS / Azure / GCP)
  • Basic knowledge of job orchestration tools (Airflow, etc.)
  • Understanding of data pipelines and workflow lifecycle
  • Academic or project experience with data engineering or analytics
Citi - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Python and PySpark Developer

8 matching positions

Data Engineering Python and Pyspark - Assistant Vice President

Location
Location
India , Chennai; Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8 to 14 years of relevant experience in Data engineering role
  • Advanced SQL/ RDBMS skills and experience with relational databases and database design
  • Strong proficiency in object-oriented languages: Python, PySpark is must
  • Experience working with Bigdata - Hive/Impala/S3/HDFS
  • Experience working with data ingestion tools such as Talend or Ab Initio
  • Strong experience in data analysis, data exploration, and trend identification
  • Solid understanding of machine learning fundamentals like Regression, classification, clustering, Feature engineering
  • Strong proficiency in scripting languages like Bash, UNIX Shell scripting
  • Strong proficiency in data pipeline and workflow management tools
  • Strong project management and organizational skills
Job Responsibility
Job Responsibility
  • Build and maintain batch or real-time data pipelines in data platform
  • Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources
  • Develop ETL (extract, transform, load) processes to help extract and manipulate data from multiple sources
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Automate data workflows such as data ingestion, aggregation, and ETL processing
  • Analyze large datasets to identify trends, anomalies, and behavioral patterns
  • Apply machine learning and AI concepts (supervised / unsupervised learning) to support predictive and exploratory analysis
  • Perform feature engineering and data transformations to enable ML models
  • Support trend analysis, segmentation, clustering, and forecasting use cases
  • Interpret analytical results and translate them into business-friendly insights
  • Fulltime
Read More
Arrow Right

Python Developer (PySpark)

We are looking for a skilled Python Developer with hands-on experience in PySpar...
Location
Location
India , Bangalore South
Salary
Salary:
Not provided
votredircom.fr Logo
Wissen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 2 to 4 Years
  • BE/BTech/BCA/MCA or equivalent degree in Computer Science, IT, or related field
Job Responsibility
Job Responsibility
  • Develop and maintain applications/scripts using Python and PySpark
  • Work on data processing, transformation, and optimization of large datasets
  • Develop scalable ETL/data pipeline solutions
  • Collaborate with business and technical teams to understand requirements
  • Write clean, efficient, and reusable code following best practices
  • Perform debugging, troubleshooting, and performance tuning
  • Manage code repositories and version control using GitHub
  • Participate in code reviews and Agile development activities
  • Ensure proper documentation and adherence to coding standards
  • Fulltime
Read More
Arrow Right

Python PySpark Developer

Key Responsibilities: • Designing and developing robust PySpark applications for...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
overturerede.in Logo
Overture Rede
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s/Master’s degree in Computer Science, Engineering, Proven experience (3-10 years) in Python development with a focus on PySpark
  • Strong understanding of distributed computing principles and experience with Apache Spark
  • Proficiency in SQL and experience with relational databases (MySQL, PostgreSQL, etc.)
  • Experience with data serialization formats such as JSON, Parquet, Avro
  • Excellent problem-solving skills and ability to work independently or as part of a team
  • Good communication skills with the ability to effectively collaborate with stakeholders
Job Responsibility
Job Responsibility
  • Designing and developing robust PySpark applications for large-scale data processing
  • Building and optimizing data ingestion, transformation, and storage processes
  • Implementing efficient algorithms and data structures for distributed computing
  • Collaborating with cross-functional teams to integrate data-driven solutions into business processes
  • Troubleshooting performance bottlenecks and ensuring high availability and reliability of data pipelines
  • Writing and optimizing SQL queries for data extraction and manipulation
  • Fulltime
Read More
Arrow Right

Big Data Pyspark Developer

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years of experience with software building and platform engineering
  • Experience in Data Engineering, focused on Big Data ecosystems
  • Knowledge in Hadoop, Pyspark, YARN, Hive, Impala, Spark, and Spark SQL with extensive high volume of data processing pipeline development
  • Programming Expert level and hand on experience in Python
  • Familiarity with data formats like Avro, Parquet, CSV, JSON
  • Hands-on experience in writing SQL queries
  • Experienced with Unix based operating systems and shell scripting
  • Experience with source code management tools such as Bitbucket, Git etc.
  • Strong computer science fundamentals in data structures, algorithms, databases, and operating systems
  • Reverse Engineering, ability to read spaghetti SQL or old scripts and document the business logic before moving it
Job Responsibility
Job Responsibility
  • Formulate and define systems scope and project objectives through research activities
  • Analyze business client needs and document requirements by utilizing business analysis procedures and concepts
  • Assess applicability of previous or similar experiences and evaluate options under circumstances not covered by procedures or precedents
  • Identify risk and consider business implications of the application of technology to the current business environment
  • Create and prepare reports, metrics and presentations
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
What we offer
What we offer
  • Programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more
  • Access to an array of learning and development resources to help broaden and deepen your skills and knowledge as your career progresses
  • Fulltime
Read More
Arrow Right

Clinical Python Developer

ICON plc is a world-leading healthcare intelligence and clinical research organi...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
iconplc.com Logo
iconplc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years’ experience as a Python Programmer / Visualisation Developer / Business Analyst utilising data warehouse pipelines
  • Strong hands-on experience with Python (and relevant libraries/packages) for data transformations and manipulations
  • PySpark experience preferred
  • Pandas experienced also considered
  • Exposure to and understanding of CDSIC guided data structures within a regulated clinical trial environment
  • Mapping experience and domain specific therapeutic area knowledge preferred
  • Solid development skills within Tibco Spotfire or equivalent data visualization tools (Power BI, Tableau, Qlik etc.)
  • Databricks experience preferred
Job Responsibility
Job Responsibility
  • Be responsible for delivery in a continuous improvement framework with respect to systems deployment, life cycle management and enhancements supported user groups
  • Contribute to initiatives to yield faster and more effective report development, efficient change management services for analytics platforms
  • Use your technical expertise with clinical data and report building, and experience gained through working with diverse and complex business processes and associated system infrastructures
  • Work in a matrix environment across functions and departments
What we offer
What we offer
  • Various annual leave entitlements
  • A range of health insurance offerings to suit you and your family’s needs
  • Competitive retirement planning offerings to maximize savings and plan with confidence for the years ahead
  • Global Employee Assistance Programme, LifeWorks, offering 24-hour access to a global network of over 80,000 independent specialized professionals who are there to support you and your family’s well-being
  • Life assurance
  • Flexible country-specific optional benefits, including childcare vouchers, bike purchase schemes, discounted gym memberships, subsidized travel passes, health assessments, among others
  • Fulltime
Read More
Arrow Right

Senior Python Developer

FinXL by Randstad Digital focuses on developing client's Networking, Digital and...
Location
Location
Australia , North Sydney
Salary
Salary:
Not provided
finxl.com.au Logo
FinXL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Python Engineer experience
  • Python & ETL: Essential expert-level proficiency
  • Airflow Mastery: A solid grasp of Airflow concepts is mandatory including: Creating and operating Airflow tasks, orchestrating complex workflows, handling various data flow challenges-bottlenecks
  • Airflow orchestration experience
  • PySpark experience
  • Data pipelines experience
  • Candidates must demonstrate a logical approach to ETL pipelines & the ability to think through edge-case scenarios
  • Experience troubleshooting complex ETL scenarios
Read More
Arrow Right

Python Developer - NLP, ML, Gen AI

Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3–5 years of hands-on Python programming experience
  • Strong fundamentals in Python, OOP, and design patterns
  • Experience with NLP libraries such as Flair, BERT, HuggingFace Transformers, or similar
  • Solid experience with PySpark, Pandas, PyArrow, and distributed data pipelines
  • Proficient in working with Parquet using FastParquet or pyarrow.parquet
  • Familiarity with fast JSON parsing libraries (json, ujson, orjson)
  • Experience building APIs using Flask (FastAPI is a plus)
  • Experience with MLflow for model tracking and deployment
  • Good understanding of CI/CD practices and Git workflows
  • Experience working with Redis or similar in-memory stores
Job Responsibility
Job Responsibility
  • Develop and optimize ETL/data processing jobs using PySpark, Pandas, PyArrow, and related libraries
  • Work with Parquet files using FastParquet or pyarrow.parquet for efficient data processing
  • Implement data parsing and serialization using json, ujson, or orjson for high-performance JSON handling
  • Build and maintain NLP pipelines using Flair, BERT, and LLM-based models
  • Develop scalable ingestion and data transformation pipelines for AI and analytics use cases
  • Build and maintain Flask-based APIs for model inference and service integrations
  • Use regular expressions for text cleaning, parsing, and NLP preprocessing
  • Integrate caching and fast lookups using Redis
  • Manage and deploy ML models using MLflow for tracking and versioning
  • Support CI/CD workflows using GitHub, LightSpeed Enterprise, and deployment pipelines
  • Fulltime
Read More
Arrow Right

Python Developer - NLP, ML, Gen AI

We are looking for a mid-level Python Developer - NLP, ML, Gen AI with combined ...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3–5 years of hands-on Python programming experience
  • Strong fundamentals in Python, OOP, and design patterns
  • Experience with NLP libraries such as Flair, BERT, HuggingFace Transformers, or similar
  • Solid experience with PySpark, Pandas, PyArrow, and distributed data pipelines
  • Proficient in working with Parquet using FastParquet or pyarrow.parquet
  • Familiarity with fast JSON parsing libraries (json, ujson, orjson)
  • Experience building APIs using Flask (FastAPI is a plus)
  • Experience with MLflow for model tracking and deployment
  • Good understanding of CI/CD practices and Git workflows
  • Experience working with Redis or similar in-memory stores
Job Responsibility
Job Responsibility
  • Develop and optimize ETL/data processing jobs using PySpark, Pandas, PyArrow, and related libraries
  • Work with Parquet files using FastParquet or pyarrow.parquet for efficient data processing
  • Implement data parsing and serialization using json, ujson, or orjson for high-performance JSON handling
  • Build and maintain NLP pipelines using Flair, BERT, and LLM-based models
  • Develop scalable ingestion and data transformation pipelines for AI and analytics use cases
  • Build and maintain Flask-based APIs for model inference and service integrations
  • Use regular expressions for text cleaning, parsing, and NLP preprocessing
  • Integrate caching and fast lookups using Redis
  • Manage and deploy ML models using MLflow for tracking and versioning
  • Support CI/CD workflows using GitHub, LightSpeed Enterprise, and deployment pipelines
  • Fulltime
Read More
Arrow Right