Big Data Pyspark Developer Job at Citi (Pune)

Big Data Lead Developer

We are seeking a highly skilled and experienced Big Data Lead Developer to estab...

Location

Canada , Mississauga

Salary:

170.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

6+ years of relevant experience in Big Data application development or systems analysis role
Experience in leading and mentoring big data engineering teams
Strong understanding of big data concepts, architectures, and technologies (e.g., Hadoop, PySpark, Hive, Kafka, NoSQL databases)
Proficiency in programming languages such as Java, Scala, or Python
Excellent problem-solving and analytical skills
Strong presentation, communication and interpersonal skills
Experience with data warehousing and business intelligence tools
Experience with data visualization and reporting
Knowledge of cloud-based big data platforms (e.g., AWS EMR, Azure HDInsight, Google Cloud Dataproc)
Proficiency in Unix/Linux environments

Job Responsibility

Lead and mentor a team of big data engineers, fostering a collaborative and high-performing environment
Provide technical guidance, code reviews, and support for professional development
Design and implement scalable and robust big data architectures and pipelines to handle large volumes of data from various sources
Evaluate and select appropriate big data technologies and tools based on project requirements and industry best practices
Implement and integrate these technologies into our existing infrastructure
Develop and optimize data processing and analysis workflows using technologies such as Spark, Hadoop, Hive, and other relevant tools
Implement data quality checks and ensure adherence to data governance policies and procedures
Continuously monitor and optimize the performance of big data systems and pipelines to ensure efficient data processing and retrieval
Collaborate effectively with cross-functional teams, including data scientists, business analysts, and product managers, to understand their data needs and deliver impactful solutions
Stay up to date with the latest advancements in big data technologies and explore new tools and techniques to improve our data infrastructure

What we offer

Global benefits designed to support your well-being, growth, and work-life balance

Fulltime

Senior Python Big Data Developer

The Applications Development Senior Programmer Analyst is an intermediate level ...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

7 - 12 years of relevant experience
Experience in systems analysis and programming of software applications
Experience in managing and implementing successful projects
Working knowledge of consulting/project management techniques/methods
Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Bachelor’s degree/University degree or equivalent experience
Strong expertise in Big Data technologies (Spark, Hadoop, Hive, Impala, Kafka, Scala, Cloudera)
Design, develop, and maintain robust and scalable data pipelines using Python, SQL, PySpark, and streaming technologies like Kafka
Strong SQL and NoSQL experience (Oracle, MongoDB, PostgreSQL) for data extraction, reconciliation, and transformation
Proficiency in Python and Shell scripting for data processing and automation

Job Responsibility

Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
Ensure essential procedures are followed and help define operating standards and processes
Serve as advisor or coach to new or lower level analysts
Has the ability to operate with a limited level of direct supervision
Can exercise independence of judgement and autonomy
Acts as SME to senior stakeholders and /or other team members

Fulltime

Senior Big Data Engineer

The Big Data Engineer is a senior level position responsible for establishing an...

Location

Canada , Mississauga

Salary:

94300.00 - 141500.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

5+ Years of Experience in Big Data Engineering (PySpark)
Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources
Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka
Proficiency in programming languages like Python, or Scala
Strong expertise in data processing frameworks such as Apache Spark, Hadoop
Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)
Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery)
Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.)
Experience with data orchestration tools like Apache Airflow or Prefect
Familiarity with containerization (Docker, Kubernetes) is a plus

Job Responsibility

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets

Fulltime

Senior Big Data Engineer

The Big Data Engineer is a senior level position responsible for establishing an...

Location

Canada , Mississauga

Salary:

94300.00 - 141500.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

5+ Years of Experience in Big Data Engineering (PySpark)
Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources
Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka
Proficiency in programming languages like Python, or Scala
Strong expertise in data processing frameworks such as Apache Spark, Hadoop
Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)
Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery)
Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.)
Experience with data orchestration tools like Apache Airflow or Prefect
Familiarity with containerization (Docker, Kubernetes) is a plus

Job Responsibility

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

What we offer

Well-being support
Growth opportunities
Work-life balance support

Fulltime

Pyspark Data Engineer

The Data Analytics Intmd Analyst is a developing professional role. Deals with m...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

4-8 years relevant experience in Data Analytics and Big Data
SQL, Python, Pyspark, with Spark components
Minimum 4 years of experience as a python developer with expertise in automation testing to design, develop, and automate robust software solutions and testing frameworks like Pytest, Behave
2-4 years of experience as Big Data Engineer to develop, optimize, and manage large-scale data processing systems and analytics platforms
4 years of experience in distributed data processing & near real-time data analytics using PySpark
Strong understanding of PySpark execution plans, partitioning & optimization techniques

Job Responsibility

Integrates in-depth data analysis knowledge with a solid understanding of industry standards and practices
Demonstrates a Good understanding of how data analytics teams and area integrate with others in accomplishing objectives
Applies project management skills
Applies analytical thinking and knowledge of data analysis tools and methodologies
Analyzes factual information to make accurate judgments and recommendations focused on local operations and broader impacts
Applies professional judgment when interpreting data and results breaking down information in a systematic and communicable manner
Employs developed communication and diplomacy skills to exchange potentially complex/sensitive information
Demonstrates attention to quality and timeliness of service to ensure the effectiveness of the team and group
Provides informal guidance or on-the-job-training to new team members
Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

Fulltime

Senior Big Data Engineer

Location

United States , Flowood

Salary:

Not provided

PhasorSoft Group

Expiration Date

Until further notice

Requirements

Proficiency in Python programming for data manipulation and analysis
Experience with PySpark for processing large-scale data
Strong understanding and practical experience with big data technologies such as Hadoop, Spark, Kafka, etc.
Knowledge of designing and implementing ETL processes for data integration
Ability to work with large datasets, perform data cleansing, transformations, and aggregations
Familiarity with machine learning concepts and experience implementing ML models
Understanding of data governance principles and experience implementing data security measures
Ability to create clear and concise documentation for data pipelines and processes
Strong teamwork and collaboration skills to work with cross-functional teams
Analytical and problem-solving skills to optimize data workflows and processes

Job Responsibility

Design and develop scalable data pipelines and solutions using Python and PySpark
Utilize big data technologies such as Hadoop, Spark, Kafka, or similar tools for processing and analyzing large datasets
Develop and maintain ETL processes to extract, transform, and load data into data lakes or warehouses
Collaborate with data engineers and scientists to implement machine learning models and algorithms
Optimize and tune data processing workflows for performance and efficiency
Implement data governance and security measures to ensure data integrity and privacy
Create and maintain documentation for data pipelines, workflows, and processes
Provide technical leadership and mentorship to junior team members

Fulltime

Big Data Engineering Lead

The Senior Big Data engineering lead will play a pivotal role in designing, impl...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Bachelor's or Master’s degree in Computer Science, Information Technology, or related field
Atleast 10 -12 years overall software development experience on majorly working with handling application with large scale data volumes from ingestion, persistence and retrieval
Deep understanding of big data technologies, including Hadoop, Spark, Kafka, Flink, NoSQL databases, etc.
Experience with Bigdata technologies Developer Hadoop, Apache Spark, Python, PySpark
Strong programming skills in languages such as Java, Scala, or Python
Excellent problem-solving skills with a knack for innovative solutions
Strong communication and leadership abilities
Proven ability to manage multiple projects simultaneously and deliver results

Job Responsibility

Lead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and resilience
Design complex data transformation processes using Spark and other big data technologies using Java, Pyspark or Scala
Design and implement data pipelines that ensure data quality, integrity, and availability
Collaborate with cross-functional teams to understand business needs and translate them into technical requirements
Evaluate and select technologies that improve data efficiency, scalability, and performance
Oversee the deployment and management of big data tools and frameworks such as Hadoop, Spark, Kafka, and others
Provide technical guidance and mentorship to the development team and junior architects
Continuously assess and integrate emerging technologies and methodologies to enhance data processing capabilities
Optimize big data frameworks, such as Hadoop, Spark, for performance improvements and reduced processing time across distributed systems
Implement data governance frameworks to ensure data accuracy, consistency, and privacy across the organization, leveraging metadata management and data lineage tracking

Fulltime

Big Data/Cloud Developer

The Applications Development Senior Programmer Analyst is an intermediate level ...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

8 plus years of relevant experience
Proficiency in Big Data, Spark, PySpark, Scala, Python
Familiarity with Data warehouse, data lake, data analytics, cloud computing, snowflake
Experience in systems analysis and programming of software applications
Experience in managing and implementing successful projects
Working knowledge of consulting/project management techniques/methods
Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Bachelor's degree/University degree or equivalent experience

Job Responsibility

Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation
Provide user and operational support on applications to business users
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues
Recommend and develop security measures in post implementation analysis of business usage
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions
Ensure essential procedures are followed and help define operating standards and processes
Serve as advisor or coach to new or lower level analysts
Appropriately assess risk when business decisions are made

Fulltime

Big Data Pyspark Developer

Citi

Location:
India , Pune

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:
March 01, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Big Data Pyspark Developer

Big Data Lead Developer

Senior Python Big Data Developer

Senior Big Data Engineer

Senior Big Data Engineer

Pyspark Data Engineer

Senior Big Data Engineer

Big Data Engineering Lead

Big Data/Cloud Developer

Big Data Pyspark Developer

Citi

Location:India , Pune

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:March 01, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Big Data Pyspark Developer

Big Data Lead Developer

Senior Python Big Data Developer

Senior Big Data Engineer

Senior Big Data Engineer

Pyspark Data Engineer

Senior Big Data Engineer

Big Data Engineering Lead

Big Data/Cloud Developer

Location:
India , Pune

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
March 01, 2026