Bigdata Developer with PySpark Job at Citi (Pune)

Bigdata Java Spark And Pyspark Developer

The Digital S/W Engineer Sr Analyst role involves contributing to the developmen...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

5-8 years in a product development/product management environment
Strong analytical and quantitative skills
Data driven and results-oriented
Experience delivering with an agile methodology
Experience in affecting large culture change
Experience leading infrastructure programs
Skilled at working with third party service providers
Excellent written and oral communication skills
Bachelor’s/University degree or equivalent experience

Job Responsibility

Executing and driving mid-size feature application design and development efforts to completion
Serving as a development lead on medium-scale projects
Supporting the execution of larger efforts
Analyzing and troubleshooting coding, application performance and design challenges
Conducting research in root cause of development and performance concerns and resolving defects
Understanding engineering needs including those required to build, maintain, and operate the system through all phases of its life
Participating in design discussions as a Development Lead
Communicating progress, anticipating bottlenecks, providing escalation management, identifying, assessing, tracking, and mitigating issues/risks
Working across teams to optimize processes
Reviewing metrics and seeking improved mechanisms for visibility and alignment with objectives

Fulltime

Pyspark Developer

The Applications Development Intermediate Programmer Analyst is an intermediate ...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

5-8 years of relevant experience in the Financial Service industry
Intermediate level experience in Tableau and Python Applications Development role
Consistently demonstrates clear and concise written and verbal communication
Demonstrated problem-solving and decision-making skills
Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Bachelor’s degree/University degree or equivalent experience
5-8 years of experience in Python
3 year experience using PySpark
3 year experience in developing Kafka data pipelines

Job Responsibility

Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
Apply fundamental knowledge of programming languages for design specifications
Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
Serve as advisor or coach to new or lower level analysts
Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
Has the ability to operate with a limited level of direct supervision
Can exercise independence of judgement and autonomy
Acts as SME to senior stakeholders and /or other team members

Fulltime

Applications Development Senior Programmer Analyst

The Applications Development Senior Programmer Analyst is an intermediate level ...

Location

India , Pune; Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

8-13 years of experience on following areas
Strong in Python programming
Strong in Object oriented programming & Data Structures
Good knowledge of design patterns
Experience with Python frameworks - flask, Django
Strong technical skills for Big data Pyspark & Hadoop ecosystem components (HDFS, Hbase, Hive, Pig)
Strong experience in pyspark
Strong knowledge of REST web services
Spark Performance tuning and optimization techniques
Databases knowledge should extend to PL SQL, SQL and Transact-SQL. Oracle is a plus

Job Responsibility

Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
Apply fundamental knowledge of programming languages for design specifications.
Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
Serve as advisor or coach to new or lower level analysts
Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
Has the ability to operate with a limited level of direct supervision.
Can exercise independence of judgement and autonomy.
Acts as SME to senior stakeholders and /or other team members.

Fulltime

Senior Bigdata Engineer

The Applications Development Senior Programmer Analyst is an intermediate level ...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

8 - 10 years of relevant experience
Experience in systems analysis and programming of software applications
Experience in managing and implementing successful projects
Working knowledge of consulting/project management techniques/methods
Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Programming Languages: Python, PySpark
Data Lake Table Format: Apache Iceberg
Data Orchestration: Apache Airflow
Data Visualization: Tableau
Big Data Processing: Apache Spark

Job Responsibility

Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
Ensure essential procedures are followed and help define operating standards and processes
Serve as advisor or coach to new or lower level analysts
Has the ability to operate with a limited level of direct supervision
Can exercise independence of judgement and autonomy
Acts as SME to senior stakeholders and /or other team members

What we offer

Equal employment opportunity

Fulltime

Python Developer

The Applications Development Intermediate Programmer Analyst is an intermediate ...

Location

India , Pune; Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

5-8 years of experience on following areas
Strong in Python programming
Strong in Object oriented programming & Data Structures
Good knowledge of design patterns
Experience with Python frameworks - flask, Django
Strong technical skills for Big data Pyspark & Hadoop ecosystem components (HDFS, Hbase, Hive, Pig)
Strong experience in pyspark
Strong knowledge of REST web services
Spark Performance tuning and optimization techniques
Databases knowledge should extend to PL SQL, SQL and Transact-SQL. Oracle is a plus

Job Responsibility

Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
Apply fundamental knowledge of programming languages for design specifications
Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
Serve as advisor or coach to new or lower level analysts
Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
Has the ability to operate with a limited level of direct supervision
Can exercise independence of judgement and autonomy
Acts as SME to senior stakeholders and /or other team members

What we offer

Global Benefits
We bring the best to our people
We put our employees first and provide the best-in-class benefits they need to be well, live well and save well

Fulltime

Bigdata Consultant

The Technical Specialist will be responsible for Medicaid Enterprise Data Wareho...

Location

United States , Columbus

Salary:

Not provided

Ocean Blue Solutions

Expiration Date

Until further notice

Requirements

8+ years of experience with Big Data, Hadoop on Data Warehousing or Data Integration projects
Analysis, Design, development, support and Enhancements of ETL/ELT in data warehouse environment with Cloudera Bigdata Technologies (with a minimum of 7 or more years’ experience in Hadoop, MapReduce, Sqoop, PySpark, Spark, HDFS, Hive, Impala, StreamSets, Kudu, Oozie, Hue, Kafka, Yarn, Python, Flume, Zookeeper, Sentry, Cloudera Navigator) along with Oracle SQL/PL-SQL, Unix commands and shell scripting
Strong development experience (minimum of 7 or more years) in creating Sqoop scripts, PySpark programs, HDFS commands, HDFS file formats (Parquet, Avro, ORC etc.), StreamSets pipeline creation, jobs scheduling, hive/impala queries, Unix commands, scripting and shell scripting etc.
Writing Hadoop/Hive/Impala scripts (minimum of 7 or more years’ experience) for gathering stats on table post data loads
Strong SQL experience (Oracle and Hadoop (Hive/Impala etc.))
Writing complex SQL queries and performed tuning based on the Hadoop/Hive/Impala explain plan results
Proven ability to write high quality code
Experience building datasets and familiarity with PHI and PII data
Expertise implementing complex ETL/ELT logic
Develop and enforce strong reconciliation process

Job Responsibility

Participate in Team activities, Design discussions, Stand up meetings and planning Review with team
Perform data analysis, data profiling, data quality and data ingestion in various layers using big data/Hadoop/Hive/Impala queries, PySpark programs and UNIX shell scripts
Follow the organization coding standard document, Create mappings, sessions and workflows as per the mapping specification document
Perform Gap and impact analysis of ETL and IOP jobs for the new requirement and enhancements
Create jobs in Hadoop using SQOOP, PYSPARK and Stream Sets to meet the business user needs
Create mockup data, perform Unit testing and capture the result sets against the jobs developed in lower environment
Updating the production support Run book, Control M schedule document as per the production release
Create and update design documents, provide detail description about workflows after every production release
Continuously monitor the production data loads, fix the issues, update the tracker document with the issues, Identify the performance issues
Performance tuning long running ETL/ELT jobs by creating partitions, enabling full load and other standard approaches

Fulltime

Big Data Engineering Lead

The Senior Big Data engineering lead will play a pivotal role in designing, impl...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Bachelor's or Master’s degree in Computer Science, Information Technology, or related field
Atleast 10 -12 years overall software development experience on majorly working with handling application with large scale data volumes from ingestion, persistence and retrieval
Deep understanding of big data technologies, including Hadoop, Spark, Kafka, Flink, NoSQL databases, etc.
Experience with Bigdata technologies Developer Hadoop, Apache Spark, Python, PySpark
Strong programming skills in languages such as Java, Scala, or Python
Excellent problem-solving skills with a knack for innovative solutions
Strong communication and leadership abilities
Proven ability to manage multiple projects simultaneously and deliver results

Job Responsibility

Lead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and resilience
Design complex data transformation processes using Spark and other big data technologies using Java, Pyspark or Scala
Design and implement data pipelines that ensure data quality, integrity, and availability
Collaborate with cross-functional teams to understand business needs and translate them into technical requirements
Evaluate and select technologies that improve data efficiency, scalability, and performance
Oversee the deployment and management of big data tools and frameworks such as Hadoop, Spark, Kafka, and others
Provide technical guidance and mentorship to the development team and junior architects
Continuously assess and integrate emerging technologies and methodologies to enhance data processing capabilities
Optimize big data frameworks, such as Hadoop, Spark, for performance improvements and reduced processing time across distributed systems
Implement data governance frameworks to ensure data accuracy, consistency, and privacy across the organization, leveraging metadata management and data lineage tracking

Fulltime

Lead Bigdata Java Developer

The Applications Development Technology Lead Analyst is a senior level position ...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

A Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
A minimum of 12 years' experience in full stack development, with a focus on Bigdata and Java
Extensive experience in big data technologies such as Python, Pyspark, Hadoop, Kafka, etc
Proven leadership experience in managing large-scale data projects
A strong understanding of data governance principles and practices
Excellent problem-solving skills and the ability to innovate solutions
Strong communication and interpersonal skills, with the ability to work collaboratively
An ability to prioritize and manage multiple tasks effectively

Job Responsibility

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
Design, develop, and maintain scalable and robust architecture for the project using Java and other full stacktechnologies
Manage big data technologies such as python, pysparkto ensure seamless data integration, storage, and analysis

Fulltime

Bigdata Developer with PySpark

Citi

Location:
India , Pune

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
January 23, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Bigdata Developer with PySpark

Bigdata Java Spark And Pyspark Developer

Pyspark Developer

Applications Development Senior Programmer Analyst

Senior Bigdata Engineer

Python Developer

Bigdata Consultant

Big Data Engineering Lead

Lead Bigdata Java Developer

Bigdata Developer with PySpark

Citi

Location:India , Pune

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:January 23, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Bigdata Developer with PySpark

Bigdata Java Spark And Pyspark Developer

Pyspark Developer

Applications Development Senior Programmer Analyst

Senior Bigdata Engineer

Python Developer

Bigdata Consultant

Big Data Engineering Lead

Lead Bigdata Java Developer

Location:
India , Pune

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
January 23, 2026