CrawlJobs Logo

Senior Java PySpark Developer

India, Pune · Job Posted April 23, 2026
Apply Position
Job Link Share

Job Description

Senior Java PySpark Developer – Assistant Vice President is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Job Responsibility

  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower-level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

Requirements

  • 7 to 12 years of Application development experience through full lifecycle SME for UI architecture patterns - Micro Frontend, NX
  • Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns. Experience on Microservices, Spring boot
  • The candidate should be commendable in Data Structures and Algorithms. He should have worked on Core Application Development of complex size encompassing all areas of Java/J2EE
  • She/He must have thorough knowledge and hands on experience in PySpark and any of the following technologies - Hadoop, Map Reduce Framework, YARN, Unix, Java Spark, Impala, Cassandra on Mesos. Cloudera certification (CCDH) is an added advantage
  • She/He should have implemented or part complex project execution in Big Data Spark eco system, where processing volumes of data thorough understanding of distributed processing and integrated applications
  • Exposure to ETL and BI tools will be good
  • Work in an agile environment following through the best practices of agile Scrum
  • Expertise in designing and optimizing the software solutions for performance and stability
  • Expertise in troubleshooting and problem solving
  • Expertise in Test driven development
  • Bachelor’s degree/University degree or equivalent experience

Nice to have

  • Cloudera certification (CCDH)
  • Exposure to ETL and BI tools

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Java PySpark Developer

8 matching positions

Senior Java PySpark Developer

We are seeking a seasoned Senior Lead Data Engineer with a dual-threat backgroun...
Location
Location
United States , Irving
Salary
Salary:
160000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional experience in Java, PySpark/Python development
  • Strong understanding of Python frameworks such as Django, Flask, or FastAPI
  • Expertise in building Java RESTful APIs and microservices architecture
  • Solid understanding of software design patterns, algorithms, and data structures
  • Hands-on experience with Big Data Environment
  • Familiarity with CI/CD pipelines and version control systems (e.g., Git)
  • Strong debugging and problem-solving skills
  • Excellent communication and collaboration skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust, scalable, and high-performance applications using Java, PySpark/Python
  • Lead the architecture and design of complex software systems and ensure adherence to best practices
  • Collaborate with product managers, designers, and other developers to define project requirements and deliverables
  • Optimize and refactor existing codebases for performance, scalability, and maintainability
  • Mentor junior developers and provide technical guidance to the team
  • Integrate third-party APIs, libraries, and tools into applications
  • Write unit tests, perform code reviews, and ensure high code quality
  • Work with DevOps teams to deploy and monitor applications in production environments
  • Stay updated with the latest trends and advancements in Java and Python and related technologies
  • Fulltime
Read More
Arrow Right

Senior Big Data Pyspark Developer

We are looking for a skilled and motivated Full Stack Developer to join our engi...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-6 years of professional software development experience
  • Proficiency in Java (including modern Java features)
  • Strong experience with Node.js
  • Strong experience with Angular (versions 2+)
  • Strong experience with Spring Boot and Spring MVC for building web applications and microservices
  • Proven experience with Microservices architecture design and implementation
  • Strong experience with Hibernate
  • Solid command of Oracle Database, including SQL and PL/SQL
  • Experience with MongoDB for NoSQL data management
  • Experience with caching mechanisms and technologies like Hazelcast
Job Responsibility
Job Responsibility
  • Contribute to the design, development, and implementation of robust software solutions, ensuring performance, scalability, and security
  • Collaborate with product managers, architects, and senior developers to translate business requirements into technical specifications and develop innovative solutions
  • Develop and maintain back-end services using Java, Spring Boot, Spring MVC, Node.js, and Microservices architecture
  • Build responsive and intuitive user interfaces using Angular
  • Design and manage databases, working with both relational (Oracle) and NoSQL (MongoDB) data stores, leveraging Hibernate for ORM
  • Implement caching strategies using technologies like Hazelcast to improve application performance
  • Implement event-driven architectures and data streaming solutions using Kafka
  • Develop and consume GraphQL APIs, ensuring efficient data exchange between front-end and back-end systems
  • Adhere to best practices in software development, including participating in code reviews, testing, continuous integration, and continuous deployment (CI/CD)
  • Actively learn from and contribute to the team, sharing knowledge and helping to maintain high technical standards
  • Fulltime
Read More
Arrow Right

Senior Java -Spark-Bigdata Engineer-Assistant Vice President

The Applications Development Senior Programmer Analyst is a senior-level positio...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-10 years of relevant experience in Data Engineering or a similar role, preferably within the Financial Services industry
  • Senior-level experience in an Applications Development or Data Engineering role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
  • Hands-on expertise in Java (8+), Spring Boot, Python, and PySpark for building high-performance data applications
  • Extensive experience with the BigData ecosystem, including Apache Spark for large-scale data processing
  • Solid understanding of Data Warehouse concepts, design principles, and best practices
  • Strong proficiency with both relational SQL databases and NoSQL databases (e.g., MongoDB, Couchbase)
Job Responsibility
Job Responsibility
  • Utilize expert knowledge of data engineering principles, big data technologies, and software development best practices to design and implement robust data solutions
  • Collaborate with business stakeholders, data scientists, and other technology teams to understand data requirements and deliver effective solutions
  • Apply deep expertise in programming languages like Python and Java for building high-performance data processing applications
  • Ensure data solutions are secure, scalable, and adhere to the firm's security and architectural standards
  • Mentor and guide junior engineers, fostering a culture of technical excellence and continuous learning
  • Lead the analysis of complex data-related issues, identify root causes, and implement sustainable solutions
  • Operate with a high degree of autonomy and independence, exercising sound judgment and decision-making
  • Act as a Subject Matter Expert (SME) in big data technologies for senior stakeholders and other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Java Spark Developer

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Chennai; Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5 to 7 years of Application development experience through full lifecycle
  • Commendable in Data Structures and Algorithms
  • Core Application Development of complex size encompassing all areas of Java/J2EE
  • Thorough knowledge and hands on experience in PySpark and any of the following technologies - Hadoop, Map Reduce Framework, YARN, Unix, Java Spark, Impala, Cassandra on Mesos
  • Implemented or part complex project execution in Big Data Spark eco system, where processing volumes of data thorough understanding of distributed processing and integrated applications
  • Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns
  • Exposure to ETL and BI tools recommended
  • Work in an agile environment following through the best practices of agile Scrum
  • Expertise in designing and optimizing the software solutions for performance and stability
  • Expertise in troubleshooting and problem solving
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower-level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Senior Data Developer (Azure)

We are looking for a highly skilled and experienced Senior Azure Data Developer ...
Location
Location
Egypt , Cairo
Salary
Salary:
Not provided
coca-colahellenic.com Logo
Coca-Cola HBC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master’s degree in computer science, information technology, data science, or a related field (or an equivalent of 7+ years of practical experience in a tech-domain)
  • Hands-on experience with MS Power BI, MS PowerApps, MS Azure Data Factory, MS Azure Data Lake Store, SQL Database (T-SQL), DAX & Power Query M (3+ years)
  • Proven track record of implementing proof-of-concept (POC) backend solutions
  • Expert knowledge with cloud platforms (Azure, Google Cloud Storage, Amazon), preferably Microsoft Azure – with a focus on data warehousing & backend development
  • Strong programming skills in languages such as C#, .NET, Python, Scala or Java
  • Experience with big data architectures and large data volumes technologies (partitioned tables with billions of records, files with hundreds of GBs)
  • Familiarity with big data technologies such as Hadoop, Spark, and Hive as well as strong knowledge with data manipulation frameworks such a PySpark
  • Strong analytical & problem-solving abilities, as well as good communication skills
  • Strong willingness to learn and adapt to new technologies and tools
  • Good proficiency in English as a day-to-day business language is a must.
Job Responsibility
Job Responsibility
  • Assist in the design, development, and maintenance of ETL (Extract, Transform, Load) processes using Azure Data Factory
  • Implement data ingestion processes from various data sources into Azure data storage solutions
  • Work with Azure SQL Database, Azure Data Lake Storage, and Hive & Databricks to store and manage large datasets (Terabytes of data)
  • Ensure data integrity and availability by implementing appropriate storage solutions
  • Integrate data from various sources, ensuring accuracy, completeness, and consistency
  • Collaborate with data scientists and analysts to understand data requirements and provide necessary support
  • Contribute to the strategy, design and development of our Enterprise and Operational Reporting, providing insights and supporting decision making for end users
  • Integrate & transform data from various data systems into structures that are suitable for building analytical solutions
  • Design, develop and implement Azure-based solutions connecting certified and validated data sources to Power BI front-end visualizations and creating a single source of truth for reporting
What we offer
What we offer
  • Development opportunities
  • Equal opportunity employer
  • IT Equipment
  • Learning programs
  • Work with iconic brands
  • Supportive team
  • Volunteering Opportunities
  • Wellbeing program
Read More
Arrow Right

Bigdata Developer with PySpark

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
  • Strong understanding of Core Java and Object-Oriented Programming (OOP) concepts
  • Proficiency in Python, specifically for PySpark development
  • Hands-on experience or familiarity with Apache Spark (PySpark), Hadoop, and related ecosystem components like Hive and Sqoop
  • Basic knowledge of SQL and relational databases
Job Responsibility
Job Responsibility
  • Develop and maintain data pipelines: Design, develop, and optimize scalable ETL (Extraction, Transformation, Loading) pipelines using PySpark to process large datasets
  • Coding and software engineering: Write clean, efficient, well-documented code primarily in Python (PySpark) and Java, often utilizing frameworks like Spring Boot
  • Collaboration and communication: Work with cross-functional teams, including senior developers, data engineers, analysts, and business partners, to understand data requirements and ensure seamless integration of solutions
  • Troubleshooting and optimization: Debug and resolve data processing issues and performance bottlenecks in Spark applications and other big data technologies
  • Full lifecycle involvement: Participate in the entire software development lifecycle (SDLC), from requirements analysis and design to testing, deployment, and operations, often using Agile/Scrum methodologies
  • Data integrity and quality: Ensure data quality and integrity throughout the data lifecycle
  • Fulltime
Read More
Arrow Right

Senior Full Stack Developer

The Senior Full Stack Developer role at NTT DATA requires expertise in Core Java...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A degree in information science, business informatics, physics, mathematics, economics or similar with 0- 6 months of training or certification
  • Knowhow with ETL & databases, particularly in the Big Data & Data Warehousing environment
  • Programming knowledge in Python (especially Pandas, NumPy, Scikit-learn, Keras) or R, (SQL, Bash is a plus)
  • Familiarity in working with analysis and visualization tools
  • alternatively according Python or R libraries (Bokeh, Matplotlib, ggplot, Plotly)
  • Ideally you have worked with at least one of these technologies Dataiku, Jupyter, Axway, Databricks, APIs, Git, SAP ERP & SAP BW
  • Having knowledge in DevOps, Frontend, Coding Standards, Testing and Profiling is a plus
  • Knowledge of MS Azure with Fabric tools like ADF, One Lake, PySpark notebooks is essential
Read More
Arrow Right

Senior Data Analyst

Under general supervision, provide analysis, insight, and recommendations by syn...
Location
Location
India , Pune; Coimbatore
Salary
Salary:
Not provided
avantorsciences.com Logo
Avantor
Expiration Date
June 30, 2026
Flip Icon
Requirements
Requirements
  • Collect, clean, and analyze large datasets to generate insights and recommendations
  • Perform Data analysis and provide decision points based on the same
  • Develop and implement data transformation components to solve business problems
  • Maintain DT pipeline and fix production issues in stipulated time
  • Work on Data visualization dashboard and maintain the same
  • Create utilities which can be re-usable for data processing, feature engineering, etc.
  • Conduct hypothesis testing and statistical analyses to understand data trends
  • Work with Data Scientist/Data Analyst – perform technical reviews, provide technical support
  • Communicate findings to non-technical stakeholders through reports and visualizations
  • Collaborate with engineers, product teams, and business stakeholders to translate business goals into data-driven solutions
Job Responsibility
Job Responsibility
  • Provide analysis, insight, and recommendations by synthesizing information for various product categories and geographies by using competitive analyses, analytical modeling, and leveraging knowledge of the product portfolio and customer programs
  • Manage pricing process for the sales team including assessing, approving, and loading all pricing requests
  • Review, research, and analyze pricing to make recommendations on price enhancements, SKU rationalization and margin opportunities
  • Process quotation requests for stock standard items and special order (customer specific) items
  • Fulltime
Read More
Arrow Right