CrawlJobs Logo

Senior Java PySpark Developer

realign-llc.com Logo

Realign

Location Icon

Location:
United States , Irving

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

160000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

We are seeking a seasoned Senior Lead Data Engineer with a dual-threat background in robust backend development and large-scale data processing. You are a self-starter who thrives in high-complexity environments and possesses the architecture maturity to take a project from a blank page to a production-ready ecosystem without hand-holding.

Job Responsibility:

  • Design, develop, and maintain robust, scalable, and high-performance applications using Java, PySpark/Python
  • Lead the architecture and design of complex software systems and ensure adherence to best practices
  • Collaborate with product managers, designers, and other developers to define project requirements and deliverables
  • Optimize and refactor existing codebases for performance, scalability, and maintainability
  • Mentor junior developers and provide technical guidance to the team
  • Integrate third-party APIs, libraries, and tools into applications
  • Write unit tests, perform code reviews, and ensure high code quality
  • Work with DevOps teams to deploy and monitor applications in production environments
  • Stay updated with the latest trends and advancements in Java and Python and related technologies

Requirements:

  • 8+ years of professional experience in Java, PySpark/Python development
  • Strong understanding of Python frameworks such as Django, Flask, or FastAPI
  • Expertise in building Java RESTful APIs and microservices architecture
  • Solid understanding of software design patterns, algorithms, and data structures
  • Hands-on experience with Big Data Environment
  • Familiarity with CI/CD pipelines and version control systems (e.g., Git)
  • Strong debugging and problem-solving skills
  • Excellent communication and collaboration skills

Nice to have:

  • Experience with Java and PySpark/Python development creating data processing pipeline and frameworks
  • Knowledge on CICD process to code versioning and deployments in various environment
  • Resource should have good knowledge on Big Data environments and distributed architecture
  • Knowledge on Snowflake is an added advantage

Additional Information:

Job Posted:
May 04, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Realign - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Java PySpark Developer

Full Stack Developer

Full Stack Developer role in Citi's Chief Technology Office (CTO) Technology Str...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, Software Engineering, or a related field
  • 8-10 years of professional experience in software development
  • Solid understanding of fundamental database concepts and practical experience with relational databases (e.g., MSSQL, Oracle) and/or NoSQL platforms (MongoDB)
  • Proficiency in Python, with experience in data manipulation and processing using frameworks like Apache Spark, PySpark
  • Hands-on experience with back-end technologies, such as Spring, Spring Boot, and Java 11+
  • Hands-on experience with front-end technologies, preferably React
  • Experience with Docker, Kubernetes, and container orchestration platforms
  • Comprehensive understanding of unit testing methodologies, test coverage principles, and experience in writing effective unit tests
  • Familiarity with foundational Generative AI model architectures (e.g., Transformers, GANs) and practical experience with deep learning libraries such as TensorFlow or PyTorch
Job Responsibility
Job Responsibility
  • Design, code, and optimize robust ETL data pipelines using technologies such as Python, PySpark, Apache Spark, Kafka, SQL to prepare large datasets for analysis
  • Participate in design, development, and deployment of full-stack applications utilizing Spring Boot and React frameworks
  • Implement scalable, resilient microservices deployed in Docker containers, orchestrated within an OpenShift environment
  • Work alongside senior developers to explore, fine-tune, and integrate pre-trained Generative AI models
  • Troubleshoot and resolve complex data-related issue and performance bottlenecks
  • Actively participate in agile ceremonies, including sprint planning, daily stand-ups, and sprint retrospectives
  • Fulltime
Read More
Arrow Right

Senior Big Data Pyspark Developer

We are looking for a skilled and motivated Full Stack Developer to join our engi...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-6 years of professional software development experience
  • Proficiency in Java (including modern Java features)
  • Strong experience with Node.js
  • Strong experience with Angular (versions 2+)
  • Strong experience with Spring Boot and Spring MVC for building web applications and microservices
  • Proven experience with Microservices architecture design and implementation
  • Strong experience with Hibernate
  • Solid command of Oracle Database, including SQL and PL/SQL
  • Experience with MongoDB for NoSQL data management
  • Experience with caching mechanisms and technologies like Hazelcast
Job Responsibility
Job Responsibility
  • Contribute to the design, development, and implementation of robust software solutions, ensuring performance, scalability, and security
  • Collaborate with product managers, architects, and senior developers to translate business requirements into technical specifications and develop innovative solutions
  • Develop and maintain back-end services using Java, Spring Boot, Spring MVC, Node.js, and Microservices architecture
  • Build responsive and intuitive user interfaces using Angular
  • Design and manage databases, working with both relational (Oracle) and NoSQL (MongoDB) data stores, leveraging Hibernate for ORM
  • Implement caching strategies using technologies like Hazelcast to improve application performance
  • Implement event-driven architectures and data streaming solutions using Kafka
  • Develop and consume GraphQL APIs, ensuring efficient data exchange between front-end and back-end systems
  • Adhere to best practices in software development, including participating in code reviews, testing, continuous integration, and continuous deployment (CI/CD)
  • Actively learn from and contribute to the team, sharing knowledge and helping to maintain high technical standards
  • Fulltime
Read More
Arrow Right

Senior Java PySpark Developer

Senior Java PySpark Developer – Assistant Vice President is an intermediate leve...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7 to 12 years of Application development experience through full lifecycle SME for UI architecture patterns - Micro Frontend, NX
  • Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns. Experience on Microservices, Spring boot
  • The candidate should be commendable in Data Structures and Algorithms. He should have worked on Core Application Development of complex size encompassing all areas of Java/J2EE
  • She/He must have thorough knowledge and hands on experience in PySpark and any of the following technologies - Hadoop, Map Reduce Framework, YARN, Unix, Java Spark, Impala, Cassandra on Mesos. Cloudera certification (CCDH) is an added advantage
  • She/He should have implemented or part complex project execution in Big Data Spark eco system, where processing volumes of data thorough understanding of distributed processing and integrated applications
  • Exposure to ETL and BI tools will be good
  • Work in an agile environment following through the best practices of agile Scrum
  • Expertise in designing and optimizing the software solutions for performance and stability
  • Expertise in troubleshooting and problem solving
  • Expertise in Test driven development
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower-level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Bigdata Developer with PySpark

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
  • Strong understanding of Core Java and Object-Oriented Programming (OOP) concepts
  • Proficiency in Python, specifically for PySpark development
  • Hands-on experience or familiarity with Apache Spark (PySpark), Hadoop, and related ecosystem components like Hive and Sqoop
  • Basic knowledge of SQL and relational databases
Job Responsibility
Job Responsibility
  • Develop and maintain data pipelines: Design, develop, and optimize scalable ETL (Extraction, Transformation, Loading) pipelines using PySpark to process large datasets
  • Coding and software engineering: Write clean, efficient, well-documented code primarily in Python (PySpark) and Java, often utilizing frameworks like Spring Boot
  • Collaboration and communication: Work with cross-functional teams, including senior developers, data engineers, analysts, and business partners, to understand data requirements and ensure seamless integration of solutions
  • Troubleshooting and optimization: Debug and resolve data processing issues and performance bottlenecks in Spark applications and other big data technologies
  • Full lifecycle involvement: Participate in the entire software development lifecycle (SDLC), from requirements analysis and design to testing, deployment, and operations, often using Agile/Scrum methodologies
  • Data integrity and quality: Ensure data quality and integrity throughout the data lifecycle
  • Fulltime
Read More
Arrow Right
New

Apps Dev Tech Lead Analyst - Vice President

As a key member of our global development team, you will: Innovate & Develop: Pa...
Location
Location
United States , Irving
Salary
Salary:
125760.00 - 188640.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6-10 years of progressive experience in systems analysis and programming of software applications
  • Strong proficiency in Java application technologies, including deep experience with TDD (Test-Driven Development), Spring framework, and Microservices architecture
  • Extensive hands-on experience with PySpark and advanced Python programming skills
  • Proven experience with Big Data ecosystems, including Cloudera and/or Data Bricks
  • Hands-on experience with distributed query engines like Starburst (Trino/Presto)
  • Proficient in designing and managing complex workflows using scheduling tools, particularly Apache Airflow
  • Strong expertise in SQL and experience with relational and non-relational databases
  • Excellent knowledge of algorithms and data structures, design patterns
  • Strong Java experience: Java core, collections, concurrency, streams
  • Frameworks and APIs: Spring (Core, Batch, Integration, MVC, Boot, Data), Hibernate, Jackson, JAX RS, JPA, JAXB
Job Responsibility
Job Responsibility
  • Innovate & Develop: Partner closely with project managers, business stakeholders, and senior managers to translate complex business requirements into well-architected technical solutions
  • Drive cross-functional collaboration with diverse management teams
  • Proactively identify, define, and implement necessary system enhancements
  • Complex Problem Resolution: Lead the resolution of high-impact problems and critical projects
  • Consult with users, clients, and other technology groups on issues
  • Technical Architecture & Standards Leadership: Serve as a subject matter expert in application programming
  • Leverage an advanced understanding of system flow to develop and enforce robust standards for coding, testing, debugging, and implementation
  • Mentorship & Talent Development: Act as a trusted advisor and coach for mid-level developers and analysts
  • Provide technical guidance, mentorship, and code reviews to junior data engineers
  • Operational Excellence: Ensure adherence to best practices and essential procedures
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
Read More
Arrow Right

Senior Java -Spark-Bigdata Engineer-Assistant Vice President

The Applications Development Senior Programmer Analyst is a senior-level positio...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-10 years of relevant experience in Data Engineering or a similar role, preferably within the Financial Services industry
  • Senior-level experience in an Applications Development or Data Engineering role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
  • Hands-on expertise in Java (8+), Spring Boot, Python, and PySpark for building high-performance data applications
  • Extensive experience with the BigData ecosystem, including Apache Spark for large-scale data processing
  • Solid understanding of Data Warehouse concepts, design principles, and best practices
  • Strong proficiency with both relational SQL databases and NoSQL databases (e.g., MongoDB, Couchbase)
Job Responsibility
Job Responsibility
  • Utilize expert knowledge of data engineering principles, big data technologies, and software development best practices to design and implement robust data solutions
  • Collaborate with business stakeholders, data scientists, and other technology teams to understand data requirements and deliver effective solutions
  • Apply deep expertise in programming languages like Python and Java for building high-performance data processing applications
  • Ensure data solutions are secure, scalable, and adhere to the firm's security and architectural standards
  • Mentor and guide junior engineers, fostering a culture of technical excellence and continuous learning
  • Lead the analysis of complex data-related issues, identify root causes, and implement sustainable solutions
  • Operate with a high degree of autonomy and independence, exercising sound judgment and decision-making
  • Act as a Subject Matter Expert (SME) in big data technologies for senior stakeholders and other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

Microsoft’s Azure Data engineering team is transforming analytics with products ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 10 years of software engineering experience building and shipping cloud-scale SaaS products
  • Strong programming skills in C#, Scala, Java, Python, or equivalent
  • Experience in SparkSQL , PySpark development
  • Demonstrated strength in establishing coding standards, conducting code reviews, and software design/architecture
  • Solid understanding of data engineering concepts and big data platforms, with eagerness to work deeply with Microsoft Fabric
  • Experience with Azure-based cloud services and distributed systems
  • Ability to debug complex distributed systems on Linux and/or Windows
  • Security Screening Requirements: Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Designing and building high-performance, scalable services for Microsoft Fabric
  • Developing new features and continuously improving our cloud-based SaaS platform, prioritizing efficiency, reliability, security, and operational excellence
  • Using AI-assisted development (e.g., LLM-based tools/agents) to accelerate design, implementation, testing, and code quality
  • Enhancing open-source components to meet enterprise requirements for performance, reliability, security, and supportability
  • Collaborating with cross-functional teams to integrate Fabric app capabilities with other Microsoft Fabric services
  • Serving as the Designated Responsible Individual (DRI)—the person on point for monitoring, incident response, diagnosing service degradation/downtime, and driving mitigations to restore and improve reliability
  • Leading continuous improvements to engineering processes, tools, and developer productivity
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Full Stack Developer

The Senior Full Stack Developer role at NTT DATA requires expertise in Core Java...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A degree in information science, business informatics, physics, mathematics, economics or similar with 0- 6 months of training or certification
  • Knowhow with ETL & databases, particularly in the Big Data & Data Warehousing environment
  • Programming knowledge in Python (especially Pandas, NumPy, Scikit-learn, Keras) or R, (SQL, Bash is a plus)
  • Familiarity in working with analysis and visualization tools
  • alternatively according Python or R libraries (Bokeh, Matplotlib, ggplot, Plotly)
  • Ideally you have worked with at least one of these technologies Dataiku, Jupyter, Axway, Databricks, APIs, Git, SAP ERP & SAP BW
  • Having knowledge in DevOps, Frontend, Coding Standards, Testing and Profiling is a plus
  • Knowledge of MS Azure with Fabric tools like ADF, One Lake, PySpark notebooks is essential
Read More
Arrow Right