CrawlJobs Logo

Senior Software Engineer - Core Java & Apache Spark

India, Chennai, Pune · Job Posted May 17, 2026
Apply Position
Job Link Share

Job Description

We are hiring an elite Senior Software Engineer to build and scale our core data processing and application infrastructure. This role demands deep, hands-on expertise in the Java ecosystem and distributed computing with Apache Spark. You will be responsible for the architecture, design, and implementation of mission-critical systems that process massive datasets, requiring a mastery of concurrency, JVM internals, and modern cloud-native patterns.

Job Responsibility

  • Architect & Build: Design and construct high-throughput, low-latency data processing pipelines using Apache Spark and the Spring ecosystem
  • Performance Engineering: Dive deep into JVM internals, garbage collection tuning, and Spark job optimization to maximize performance and resource efficiency
  • Distributed Systems Design: Implement scalable, resilient, and transactional architectures leveraging container orchestration (Kubernetes/OpenShift) and distributed data stores
  • Code & Design Excellence: Champion and enforce best practices in software engineering, including SOLID principles, advanced design patterns, Domain-Driven Design (DDD), and Test-Driven Development (TDD)
  • Database Mastery: Engineer and optimize data models for both relational and NoSQL databases, ensuring data integrity, performance, and scalability
  • CI/CD Automation: Own and enhance CI/CD pipelines for automated build, test, and deployment of Java applications and Spark jobs in a containerized environment
  • Technical Leadership: Lead design and code reviews, mentor junior engineers, and drive the adoption of new technologies and architectural patterns across the team

Requirements

  • Core Java & JVM: Expert-level proficiency in Java, including the Collections Framework, Lambdas, and the Java Concurrency API. Demonstrable experience tuning the JVM and troubleshooting memory/GC issues
  • Apache Spark: Proven, hands-on experience developing, deploying, and tuning complex Spark applications for large-scale data transformation and analysis
  • Spring Ecosystem: Extensive, practical experience with the Spring Framework, particularly Spring Boot, Spring Data, and Spring Batch in a production environment
  • Data Structures & Algorithms: Deep understanding of fundamental data structures and algorithms, with a focus on their application in distributed computing and performance-critical systems
  • Containerization & Cloud-Native: Hands-on experience with Docker for building images and Kubernetes/OpenShift for deploying and managing distributed applications
  • Database Engineering: Strong command of SQL and relational database design, including transaction management and indexing. Experience with at least one production NoSQL database (MongoDB, Graph DB, etc.)
  • Architectural Design: Practical application of OOP, SOLID, and DDD principles to build maintainable and scalable systems. You write tests first (TDD) and believe in robust, automated testing

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer - Core Java & Apache Spark

8 matching positions

OSS Assurance Software Developer (R&D)/ Senior Systems/Software Engineer - Java

Join our R&D team in Bengaluru to build and innovate next-generation OSS Assuran...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Telecommunications Engineering, or a related technical field
  • 5+ years of hands-on software development experience in the telecom OSS/BSS domain or highly concurrent, real-time enterprise software
  • Strong proficiency in Java, Go, or Python
  • Experience with distributed streaming platforms (e.g., Kafka or similar)
  • Familiarity with database technologies: NoSQL (Cassandra, MongoDB) and relational (PostgreSQL, MySQL)
  • Working knowledge of cloud-native environments (Docker, Kubernetes)
  • OS: RedHat Linux, CentOS Linux, Windows
  • Cloud infrastructure: K8s Vanilla, AWS, Redhat Openshift, Docker
  • Cloud deployment: Helm
  • Database: Cassandra, Kairos DB, CouchDB
Job Responsibility
Job Responsibility
  • Design, write, and maintain clean, scalable, and efficient code (primarily in Java, Go, or Python) for core Fault and Performance Management modules
  • Build microservices and RESTful APIs to integrate assurance platforms with networks, and physical network elements
  • Develop high-throughput data processing pipelines using tools like Apache Kafka, Apache Flink, or Apache Spark to process massive volumes of network telemetry
  • Prototype new features leveraging AI/ML (e.g., automated root cause analysis, predictive fault analytics) to transition networks from reactive to proactive assurance
  • Containerize applications using Docker and deploy them on Kubernetes-based telecom cloud environments
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Python) – Fixed Income

Citi, a leading global bank, is seeking a talented and passionate Python Develop...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3-5 years of experience developing and deploying production-ready Python applications
  • Strong experience with core Python, SQL, and database APIs
  • Experience with Python frameworks (e.g., Django or Flask) is a plus
  • Familiarity with data processing concepts and related technologies (e.g., Kafka, Apache Spark) is beneficial
  • Experience using Java is preferred
  • Excellent communication and collaboration skills
  • Strong problem-solving and analytical skills
  • Solid understanding of Object-Oriented Programming (OOP) concepts, multithreading, and thread pools
  • Familiarity with containerization technologies like Docker and deployment platforms like Kubernetes, OpenShift, or ECS
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust and scalable applications primarily using Python
  • Implement efficient and optimized code for various business needs
  • Integrate Python applications with various data sources, APIs, and other systems
  • Contribute to the design and development of application architectures
  • Write clean, well-documented, and testable code
  • Collaborate effectively with other engineers, product managers, and stakeholders throughout the software development lifecycle (SDLC), adhering to Agile methodologies
  • Stay up-to-date with the latest trends and technologies in Python development
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

Security represents the most critical priorities for our customers in a world aw...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 5+ years of experience working with distributed data processing frameworks such as Apache Spark, Databricks, or similar technologies to transform and manage large-scale datasets
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, develop, test, deploy, and maintain core services and platform components that enable Data Security Posture Management (DSPM) scenarios across Microsoft Purview
  • Implement scalable, reliable, and secure backend systems, including data ingestion, processing, and enrichment pipelines operating at cloud scale
  • Contribute to technical design and architecture discussions, applying engineering best practices to ensure performance, resiliency, privacy, and compliance requirements are met
  • Collaborate with product managers, partner engineering teams, and dependent services to translate customer and business requirements into high‑quality technical solutions
  • Drive operational excellence through ownership of code quality, monitoring, on‑call participation, and continuous improvement, while mentoring and supporting other engineers on the team
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Distributed Systems

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
Canada , Vancouver
Salary
Salary:
114400.00 - 203900.00 CAD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • 3+ years experience with distributed messaging systems such as Azure Service Bus, Apache Kafka, RabbitMQ, Google Pub/Sub, or SQS/Kinesis or experience with stream processing or real-time data platforms such as Apache Spark, Flink, Storm, or similar frameworks
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Drive the design and implementation of complex, large-scale distributed systems by producing technical designs, proof-of-concepts, and prototype solutions from ambiguous or high-level requirements
  • Own end-to-end delivery of key system components, including design tradeoffs, implementation, testing strategy, deployment, and long-term operability
  • Continuously improve system performance, scalability, and resilience by identifying architectural gaps, leading refactoring efforts, and addressing systemic technical debt
  • Define and apply metrics, best practices, and quality bars to ensure long-term service stability, operational excellence, and strong return on engineering investment
  • Lead code reviews and design discussions, setting technical direction and mentoring engineers to improve overall code quality and system design maturity
  • Collaborate across teams and organizations to align designs, influence dependencies, and deliver solutions that scale across Azure
  • Build and evolve the core messaging infrastructure that underpins hundreds of thousands of Azure applications, supporting critical platform capabilities such as eventing, asynchronous workflows, telemetry, and diagnostics.
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - CoreAI Model Inference & Serving

Join our team within CoreAI, where we are building the AI data-plane that powers...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Java
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • 4+ years of design and problem-solving experience, with understanding of system performance, scalability, and engineering best practices
  • Understanding of distributed systems specifically in request serving at scale
  • (e.g. inferencing, L7 gateways, high-performance storage, distributed databases across global-scale infrastructure)
  • Demonstrated experience in building high-quality, reliable systems at scale
  • Experience using modern AI-assisted development tools and workflows to move faster, improve quality, and amplify engineering impact
  • Customer-obsessed approach to problem solving, with empathy and a drive to deliver impactful solutions
Job Responsibility
Job Responsibility
  • Be a hands-on technical leader, designing, coding, and shipping core serving systems, smart routing, and request distribution for a broad portfolio of LLMs
  • Build large-scale AI services and platform capabilities that power new products and customer experiences
  • Drive cutting-edge innovation in AI systems alongside world-class engineers and cross-functional partners
  • Lead through architecture, code reviews, mentorship, and technical excellence while staying close to implementation
  • Improve reliability, scalability, observability, efficiency, and performance across mission-critical services
  • Fulltime
Read More
Arrow Right

Senior Lead Developer (Java, Spark, HDFS, Hive) - Vice President

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of relevant experience in Apps Development or systems analysis role
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication
  • Highly experienced and skilled Java technical lead with 10+years of experience with software building and platform engineering
  • Extensive development expertise in building the high scaled and performant software platforms for data computation and processing
  • Expert level knowledge of core Java concepts and framework such as Spring Boot, Microservices and well versed with OOPs concepts and design patterns
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Senior Java Big Data Technical Engineer

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of relevant experience in Apps Development or systems analysis role
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication
  • Highly experienced and skilled Java & Big Data Engineer technical lead with 10+years of experience with software building and platform engineering
  • Extensive knowledge of HDFS, Hive(Relevant experience of 8+ years)
  • Hands-on development expertise in Java with Spark
Job Responsibility
Job Responsibility
  • Contribute significantly to both engineering and research initiatives within the EAP domain
  • Adopt a product-focused approach, ensuring the development of robust, scalable, and user-friendly solutions
  • Thrive in a fast-paced environment by continuously testing, learning, and tackling cutting-edge problems
  • Develop, Lead and inspire a team of developers working on cutting-edge applications
  • Manage one or more Applications Development teams in an effort to accomplish established goals as well as conduct personnel duties for team (e.g. performance evaluations, hiring and disciplinary actions)
  • Utilize in-depth knowledge and skills across multiple Applications Development areas to provide technical oversight across systems and applications
  • Review and analyze proposed technical solutions for projects
  • Contribute to formulation of strategies for applications development and other functional areas
  • Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
  • Provide evaluative judgment based on analysis of factual data in complicated and unique situations
  • Fulltime
Read More
Arrow Right

Application Developer - Java Spark Big Data - Assistant Vice President

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of relevant experience using Core Java, Spark, Big Data Technologies HDFC, Hive etc
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Extensive development expertise in building the high scaled and performant software platforms for data computation and processing
  • Experience in software development with a strong focus on Core Java and Spark
  • Expert level knowledge of core Java concepts and framework such as Spring Boot, Microservices and well versed with OOPs concepts and design patterns
  • Hands-on experience with Apache Spark (with Java)
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right