CrawlJobs Logo

Technical Lead, Spark (Java)

· Job Posted February 17, 2026
Apply Position
Job Link Share

Job Description

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises. The Data Platform Pillar is the bedrock of Cloudera’s technology, where we design and build the core components that let our customers store, manage, and process data with unmatched scalability, security, and performance. Cloudera is seeking a Technical Lead, Spark (Java) with strong distributed systems expertise to work on the Cloudera distribution of Apache Spark and Livy. The role involves building enterprise-grade systems for customers running Spark on thousands of nodes and processing petabytes of data. We are looking for a passionate engineer eager to enhance a product already supporting major production systems and to drive the next-generation Data Engineering experience. You will collaborate with a distributed team across the United States and Hungary, including multiple Apache Spark committers.

Job Responsibility

  • Design new features for Cloudera’s data engineering experience, and take them from prototypes to leading a team to deliver the feature in production at scale
  • Contribute to Apache Spark, Livy
  • Develop new features in Scala/Java/Python on modern platforms
  • Gain expertise in distributed data processing, from SQL planners and optimizers, to data layout and table formats like Apache Parquet and Iceberg, to fault tolerance in distributed systems
  • Gain a solid understanding and deep technical knowledge of components across the Cloudera Data Engineering Experience stack, but focusing on Iceberg and Spark, which you can utilize in your daily tasks
  • Get to work on large-scale distributed systems, from 100s to 1000s of nodes, in production clusters
  • Debug system-level deployment issues, root cause analysis, perform system test analysis, and resolve failures
  • Work on improving internal infrastructure
  • Collaborate with other team members and stakeholders

Requirements

  • 8-10+ years of professional software development
  • Experience leading and delivering complex product enhancements
  • Strong understanding of at least one of the following languages: Java, Scala, Python
  • Experience with systems design, development
  • Passionate about programming, clean coding habits, attention to detail, and focus on quality
  • Strong oral and written communication skills
  • Strong ability to research and solve problems independently without constant supervision
  • Open-minded, desire to learn new things and build great products
  • Experience with distributed systems

Nice to have

  • Experience with SQL planners
  • Experience with using/developing Apache Spark, Livy or other related technologies
  • Experience with large-scale, distributed systems design and development with an understanding of scaling, performance, and scheduling
  • Solid experience with at least one clouds
  • Contributors to open-source projects

What we offer

  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Technical Lead, Spark (Java)

8 matching positions

Technical Lead, Spark (Java)

At Cloudera, we empower people to transform complex data into clear and actionab...
Location
Location
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-10+ years of professional software development
  • Experience leading and delivering complex product enhancements
  • Strong understanding of at least one of the following languages: Java, Scala, Python
  • Experience with systems design, development
  • Passionate about programming, clean coding habits, attention to detail, and focus on quality
  • Strong oral and written communication skills
  • Strong ability to research and solve problems independently without constant supervision
  • Open-minded, desire to learn new things and build great products
  • Experience with distributed systems
Job Responsibility
Job Responsibility
  • Design new features for Cloudera’s data engineering experience, and take them from prototypes to leading a team to deliver the feature in production at scale
  • Contribute to Apache Spark, Livy
  • Develop new features in Scala/Java/Python on modern platforms
  • Gain expertise in distributed data processing, from SQL planners and optimizers, to data layout and table formats like Apache Parquet and Iceberg, to fault tolerance in distributed systems
  • Gain a solid understanding and deep technical knowledge of components across the Cloudera Data Engineering Experience stack, but focusing on Iceberg and Spark
  • Get to work on large-scale distributed systems, from 100s to 1000s of nodes, in production clusters
  • Debug system-level deployment issues, root cause analysis, perform system test analysis, and resolve failures
  • Work on improving internal infrastructure
  • Collaborate with other team members and stakeholders
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Lead Java Spark Developer

The Applications Development Manager is an intermediate management level positio...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8 to 11 years of strong experience in Java/J2EE, Spring, Hibernate with expertise in design, development, performance tuning, troubleshooting and deployment
  • Working Experience in Java-Spark & Big Data
  • Strong knowledge of Microservices and eco-system
  • Working knowledge of Containerization using Docker/Kubernetes
  • Good understanding of tomcat, and Linux or Unix operating systems
  • Should be well versed with designing and architecting solutions with latest tech advancements
  • Familiar with standard SDLC and Agile processes
  • Hands on working experience and ability to motivate and lead the team
  • Experience with latest technology in areas of Distributed Computing and Big Data ecosystem(Spark, Hadoop etc.)
  • Solid understanding of SOA concepts, RESTful API design
Job Responsibility
Job Responsibility
  • Works as Java Team lead for suite of applications under Market Risk reporting platform
  • Should own the responsibility of the Module in Market Risk and synergies with team to deliver
  • Should be able to lead a team to deliver complex system designs
  • Understand requirements and code and unit test required components
  • Support acceptance tests and production test
  • Report progress on work and work collaboratively with the existing global team
  • Keep abreast of latest technological happenings in his work area and bring relevant ideas/concept to the table
  • Fulltime
Read More
Arrow Right

Lead Java Spark Developer

The Applications Development Manager is an intermediate management level positio...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8 to 11 years of strong experience in Java/J2EE, Spring, Hibernate with expertise in design, development, performance tuning, troubleshooting and deployment
  • Working Experience in Java-Spark & Big Data
  • Strong knowledge of Microservices and eco-system
  • Working knowledge of Containerization using Docker/Kubernetes
  • Good understanding of tomcat, and Linux or Unix operating systems
  • Should be well versed with designing and architecting solutions with latest tech advancements
  • Familiar with standard SDLC and Agile processes
  • Hands on working experience and ability to motivate and lead the team
  • Experience with latest technology in areas of Distributed Computing and Big Data ecosystem(Spark, Hadoop etc.)
  • Solid understanding of SOA concepts, RESTful API design
Job Responsibility
Job Responsibility
  • Works as Java Team lead for suite of applications under Market Risk reporting platform
  • Should own the responsibility of the Module in Market Risk and synergies with team to deliver
  • Should be able to lead a team to deliver complex system designs
  • Understand requirements and code and unit test required components
  • Support acceptance tests and production test
  • Report progress on work and work collaboratively with the existing global team
  • Keep abreast of latest technological happenings in his work area and bring relevant ideas/concept to the table
  • Fulltime
Read More
Arrow Right

Senior Lead Developer (Java, Spark, HDFS, Hive) - Vice President

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of relevant experience in Apps Development or systems analysis role
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication
  • Highly experienced and skilled Java technical lead with 10+years of experience with software building and platform engineering
  • Extensive development expertise in building the high scaled and performant software platforms for data computation and processing
  • Expert level knowledge of core Java concepts and framework such as Spring Boot, Microservices and well versed with OOPs concepts and design patterns
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Lead Java Big Data Engineer Vice President

At Citi, we are at the forefront of financial technology, driven by a belief in ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of progressive experience in professional software engineering, with at least 3 years in a technical leadership or architect role
  • Proven track record of designing and building complex, high-performance, scalable server-side applications using Java
  • Deep, hands-on experience with the Big Data ecosystem, including mastery of Apache Spark, Hadoop (HDFS), and real-time data streaming with Kafka
  • Extensive experience with relational databases, data modeling, and data warehousing concepts
  • Demonstrated experience leading and mentoring technical teams and successfully delivering complex, large-scale data projects from concept to production
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
Job Responsibility
Job Responsibility
  • Define the end-to-end architectural vision and technical roadmap for migrating from Sybase IQ to a modern Big Data platform, ensuring solutions are scalable, resilient, and secure
  • Lead the design, development, and deployment of robust, large-scale data processing pipelines using technologies like Apache Spark, Kafka, and distributed data stores
  • Develop and execute a comprehensive, phased strategy for migrating petabytes of historical and transactional data from Sybase IQ, ensuring data integrity, minimal downtime, and zero business disruption
  • Oversee the design and development of Java-based microservices that interact with the new data platform, ensuring seamless integration with the broader Oasys application ecosystem
  • Lead, inspire, and mentor a high-performing team of Java and Big Data engineers. Foster a culture of engineering excellence, innovation, and accountability
  • Partner with global business leaders, product owners, and other senior technology managers to define requirements, manage expectations, and deliver solutions that drive significant business value
  • Remain deeply technical and contribute to coding, design, and architectural decisions, leading by example
  • Fulltime
Read More
Arrow Right

Technical Lead - Fixed Income Data Services

This role is for an Application Development Technical lead within the FI Data te...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of demonstrable and relevant experience in software development, with at least 3-5 years in a leadership role within a high-performing technical team
  • Strong understanding of Java, with the ability to guide and review complex solutions
  • Solid understanding of REST API development, including best practices for design, security, and scalability
  • Demonstrable experience in driving the creation of reusable, testable, and efficient code with proper error and exception handling, and establishing coding standards
  • Extensive experience with the design and implementation of cloud-native applications and deployment via Kubernetes / Openshift, including strategic decision-making on cloud architecture
  • Expertise in big data computation platforms (Flink, Spark, Apache Beam) or big data distribution platforms (Hadoop, Druid, Pinot, Trino, Ignite), and a track record of leading teams leveraging these technologies
  • Hands-on experience in handling various data structures, and the ability to guide complex data modeling decisions
  • Proven leadership in establishing and maturing Continuous Integration and Continuous Delivery environments. Familiarity with TeamCity, Sonarqube, and Jenkins
  • Extensive experience with the SDLC lifecycle and in leading and coaching within an Agile environment (Scrum/Kanban)
  • Demonstrable leadership in promoting and enforcing engineering best practices: design patterns, coding standards, rigorous code review processes, and comprehensive unit testing strategies (e.g., Mockito, Junit, Pytest)
Job Responsibility
Job Responsibility
  • Lead and oversee the design and development of high-performance green-field data analytics products for a Tier 1 bank, ensuring architectural excellence and alignment with business goals
  • Collaborate strategically with other dev leads in US and Canada, translating complex business requirements into technical roadmaps and fostering a partnership approach to deliver impactful solutions
  • Drive innovation within the team, encouraging the exploration and implementation of cutting-edge data visualization and analytics solutions
  • Mentor and guide team members in applying an engineering mindset, fostering deep understanding of use-cases, developing robust estimation techniques for volume and compute velocity, and openly addressing implementation limitations
  • Lead the evaluation and development of Proof-of-Concepts (POCs) for new strategic initiatives, guiding the team to convert successful prototypes into robust enterprise solutions
  • Foster a culture of continuous learning and growth within the team, empowering members to research, learn, and recommend emerging technologies
  • Provide leadership and strategic direction for post-release support, collaborating closely with business, development, and support groups to ensure operational stability and client satisfaction
  • Manage team performance, including goal setting, performance reviews, career development, and providing regular feedback to foster professional growth
  • Participate in hiring processes, attracting, interviewing, and onboarding top talent to grow the team's capabilities
  • Facilitate effective communication within the team and across different stakeholders, ensuring transparency and alignment
  • Fulltime
Read More
Arrow Right

Technical Lead - Azure & Power BI

We are looking for a highly skilled and experienced Technical Lead – Azure & Pow...
Location
Location
Egypt , New Cairo
Salary
Salary:
Not provided
coca-colahellenic.com Logo
Coca-Cola HBC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree in Computer Science, Information Technology, Data Science, or equivalent practical experience (7+ years)
  • Hands‑on expertise with Power BI (5+ years), including: Data modeling (star schema, business semantic layer), DAX & Power Query M, Row‑level security, governance, workspace management, Best practices for performance optimization
  • Strong experience with the Azure data platform (5+ years), including: Azure Data Factory, Azure Data Lake / Delta Lake, SQL Database / Synapse SQL
  • Expert‑level SQL skills (5+ years)
  • Strong programming skills in at least one language: C#, Python, Scala, or Java
  • Strong analytical, communication, and team leadership skills
  • Proven experience developing POCs, backend pipelines, and delivering insights to senior management
  • Experience with cloud platforms (Azure preferred) and data engineering technologies (Spark, Hadoop, Databricks, PySpark)
  • Experience with DevOps/MLOps and CI/CD‑based delivery processes
  • First proven leadership experience and ability to coach/mentor development teams
Job Responsibility
Job Responsibility
  • Lead development teams in designing, developing, and implementing Azure + Power BI reporting solutions
  • Drive the full lifecycle of Power BI development—from data ingestion and modeling on Azure to building semantic models and creating high‑quality dashboards
  • Support and mentor Senior & Junior Developers across multiple teams
  • ensure strong engineering standards and best practices
  • Make key technical decisions on Azure Data Factory, Data Lake, data modeling, data transformation, and Power BI architecture
  • Ensure data models are optimized for performance, governance, and usability within Power BI
  • Collaborate with Enterprise & Platform Architects to ensure solution designs align with overall architecture
  • Conduct code reviews and enforce best practices across Azure data pipelines and Power BI development
  • Troubleshoot complex technical issues across Azure data services and BI visualization layers
  • Facilitate effective communication between business stakeholders, data engineers, Power BI developers, and product teams
What we offer
What we offer
  • Coaching and mentoring programs
  • Development opportunities
  • Equal opportunity employer
  • IT Equipment
  • Work with iconic brands
  • Supportive team
  • Fulltime
Read More
Arrow Right

Senior Java Spark Developer

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-12 years of professional experience in software development, with a strong focus on Java
  • Proven track record of hands-on experience in designing and building scalable applications using Spring Boot
  • Extensive experience with relational databases and SQL (e.g., Oracle, PostgreSQL, MySQL)
  • Experience with microservices architecture and RESTful API design
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) is a plus
  • Experience with version control systems (e.g., Git)
  • Experience with Agile development methodologies (Scrum, Kanban)
  • Technical Skills Mandatory: Java (Core Java, Java 8+), Spring Framework (Spring Boot, Spring MVC, Spring Data JPA), SQL, RESTful APIs
  • Strongly Preferred: Microservices, Docker, Kubernetes, CI/CD tools (Jenkins, GitLab CI), Messaging Queues (Kafka, RabbitMQ), Unit Testing (JUnit, Mockito)
  • Soft Skills: Excellent problem-solving and analytical skills
Job Responsibility
Job Responsibility
  • Lead the design, development, and implementation of complex enterprise-level applications using Java and Spring Boot
  • Develop and maintain high-quality, reusable, and testable code following established coding standards and best practices
  • Design and optimize relational database schemas and queries using SQL
  • Participate in code reviews to ensure code quality, maintainability, and adherence to architectural guidelines
  • Collaborate with product owners, business analysts, and other stakeholders to understand requirements and translate them into technical specifications
  • Troubleshoot and debug production issues, providing timely resolutions and root cause analysis
  • Mentor and guide junior developers, fostering a culture of continuous learning and improvement
  • Contribute to architectural discussions and decisions, ensuring solutions align with overall system architecture
  • Implement and maintain CI/CD pipelines to automate testing and deployment processes
  • Stay up-to-date with emerging technologies and industry trends, evaluating their potential impact and applicability
  • Fulltime
Read More
Arrow Right