Senior Spark Developer Jobs

Citi

Location:
Canada, Mississauga

Category:
IT - Software Development

Contract Type:
Employment contract

Salary:

Not provided

Save Job

Apply Position

Job Description:

We are seeking a highly skilled and experienced Senior Spark Developer to join our team. This role demands a deep understanding of Apache Spark and its ecosystem, along with a strong foundation in Java/J2EE application development. You will be responsible for designing, developing, and optimizing Spark-based solutions to process large volumes of data, collaborating with various teams to deliver high-performance and scalable data applications.

Job Responsibility:

Design, develop, and implement complex Spark applications for processing large datasets
Partner with management teams to integrate Spark-based solutions into existing data infrastructure
Resolve critical data processing challenges by evaluating complex business processes
Provide technical leadership and mentorship to other engineers
Develop and maintain coding standards, testing procedures, and debugging techniques specifically for Spark applications
Contribute to the overall data architecture ensuring alignment with business goals
Drive compliance with applicable laws, rules, and regulations

Requirements:

6+ years of application development experience with a significant focus on Java/J2EE and Apache Spark
Strong command of Object-Oriented Programming (OOP) principles and design patterns in Java
Excellent understanding of data structures and algorithms, and their application in Spark development
Proven experience developing complex Java/J2EE applications, encompassing all areas of the technology stack
Thorough knowledge and hands-on experience with Hadoop, MapReduce, YARN, Sqoop, Pig, Hue, Unix, Impala, and Cassandra on Mesos
Extensive experience designing, developing, and deploying Spark applications in a production environment, handling large volumes of data
Deep understanding of Spark architecture, including Spark SQL, Spark Streaming, RDDs, and DataFrames
Experience with ETL and BI tools is a plus
Experience working in an agile environment using Scrum methodologies
Expertise in designing and optimizing software solutions for performance and stability, particularly in the context of Spark
Expertise in troubleshooting and problem-solving complex technical issues
Experience with test-driven development (TDD)
Cloudera certification (CCDH) is an added advantage

Nice to have:

Experience with cloud-based Spark platforms (e.g., Databricks, AWS EMR, Azure HDInsight)
Experience with other big data technologies (e.g., Kafka, Hive, HBase)
Experience with data visualization tools and techniques

What we offer:

Global workforce benefits designed to support well-being, growth, and work-life balance

Additional Information:

Job Posted:
September 05, 2025

Employment Type:

Fulltime

Work Type:

Hybrid work

View All Jobs In This Company

Job Link Share:

Senior Spark Developer