Senior Spark Developer Jobs

Citi

Location:
Canada, Mississauga

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

We are seeking a highly skilled and experienced Senior Spark Developer to join our team. This role demands a deep understanding of Apache Spark and its ecosystem, along with a strong foundation in Java/J2EE application development. You will be responsible for designing, developing, and optimizing Spark-based solutions to process large volumes of data, collaborating with various teams to deliver high-performance and scalable data applications. This is a challenging and rewarding opportunity to contribute to a cutting-edge data engineering team.

Job Responsibility:

Design, develop, and implement complex Spark applications for processing large datasets, leveraging your expertise in distributed computing and data manipulation techniques
Partner with management teams to integrate Spark-based solutions into existing data infrastructure, ensuring seamless data flow and optimal performance
Resolve critical data processing challenges by evaluating complex business processes, system processes, and industry standards, applying your deep understanding of Spark's capabilities
Provide technical leadership and mentorship to other engineers, guiding them on Spark best practices and promoting efficient development strategies
Develop and maintain coding standards, testing procedures, and debugging techniques specifically for Spark applications
Contribute to the overall data architecture, ensuring that Spark solutions align with business goals and integrate effectively with other data technologies
Appropriately assess risk when making technical decisions, considering factors such as data security, performance, and scalability
Drive compliance with applicable laws, rules, and regulations, adhering to company policies and demonstrating sound ethical judgment

Requirements:

6+ years of application development experience, with a significant focus on Java/J2EE and Apache Spark
Strong command of Object-Oriented Programming (OOP) principles and design patterns in Java
Excellent understanding of data structures and algorithms, and their application in Spark development
Proven experience developing complex Java/J2EE applications, encompassing all areas of the technology stack
Thorough knowledge and hands-on experience with Hadoop, MapReduce, YARN, Sqoop, Pig, Hue, Unix, Impala, and Cassandra on Mesos
Extensive experience designing, developing, and deploying Spark applications in a production environment, handling large volumes of data
Deep understanding of Spark architecture, including Spark SQL, Spark Streaming, RDDs, and DataFrames
Experience with ETL and BI tools is a plus
Experience working in an agile environment using Scrum methodologies
Expertise in designing and optimizing software solutions for performance and stability, particularly in the context of Spark
Expertise in troubleshooting and problem-solving complex technical issues
Experience with test-driven development (TDD)
Cloudera certification (CCDH) is an added advantage

Nice to have:

Experience with cloud-based Spark platforms (e.g., Databricks, AWS EMR, Azure HDInsight)
Experience with other big data technologies (e.g., Kafka, Hive, HBase)
Experience with data visualization tools and techniques

Additional Information:

Job Posted:
July 18, 2025

Employment Type:

Fulltime

Work Type:

Hybrid work

View All Jobs In This Company

Job Link Share:

Senior Spark Developer