Scala/Python Big Data Development Manager, Citi

Citi

Location:
Canada, Mississauga

Category:
IT - Software Development

Contract Type:
Employment contract

Salary:

Not provided

Save Job

Apply Position

Job Description:

The Scala/Python Big Data Development Manager is responsible for leading applications systems analysis and programming activities within the Chief Data Office. This role includes managing data engineering teams, driving strategic vision, and optimizing large-scale distributed data processing pipelines using Apache Spark and Scala.

Job Responsibility:

Manage one or more Applications Development teams in an effort to accomplish established goals as well as conduct personnel duties for team (e.g., performance evaluations, hiring and disciplinary actions)
Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Ensure procedures are followed and contribute to defining standards

Requirements:

6+ years of hands-on experience in big data development, focusing on Apache Spark, Scala, and distributed systems
Experience as Applications Development Manager
High proficiency in Scala-based functional programming for developing robust and efficient data processing pipelines
Strong experience with Apache Spark, Hadoop ecosystem tools such as Hive, HDFS, and YARN, AIRFLOW, DataOps, Data Management
Advanced knowledge of Scala and a good understanding of Python for data engineering tasks
Solid understanding of data modeling principles and ETL processes in big data environments
Strong ability to analyze and solve performance issues in Spark jobs and distributed systems
Familiarity with Git, Jenkins, and other CI/CD tools for automating the deployment of big data applications

Nice to have:

Any experience with python development
Experience with streaming platforms such as Apache Kafka or Spark Streaming
Python data engineering experience
Familiarity with financial data processing, ensuring scalability, security, and compliance requirements

What we offer:

Equal opportunity employer
Global benefits
Personal development opportunities

Additional Information:

Job Posted:
May 30, 2025

Employment Type:

Fulltime

Work Type:

Hybrid work

View All Jobs In This Company

Job Link Share:

Scala/Python Big Data Development Manager