Lead Big Data Spark Engineer Job at Citi (Mississauga)

Data Engineering Lead

Data Engineering Lead a strategic professional who stays abreast of developments...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

10-15 years of hands-on experience in Hadoop, Scala, Java, Spark, Hive, Kafka, Impala, Unix Scripting and other Big data frameworks
4+ years of experience with relational SQL and NoSQL databases: Oracle, MongoDB, HBase
Strong proficiency in Python and Spark Java with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc) and Scala and SQL
Data Integration, Migration & Large Scale ETL experience (Common ETL platforms such as PySpark/DataStage/AbInitio etc.) - ETL design & build, handling, reconciliation and normalization
Data Modeling experience (OLAP, OLTP, Logical/Physical Modeling, Normalization, knowledge on performance tuning)
Experienced in working with large and multiple datasets and data warehouses
Experience building and optimizing ‘big data’ data pipelines, architectures, and datasets
Strong analytic skills and experience working with unstructured datasets
Ability to effectively use complex analytical, interpretive, and problem-solving techniques
Experience with Confluent Kafka, Redhat JBPM, CI/CD build pipelines and toolchain – Git, BitBucket, Jira

Job Responsibility

Strategic Leadership: Define and execute the data engineering roadmap for Global Wealth Data, aligning with overall business objectives and technology strategy
Team Management: Lead, mentor, and develop a high-performing, globally distributed team of data engineers, fostering a culture of collaboration, innovation, and continuous improvement
Architecture and Design: Oversee the design and implementation of robust and scalable data pipelines, data warehouses, and data lakes, ensuring data quality, integrity, and availability for global wealth data
Technology Selection and Implementation: Evaluate and select appropriate technologies and tools for data engineering, staying abreast of industry best practices and emerging trends specific to wealth management data
Performance Optimization: Continuously monitor and optimize data pipelines and infrastructure for performance, scalability, and cost-effectiveness, ensuring optimal access to global wealth data
Collaboration: Partner with business stakeholders, data scientists, portfolio managers, and other technology teams to understand data needs and deliver effective solutions that support investment strategies and client reporting
Data Governance: Implement and enforce data governance policies and procedures to ensure data quality, security, and compliance with relevant regulations, particularly around sensitive financial data

Fulltime

Big Data / Scala / Python Engineering Lead

The Applications Development Technology Lead Analyst is a senior level position ...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

At least two years (Over all 10+ hands on Data Engineering experience) of experience building and leading highly complex, technical data engineering teams
Lead data engineering team, from sourcing to closing
Drive strategic vision for the team and product
Experience managing an data focused product, ML platform
Hands on experience relevant experience in design, develop, and optimize scalable distributed data processing pipelines using Apache Spark and Scala
Experience managing, hiring and coaching software engineering teams
Experience with large-scale distributed web services and the processes around testing, monitoring, and SLAs to ensure high product quality
7 to 10+ years of hands-on experience in big data development, focusing on Apache Spark, Scala, and distributed systems
Proficiency in Functional Programming: High proficiency in Scala-based functional programming for developing robust and efficient data processing pipelines
Proficiency in Big Data Technologies: Strong experience with Apache Spark, Hadoop ecosystem tools such as Hive, HDFS, and YARN

Job Responsibility

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary

Fulltime

Big Data Program Lead

As part of Citi’s broad transformation strategy, Data Engineering group is under...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

10+ years relevant experience on building data engineering solutions for large scale Operational and Data Warehouse implementations
consistently demonstrates clear and concise written and verbal communication
management and prioritization skills
8+ years experience in building enterprise data warehouse systems in finance sector is preferable
8+ years of relevant experience in Application Development for Enterprise
must Technical Skills - Java/Scala, Hadoop, Python, Hive, Impala, Kafka and Elastic
Apache Iceberg
Databases: Oracle
Netezza
must Core Skills - 10+ years experience in handling Large Teams: IT Projects Design and Development

Job Responsibility

provides architectural vision, ensuring architecture conforms to enterprise blueprints
develops architecture, strategy, planning, and problem solving solutions on an enterprise level
interfaces across several channels, acting as a visionary to proactively assist in defining direction for future projects
maintains continuous awareness of business, technical, and infrastructure issues and acts as a sounding board or consultant to aid in the development of creative solutions
experience with developing metadata driven frameworks for data processing/transformation and built real-time processing solutions
hands-on data engineer with core skillset on Big Data stack of technologies including but not limited to, Spark with Scala, Hive, Impala, Kafka, Solace, Iceberg format tables etc.
position requires excellent communication skills to drive the change required and ability to translate the vision into technical artifacts
identify and apply optimization techniques to improve performance of existing applications
provides thought leadership in subjects that are key to the business
provides senior-level technical consulting and mentoring during design and development for highly complex and critical data projects

Fulltime

Big Data Engineering Lead

The Senior Big Data engineering lead will play a pivotal role in designing, impl...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Bachelor's or Master’s degree in Computer Science, Information Technology, or related field
Atleast 10 -12 years overall software development experience on majorly working with handling application with large scale data volumes from ingestion, persistence and retrieval
Deep understanding of big data technologies, including Hadoop, Spark, Kafka, Flink, NoSQL databases, etc.
Experience with Bigdata technologies Developer Hadoop, Apache Spark, Python, PySpark
Strong programming skills in languages such as Java, Scala, or Python
Excellent problem-solving skills with a knack for innovative solutions
Strong communication and leadership abilities
Proven ability to manage multiple projects simultaneously and deliver results

Job Responsibility

Lead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and resilience
Design complex data transformation processes using Spark and other big data technologies using Java, Pyspark or Scala
Design and implement data pipelines that ensure data quality, integrity, and availability
Collaborate with cross-functional teams to understand business needs and translate them into technical requirements
Evaluate and select technologies that improve data efficiency, scalability, and performance
Oversee the deployment and management of big data tools and frameworks such as Hadoop, Spark, Kafka, and others
Provide technical guidance and mentorship to the development team and junior architects
Continuously assess and integrate emerging technologies and methodologies to enhance data processing capabilities
Optimize big data frameworks, such as Hadoop, Spark, for performance improvements and reduced processing time across distributed systems
Implement data governance frameworks to ensure data accuracy, consistency, and privacy across the organization, leveraging metadata management and data lineage tracking

Fulltime

Data Engineering Lead

The Engineering Lead Analyst is a senior level position responsible for leading ...

Location

Singapore , Singapore

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

10-15 years of hands-on experience in Hadoop, Scala, Java, Spark, Hive, Kafka, Impala, Unix Scripting and other Big data frameworks
4+ years of experience with relational SQL and NoSQL databases: Oracle, MongoDB, HBase
Strong proficiency in Python and Spark Java with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc) and Scala and SQL
Data Integration, Migration & Large Scale ETL experience (Common ETL platforms such as PySpark/DataStage/AbInitio etc.) - ETL design & build, handling, reconciliation and normalization
Data Modeling experience (OLAP, OLTP, Logical/Physical Modeling, Normalization, knowledge on performance tuning)
Experienced in working with large and multiple datasets and data warehouses
Experience building and optimizing ‘big data’ data pipelines, architectures, and datasets
Strong analytic skills and experience working with unstructured datasets
Ability to effectively use complex analytical, interpretive, and problem-solving techniques
Experience with Confluent Kafka, Redhat JBPM, CI/CD build pipelines and toolchain – Git, BitBucket, Jira

Job Responsibility

Define and execute the data engineering roadmap for Global Wealth Data, aligning with overall business objectives and technology strategy
Lead, mentor, and develop a high-performing, globally distributed team of data engineers, fostering a culture of collaboration, innovation, and continuous improvement
Oversee the design and implementation of robust and scalable data pipelines, data warehouses, and data lakes, ensuring data quality, integrity, and availability for global wealth data
Evaluate and select appropriate technologies and tools for data engineering, staying abreast of industry best practices and emerging trends specific to wealth management data
Continuously monitor and optimize data pipelines and infrastructure for performance, scalability, and cost-effectiveness
Partner with business stakeholders, data scientists, portfolio managers, and other technology teams to understand data needs and deliver effective solutions
Implement and enforce data governance policies and procedures to ensure data quality, security, and compliance with relevant regulations

What we offer

Equal opportunity employer commitment
Accessibility and accommodation support
Global workforce benefits

Fulltime

Big Data Spark Development Vice President

We are seeking a Software/Application Dev Lead Analyst for Global Data Platform ...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Bachelor's or master's degree in computer science, Information Technology, or equivalent
Minimum 15 years of work experience
At least 8 years of experience of leading Enterprise Bigdata Development and Data Science (Analytical) teams
Experience developing Applications for High volume instanced payments and/or AML industry is a significant plus
Experience working in Banking technology is preferred
Very strong Engineer excellence knowledge and experience like Data patterns, Pipelines, DQs, Recons, Governance, Scalable application traits and cloud portable coding
Project management, interpersonal, and communication skills, with high attention to details
Must-Have: Experience in building enterprise-grade transaction management and AML system with focus on recovery, stability, reliability, scalability and performance
Must-Have: Strong hand-on seasoned engineer/lead in Bigdata data store application building using enterprise SDLC/Agile methodology, Data modelling/Architect, supporting Operational and production systems
Must-Have: Strong technical skills and hand-on in Spark/Scala, Kafka, Hadoop, Couchbase, HBASE and Snowflake

Job Responsibility

Manage one or more Applications Development teams to accomplish established goals as well as conduct personnel duties for team (e.g. performance evaluations, hiring and disciplinary actions)
Utilize in-depth knowledge and skills across multiple Applications Development areas to provide technical oversight across systems and applications
Review and analyze proposed technical solutions for projects
Contribute to formulation of strategies for applications development and other functional areas
Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
Provide evaluative judgment based on analysis of factual data in complicated and unique situations
Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency, as well as effectively supervise the activity of others and create accountability with those who fail to maintain these standards

Fulltime

Big Data Lead Developer

We are seeking a highly skilled and experienced Big Data Lead Developer to estab...

Location

Canada , Mississauga

Salary:

170.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

6+ years of relevant experience in Big Data application development or systems analysis role
Experience in leading and mentoring big data engineering teams
Strong understanding of big data concepts, architectures, and technologies (e.g., Hadoop, PySpark, Hive, Kafka, NoSQL databases)
Proficiency in programming languages such as Java, Scala, or Python
Excellent problem-solving and analytical skills
Strong presentation, communication and interpersonal skills
Experience with data warehousing and business intelligence tools
Experience with data visualization and reporting
Knowledge of cloud-based big data platforms (e.g., AWS EMR, Azure HDInsight, Google Cloud Dataproc)
Proficiency in Unix/Linux environments

Job Responsibility

Lead and mentor a team of big data engineers, fostering a collaborative and high-performing environment
Provide technical guidance, code reviews, and support for professional development
Design and implement scalable and robust big data architectures and pipelines to handle large volumes of data from various sources
Evaluate and select appropriate big data technologies and tools based on project requirements and industry best practices
Implement and integrate these technologies into our existing infrastructure
Develop and optimize data processing and analysis workflows using technologies such as Spark, Hadoop, Hive, and other relevant tools
Implement data quality checks and ensure adherence to data governance policies and procedures
Continuously monitor and optimize the performance of big data systems and pipelines to ensure efficient data processing and retrieval
Collaborate effectively with cross-functional teams, including data scientists, business analysts, and product managers, to understand their data needs and deliver impactful solutions
Stay up to date with the latest advancements in big data technologies and explore new tools and techniques to improve our data infrastructure

What we offer

Global benefits designed to support your well-being, growth, and work-life balance

Fulltime

Big Data Platform Senior Engineer

Lead Java Data Engineer to guide and mentor a talented team of engineers in buil...

Location

Bahrain , Seef, Manama

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Significant hands-on experience developing high-performance Java applications (Java 11+ preferred) with strong foundation in core Java concepts, OOP, and OOAD
Proven experience building and maintaining data pipelines using technologies like Kafka, Apache Spark, or Apache Flink
Familiarity with event-driven architectures and experience in developing real-time, low-latency applications
Deep understanding of distributed systems concepts and experience with MPP platforms such as Trino (Presto) or Snowflake
Experience deploying and managing applications on container orchestration platforms like Kubernetes, OpenShift, or ECS
Demonstrated ability to lead and mentor engineering teams, communicate complex technical concepts effectively, and collaborate across diverse teams
Excellent problem-solving skills and data-driven approach to decision-making

Job Responsibility

Provide technical leadership and mentorship to a team of data engineers
Lead the design and development of highly scalable, low-latency, fault-tolerant data pipelines and platform components
Stay abreast of emerging open-source data technologies and evaluate their suitability for integration
Continuously identify and implement performance optimizations across the data platform
Partner closely with stakeholders across engineering, data science, and business teams to understand requirements
Drive the timely and high-quality delivery of data platform projects

Fulltime

Lead Big Data Spark Engineer

Citi

Location:
Canada , Mississauga

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
February 16, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Lead Big Data Spark Engineer

Data Engineering Lead

Big Data / Scala / Python Engineering Lead

Big Data Program Lead

Big Data Engineering Lead

Data Engineering Lead

Big Data Spark Development Vice President

Big Data Lead Developer

Big Data Platform Senior Engineer

Lead Big Data Spark Engineer

Citi

Location:Canada , Mississauga

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:February 16, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Lead Big Data Spark Engineer

Data Engineering Lead

Big Data / Scala / Python Engineering Lead

Big Data Program Lead

Big Data Engineering Lead

Data Engineering Lead

Big Data Spark Development Vice President

Big Data Lead Developer

Big Data Platform Senior Engineer

Location:
Canada , Mississauga

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
February 16, 2026