This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are seeking a Spark, Big Data - ETL Tech Lead for Commercial Card’s Global Data Repository development team. The successful candidate will interact with the Development Project Manager, the development, testing, and production support teams, as well as other departments within Citigroup for TTS platforms. The candidate requires exceptional communication skills across both technology and the business and will have a high degree of visibility. He/she will be a rigorous technical lead with a strong understanding of how to build scalable, enterprise level global applications.
Job Responsibility:
Lead the design and implementation of large-scale data processing pipelines using Apache Spark on BigData Hadoop Platform
Develop and optimize Spark applications for performance and scalability
Responsible for providing technical leadership of multiple large scale/complex global software solutions
Integrate data from various sources, including Couchbase, Snowflake, and HBase, ensuring data quality and consistency
Experience of developing teams of permanent employees and vendors from 5 – 15 developers in size
Build and sustain strong relationships with the senior business leaders associated with the platform
Design, code, test, document and implement application release projects as part of development team
Work with onsite development partners to ensure design and coding best practices
Work closely with Program Management and Quality Control teams to deliver quality software to agreed project schedules
Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns
Compliance with Citi's System Development Lifecycle and Information Security requirements
Oversee development scope, budgets, time line documents
Monitor, update and communicate project timelines and milestones
obtain senior management feedback
understand potential speed bumps and client’s true concerns/needs
Stay updated with the latest trends and technologies in big data and cloud computing
Mentor and guide junior developers, providing technical leadership and expertise
Requirements:
Bachelor’s or master’s degree in computer science, Information Technology, or equivalent
Minimum 10 years of Proven experience in developing and managing big data solutions using Apache Spark. Having strong hold on Spark-core, Spark-SQL & Spark Streaming
Minimum 6 years of experience in leading globally distributed teams successfully
Strong programming skills in Scala, Java, or Python
Hands on experience on Technologies like Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume etc.
Proficiency in SQL and experience with relational (Oracle/PL-SQL) and NoSQL databases like mongoDB
Demonstrated people and technical management skills
Demonstrated excellent software development skills. Strong experiences in implementation of complex file transformations like positional, xmls
Experience in building enterprise system with focus on recovery, stability, reliability, scalability and performance
Experience in working on Kafka, JMS / MQ applications
Experience in working multiple OS (Unix, Linux, Win)
Familiarity with data warehousing concepts and ETL processes
Experience in performance tuning of large technical solutions with significant volumes
Knowledge of data modeling, data architecture, and data integration techniques
Knowledge on best practices for data security, privacy, and compliance
Nice to have:
Experience in Java, Spring, ETL Tools like Talend, Ab Initio is a plus
Experience of migrating functionality from ETL tools to Spark
Experience/knowledge on Cloud technologies AWS, GCP
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.