This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
This position is under ICG TTS Operations Technology Group to help implement next-generation Digital Automation Platform and Imaging Workflow Technologies. The role requires managing development teams in the distributed systems ecosystem while leveraging superior technical knowledge of programming languages and leading-edge development tools.
Job Responsibility:
Develop, test, and deploy production-grade Spark applications in Scala ensuring optimal performance, scalability, and resource utilization
Provide technical leadership and guidance to a team of data engineers fostering a culture of technical excellence and continuous improvement
Conduct rigorous code reviews, establish coding standards, and enforce best practices for Spark Scala development and data governance
Identify and resolve performance bottlenecks in Spark applications using advanced tuning techniques
Design and build complex data pipelines for ETL/ELT purposes.
Requirements:
Hands on knowledge of SPARK, Py-Spark, scala, Java etc.
Hands on knowledge of RDBMS like MS-SQL/Oracle
Knowledge of CI/CD tools like LightSpeed, uDeploy etc.
Proficiency in Spark architecture (RDDs, DataFrames, Datasets), execution model, and optimization techniques
Experience with Spark SQL, Spark Streaming, and Spark Core
Ability to design and build complex data pipelines (ETL/ELT)
Expert-level proficiency in Scala programming, including functional programming paradigms and object-oriented design
Strong hands-on experience with Big Data Ecosystem such as HDFS, YARN, Hive, Kafka etc.
Solid understanding of relational databases (SQL, schema design) and NoSQL databases
Excellent communication, interpersonal, and leadership skills with the ability to articulate complex technical concepts
Exceptional analytical and problem-solving abilities, with meticulous attention to detail
Bachelor's degree/University degree or equivalent experience.
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.