This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
The role is for a Senior Spark Java developer in Global Statement Delivery team. The candidate will design, develop, and maintain Java-based applications and data pipelines using Apache Spark framework for large-scale data processing. Responsibilities include creating scalable, efficient, and maintainable code while collaborating with data teams and ensuring data models and pipelines function correctly. The role involves engagement with business and understanding of operating environments.
Job Responsibility:
Writing code, designing algorithms, and building data processing pipelines using the Spark API
Utilizing Spark's capabilities to process and transform large datasets
Working with technologies like HDFS, Hive, HBase, and Kafka
Leading and developing staff in a technical development environment
Collaborating with engineers, data scientists, and stakeholders to understand requirements and design solutions
Identifying and addressing performance bottlenecks in Spark applications
Writing clear and concise documentation
Implementing and maintaining continuous integration and deployment pipelines.
Requirements:
Bachelor’s degree in Science, Computers, Information Technology, or Engineering
At least 10+ years overall IT experience
At least 2+ years in a team lead role with experience on large & complex projects
At least 3 years of experience in Java Spark and Big data frameworks
Strong proficiency in Python and Java Spark with knowledge of core Spark concepts like RDDs, Dataframes, Spark Streaming
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.