CrawlJobs Logo

Senior Big Data Platform Engineer

https://www.citi.com/ Logo

Citi

Location Icon

Location:
India, Pune

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Job Responsibility:

  • Install and configure Cloudera cluster
  • Apply proper architecture guidelines to ensure highly available services
  • Plan and execute major platform software and operating system upgrades and maintenance across physical environments
  • Develop and automate processes for maintenance and monitoring of the environment (Python, Java, Shell Script)
  • Implement security measures for all aspects of the cluster (SSL, disk encryption, role-based access via Cloudera sentry)
  • Ensure proper resource utilization between the different development teams and processes
  • Review performance stats and query execution/explain plans
  • recommend changes for tuning Hive/Impala queries
  • Create and maintain detailed, up-to-date technical documentation

Requirements:

  • 5+ years experience with big data tools: Hadoop, Hive, HBase, Spark, Kafka, Impala, Solr, Phoenix, etc.
  • 3+ years experience with Python, Java, Shell Script
  • 2+ years experience with cloud services platform (prefer AWS.)
  • Ability to troubleshoot problems and quickly resolve issues
  • Cluster maintenance as well as creation and removal of nodes
  • Performance tuning of Hadoop clusters
  • Screen Hadoop cluster job performances and capacity planning
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files
  • File system management and monitoring
  • HDFS support and maintenance
  • Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required

Additional Information:

Job Posted:
August 02, 2025

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.