This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are seeking a highly skilled Cloudera Hadoop Administrator (DBA) with hands-on experience managing and administering Databricks environments. This role requires deep expertise in maintaining enterprise-grade Hadoop clusters (Cloudera distribution), including performing backup and restore operations and supporting development, test, and production systems.
Job Responsibility:
Manage and support Cloudera Hadoop clusters and services (HDFS, YARN, Hive, Impala, Spark, Oozie, etc.)
Perform cluster upgrades, patching, performance tuning, capacity planning, and health monitoring
Secure the Hadoop platform using Kerberos, Ranger, or Sentry
Develop and maintain automation and monitoring scripts
Ingest data using tools such as Sqoop, NiFi, DEI Informatica, Qlik
Support release and deployment activities, including deployment of new across Dev/Test and Production environments
Integration of CI/CD pipelines (Git, or custom tooling) for automated code deployment
Ensuring minimal downtime, rollback capability, and alignment with change management policies
Maintain detailed release documentation, track changes in version control systems, and collaborate with development and operations teams to streamline deployment workflows
Administer and maintain Databricks workspaces in cloud environments (Azure, or GCP)
Configure clusters, manage libraries, job scheduling, and workspace settings
Enforce role-based access control (RBAC), integrate with SSO, and manage workspace security
Monitor and optimize performance and cost across the Databricks platform
Collaborate with teams to support data pipelines, ML workflows, and analytics use cases
Integrate Databricks with cloud storage solutions (S3, ADLS) and Delta Lake
Troubleshoot issues related to jobs, performance, or user access
Maintain platform documentation and conduct user training
Stay current with Databricks updates, new features, and best practices
Support hybrid workflows between Hadoop and Databricks environments
Requirements:
4+ years of hands-on experience administering Cloudera Hadoop clusters
2–3+ years of Databricks experience in production environments
2+ years of Databricks administration experience on Azure (preferred)
Strong knowledge of Spark and Delta Lake architecture
Experience with IAM, Active Directory, and SSO integration
Familiarity with DevOps and CI/CD for data platforms
Deep understanding of Hadoop ecosystem: Hive, Impala, Spark, HDFS, YARN
Experience integrating data from DB2 to Hadoop/Databricks using tools like Sqoop or custom connectors
Scripting skills in Shell and/or Python for automation and system administration
Solid foundation in Linux/Unix system administration
Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field — or equivalent professional experience
Nice to have:
Experience with cloud technologies (Azure or GCP preferred)
Exposure to modern data lake and hybrid cloud architectures
Cloudera and/or Databricks certifications
Familiarity with infrastructure-as-code and automation tools (e.g., Terraform)
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.