CrawlJobs Logo

Hadoop and Bigdata Administrator

clear-trail.com Logo

ClearTrail

Location Icon

Location:
India , Indore, NOIDA

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

You will work in a multi-functional role with a combination of expertise in System and Hadoop administration. You will work in a team that often interacts with customers on various aspects related to technical support for deployed system. You will be deputed at customer premises to assist customers for issues related to System and Hadoop administration. You will Interact with QA and Engineering team to co-ordinate issue resolution within the promised SLA to customer.

Job Responsibility:

  • Deploying and administering Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem
  • Installing Linux Operating System and Networking
  • Writing Unix SHELL/Ansible Scripting for automation
  • Maintaining core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, REDIS, SPARK, HBASE etc.
  • Takes care of the day-to-day running of Hadoop clusters using Ambari/Cloudera manager/Other monitoring tools, ensuring that the Hadoop cluster is up and running all the time
  • Maintaining HBASE Clusters and capacity planning
  • Maintaining SOLR Cluster and capacity planning
  • Work closely with the database team, network team and application teams to make sure that all the big data applications are highly available and performing as expected
  • Manage KVM Virtualization environment

Requirements:

  • Linux Administration
  • Experience in Python and Shell Scripting
  • Deploying and administering Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem
  • Knowledge of Hadoop core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, REDIS, SPARK etc.
  • Knowledge of HBASE Clusters

Nice to have:

  • Experience in Networking Concepts
  • Working knowledge of SOLR, Elastic Search
  • Experience in Virtualization technology, KVM, OLVM

Additional Information:

Job Posted:
January 02, 2026

Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Hadoop and Bigdata Administrator

Bigdata Support Lead Engineer

The Lead Data Analytics analyst is responsible for managing, maintaining, and op...
Location
Location
India , Bengaluru; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of total IT experience
  • 5+ years of experience in supporting Hadoop (Cloudera)/big data technologies
  • 5+ years of experience in public cloud infrastructure (AWS or GCP)
  • Experience with Kubernetes and cloud-native technologies
  • Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)
  • Advanced knowledge of the Hadoop ecosystem and Big Data technologies
  • Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
  • Knowledge of troubleshooting techniques for Hive, Spark, YARN, Kafka, and HDFS
  • Advanced Linux system administration and scripting skills (Shell, Python)
  • Experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark with Java or Scala or Python
Job Responsibility
Job Responsibility
  • Lead day to day operation and support for Cloudera Hadoop ecosystem components (HDFS, YARN, Hive, Impala, Spark, HBase, etc)
  • Troubleshoot issues related to data ingestion, job failures, performance degradation and service unavailability
  • Monitor cluster health using Cloudera Manager and respond to alerts, logs, and metrics
  • Collaborate with engineering teams to analyze root causes and implement preventive measures
  • Collaborate patching, service restarts, failovers and rolling restarts for cluster maintenance
  • Assist in user onboarding, access control and issues in accessing the cluster services
  • Contribute to documentation for knowledge base
  • Work on data recovery, replication, and backup support tasks
  • Responsible for moving all legacy workloads to cloud platform
  • Ability to research and assess open-source technologies, public cloud tech stack (AWS/GCP) components to recommend and integrate into the design and implementation
  • Fulltime
Read More
Arrow Right

Bigdata SME

The selected candidate will work directly with the DriveOhio and IT team in rese...
Location
Location
United States , Columbus
Salary
Salary:
Not provided
oceanbluecorp.com Logo
Ocean Blue Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-year college degree in computer science or related field with advanced study preferred
  • 5 yrs. experience in Hadoop HDFS Build and administration, certification preferred
  • 5 yrs. experience in working with, installing and setting up HBase,MongoDB, Maven, DocumentDB, Amazon DynamoDB, BigTable, Cassandra, or Druid
  • 5 yrs. experience working daily within an Agile team
  • 5 yrs. experience working within a paired programming environment
  • 7 yrs. in Software development as a developer
  • 7 yrs. experience in IT infrastructure deployment
  • 7 yrs. experience in Open Source software deployment
  • 7 yrs. experience in Web systems and application deployment
  • 7 yrs. experience in Requirements Gathering and Use Case development
Job Responsibility
Job Responsibility
  • Operate effectively as a big data SME with knowledge of the latest tools, applications and cloud infrastructures necessary to implement a powerful open source system
  • Operate as technical expert with intimate knowledge regarding all components that comprise the entire solution set
  • Serve as the SME on the host of applications and environments required to serve the users
  • Operate as SME in the implementation of Open Source Big data solutions from infrastructure to applications
  • Assist with developing the delivery Epics, Stories and Tasks that will comprise the solution set for BI
  • Operate as the cross technology and platform SME
  • Act as Open Source advocate and practitioner
  • Assist in the execution of the process operating as Agile evangelist and master
  • Mentor teams involved in developing highly technical solutions and promote culture that values input from all team members
  • Promote continuous learning and deliver value to the customer
Read More
Arrow Right
New

Project Director

As a Project Director at AKQA, you will be responsible for the overall direction...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
akqa.com Logo
AKQA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Project management experience within the digital/creative industry
  • Experience of project managing custom-designed, highly-complex full life-cycle projects in excess of £1.5m
  • Delivery of distributed development projects across multiple geographies is advantageous
  • Strong knowledge and best practice approach for project management
  • Experience of having adapted the delivery process around those required by a client
  • Enough knowledge of SCRUM, DSDM, Kanban and Lean to have a debate with clients as to their merits and drawbacks
  • Exceptional client management skills
  • Strong organisational and planning skills
  • Excellent communication skills across all mediums – presentation, verbal, written
  • gaining the confidence of the business
Job Responsibility
Job Responsibility
  • Responsible for the successful delivery of highly complex projects with revenue typically in excess of £1.5m across large-scale project or multiple projects
  • Analyses and understands the project and its context within the client's business and how expected benefits can be enabled (indirect, direct, financial and non-financial)
  • Structure projects appropriately from the outset, selecting the best tools and processes to meet the project, team and client requirements
  • Identify project risks and issues, ensuring effective mitigation and risk strategies are implemented
  • Estimate and prepare strong proposals
  • Track and report financial status of projects against an agreed budget, using burn reports to monitor and proactively mitigate potential overruns, highlighting clearly to the Executive Delivery Director when an overrun is likely to occur
  • Identify and successfully manage multiple suppliers, partners and senior clients expected to be at C level to ensure the best outcome for both clients and AKQA
  • Keep stakeholders informed of project progress at all times and manage expectations proactively
  • Work with Client Leads on delivering high scoring client satisfaction
  • Develop positive senior level relationships both internally and externally
What we offer
What we offer
  • Opportunity to produce meaningful and award-winning work for world-class clients and brands
  • Work in an environment which fosters a meritocratic culture and encourages ownership
  • Liaise with bright minds across KSA, UAE and Egypt
  • Opportunity to learn and grow within a creative and innovative team
  • Access to ongoing personal and professional development
  • Commitment to your career growth, as well as your work/life balance
  • Fulltime
Read More
Arrow Right
New

Full Stack Engineer - Vice President

This role is for an innovative Full Stack Engineer to help the build out of solu...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong engineering experience with high-performance, large-scale distributed systems
  • Fluency in Java, Python or both
  • UI development skills with technologies such as React JS or StreamLit
  • Experience with frameworks such as Spring (Boot, Core, JDBC, AI etc.) or Flask
  • Proficiency in database technologies, such as Oracle, Postgres, or MongoDB
  • Experience designing and implementing REST or WebSocket APIs
  • Experience with messaging and integration platforms like Kafka or JMS/MQ
  • Familiarity with one of the major cloud platforms including AWS, GCP, or Azure
  • Strong knowledge of infrastructure tools, including Docker, Kubernetes, Terraform, and Helm
  • Experience with build and deployment (CI/CD) tools such as Jenkins and Gradle
Job Responsibility
Job Responsibility
  • Contribute significantly to engineering & delivery of end-to-end solutions
  • Adopt a product-focused approach, ensuring the development of robust, scalable, and user-friendly solutions
  • Thrive in a fast-paced environment by continuously testing, learning, and tackling cutting-edge problems
  • Actively engage in pair programming, promote lean methodologies, and streamline processes by removing unnecessary bureaucracy
  • Prioritize rapid delivery and iterative development, demonstrating adaptability and a willingness to pivot rather than pursuing a perfect upfront solution
  • Develop foundational components and mature technology capabilities in Artificial Intelligence (AI) and Large Language Models (LLMs)
  • Drive the enterprise-wide adoption and successful integration of Generative AI solutions
  • Demonstrate strong problem-solving capabilities and a proactive learning mindset, continuously acquiring new skills
  • Exhibit excellent communication and collaboration skills, effectively engaging with diverse stakeholders
  • Be adaptable and resourceful in navigating complex technical and organizational challenges
  • Fulltime
Read More
Arrow Right
New

Senior Backend Engineer

Software Engineers at OnePay build the products & systems that serve our custome...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
OnePay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-7 years professional experience building, shipping — and growing — non-trivial products & services
  • Passion for your craft and care for the people you work with
  • An act-like-an-owner mentality
  • A desire to keep growing your skills, and an ability to learn quickly
  • The Triple H Factor: Hungry, Humble, Honest
Job Responsibility
Job Responsibility
  • Working closely with other engineers to ship code
  • Building and maintaining documentation
  • Solving complex problems that arise at scale
What we offer
What we offer
  • Competitive salary, stock options, and benefits from Day 1
  • Comprehensive health insurance coverage (health insurance, accident and disability insurance, term life insurance), including mental health support and wellness programs
  • Hybrid work model (Bengaluru office three days a week), various time off programs (vacation, sick, other paid leaves, and paid regional holidays)
  • Monthly transport and work-from-home allowances
  • A high-growth, mission-driven, inclusive culture where your work has real impact
  • Fulltime
Read More
Arrow Right
New

In Store Team Member

As an Instore Team Member, you’ll be at the heart of our store, making delicious...
Location
Location
United Kingdom , Shirley
Salary
Salary:
7.55 - 12.21 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Positive, can-do attitude and a passion for great customer service
  • Able to work quickly and efficiently, especially during busy periods
  • Good communication skills and a team player
  • Attention to detail and pride in your work
  • Willingness to learn and take on new challenges
  • Right to work relevant to store location
Job Responsibility
Job Responsibility
  • Prepare pizzas and side items to Domino’s high standards
  • Serve customers face-to-face and by phone, taking orders and payments
  • Maintain food hygiene and safety standards at all times
  • Support with cleaning, restocking and general store duties
  • Contribute to local marketing activities (e.g. leaflet drops, events)
  • Work flexibly across shifts, including evenings and weekends
What we offer
What we offer
  • Competitive hourly pay (with opportunities for progression)
  • 28 days paid holiday per year
  • Flexible working hours to suit your lifestyle
  • Staff discount on our delicious food
  • Company pension scheme (where eligible)
  • Family Leave policies in place
  • Paid training and clear career progression pathway with linked pay increases
  • Supportive, inclusive, and fun team environment
  • Employee recognition opportunities
Read More
Arrow Right
New

Analytics Engineer

We’re looking for an Analytics Engineer to help build and maintain the data mode...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
Multiverse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of building and optimising complex SQL (including complex joins, window functions and optimisation methods)
  • Strong understanding of data modelling and warehouse design (e.g., Kimball-style dimensional modelling)
  • Experience using dbt in production environments, including testing and documentation
  • Familiar with version control (GitHub)
  • Experience tuning dbt models and SQL queries for performance
  • Able to independently transform business logic into technical implementation
  • Comfortable participating in and contributing to code reviews
Job Responsibility
Job Responsibility
  • Build and maintain dbt models to transform raw data into clean, documented, and accessible data sets
  • Translate business and analytics requirements into scalable data models
  • Design and implement data warehouse schemas using dimensional modelling techniques (fact and dimension tables, slowly changing dimensions, etc.)
  • Participate in design and code reviews to improve model design and query performance
  • Expose these models and associated metrics via our Semantic Layer
  • Implement and maintain dbt tests to ensure data quality and model accuracy
  • Document data models clearly to support cross-functional use
  • Use GitHub and CI/CD pipelines to manage code and deploy changes safely and efficiently
  • Optimise dbt models and SQL queries for performance and maintainability
  • Work with Snowflake
What we offer
What we offer
  • 27 days holiday
  • 5 additional days off: 1 life event day, 2 volunteer days, 2 company-wide wellbeing days (M-Powered Weekend)
  • 8 bank holidays per year
  • private medical Insurance with Bupa
  • a medical cashback scheme
  • life insurance
  • gym membership & wellness resources through Wellhub
  • access to Spill - all in one mental health support
  • Hybrid work offering - for most roles we collaborate in the office three days per week
  • Work-from-anywhere scheme - you'll have the opportunity to work from anywhere, up to 10 days per year
  • Fulltime
Read More
Arrow Right
New

Enterprise Account Executive

Multiverse is the upskilling platform for AI and Tech adoption. We have partnere...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
Multiverse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of closing experience in an enterprise B2B sales environment
  • Proven track record in creating and driving new business
  • Ability to build and deliver a thorough end-to-end sales process
  • Demonstrated excellence as a top performer in previous roles
  • High energy and driven to continually raise the bar
  • Passionate about social mobility and doing social good
Job Responsibility
Job Responsibility
  • Learn the world-class Multiverse GTM playbook
  • Master MEDDIC to drive and grow your opportunities
  • Drive new business opportunities across our most strategic accounts, connecting with C-level to C-2 business leaders
  • Understand the challenges your prospective customers face related to digital transformation and capacity, capability and diversity, and learn to position the Multiverse solution appropriately
  • Work with our Business Value Consultant team to build and deliver ROI assessments within your accounts to prove the value of the Multiverse solution and close strategic deals
  • Consistently build champions to land new logos as well as to expand within your existing customers and create strategic accounts
What we offer
What we offer
  • 27 days holiday
  • 5 additional days off: 1 life event day, 2 volunteer days, 2 company-wide wellbeing days
  • 8 bank holidays per year
  • Private medical Insurance with Bupa
  • Medical cashback scheme
  • Life insurance
  • Gym membership & wellness resources through Wellhub
  • Access to Spill - all in one mental health support
  • Hybrid work offering
  • Work-from-anywhere scheme - up to 10 days per year
  • Fulltime
Read More
Arrow Right