CrawlJobs Logo

Hadoop and Bigdata Administrator

India, Indore, NOIDA · Job Posted January 02, 2026
Apply Position
Job Link Share

Job Description

You will work in a multi-functional role with a combination of expertise in System and Hadoop administration. You will work in a team that often interacts with customers on various aspects related to technical support for deployed system. You will be deputed at customer premises to assist customers for issues related to System and Hadoop administration. You will Interact with QA and Engineering team to co-ordinate issue resolution within the promised SLA to customer.

Job Responsibility

  • Deploying and administering Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem
  • Installing Linux Operating System and Networking
  • Writing Unix SHELL/Ansible Scripting for automation
  • Maintaining core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, REDIS, SPARK, HBASE etc.
  • Takes care of the day-to-day running of Hadoop clusters using Ambari/Cloudera manager/Other monitoring tools, ensuring that the Hadoop cluster is up and running all the time
  • Maintaining HBASE Clusters and capacity planning
  • Maintaining SOLR Cluster and capacity planning
  • Work closely with the database team, network team and application teams to make sure that all the big data applications are highly available and performing as expected
  • Manage KVM Virtualization environment

Requirements

  • Linux Administration
  • Experience in Python and Shell Scripting
  • Deploying and administering Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem
  • Knowledge of Hadoop core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, REDIS, SPARK etc.
  • Knowledge of HBASE Clusters

Nice to have

  • Experience in Networking Concepts
  • Working knowledge of SOLR, Elastic Search
  • Experience in Virtualization technology, KVM, OLVM

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Hadoop and Bigdata Administrator

8 matching positions

Bigdata Platform Admin (Hadoop)

We are looking for a highly skilled and passionate BigData Platform Admin, who a...
Location
Location
United States , Irving
Salary
Salary:
19000.00 USD / Month
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering or a related field
  • 5+ years of experience in big data environment, with a focus on Hadoop
  • Proven experience in a technical leadership or architect role, working closely with both operations and development teams
  • Experience with distributed systems, data processing frameworks (e.g. Spark, Hive) and data warehousing concepts
  • Familiarity with the cloud platforms (eg. AWS, Azure, GCP) and containerization technologies (eg. Dockets, Kebernetes) is a plus
  • Deep understanding of Hadoop ecosystem components (HDFS, YARN, MapReduce, Hive, Spark, Kafka, Etc.)
  • Strong understanding of Spark architecture and core concepts
  • Proficiency in Linux scripting for automation and system management
  • Basic to intermediate proficiency in Python/Scala for scripting and data manipulation
  • Experience with monitoring tools (eg. Grafana, Prometheus) and logging frameworks
Job Responsibility
Job Responsibility
  • Stakeholder Unification: Serve as a single point of contact and unified stakeholder for all Hadoop-related concerns, bridging the gap between platform administrators and application teams
  • Platform Upgrade Management: Review and assess upcoming Hadoop platform upgrades, including new features, libraries and patches
  • Conduct impact analysis on existing applications and services, identifying potential risks and opportunities
  • Coordinate and communicate upgrade schedules and requirements with all relevant teams
  • Technical Feature and Library Evaluation: Identify and evaluate new technical features and libraries within the Hadoop ecosystem that can benefit application teams or improve platform efficiency
  • Propose and advocate for the adoption of new technologies and methodologies to enhance the platform’s capabilities
  • Cluster Health and Optimization: Monitor overall cluster health, performance metrics, and resource utilization
  • Propose and implement optimization strategies to improve cluster efficiency, scalability and cost-effectiveness
  • Collaborate with the admin team to troubleshoot and resolve complex platform-level issues
  • Resource Management and Housekeeping: Oversee and manage the allocation of cluster resources (CPU, memory, storage) across various applications and tenants
  • Fulltime
Read More
Arrow Right

Bigdata Support Lead Engineer

The Lead Data Analytics analyst is responsible for managing, maintaining, and op...
Location
Location
India , Bengaluru; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of total IT experience
  • 5+ years of experience in supporting Hadoop (Cloudera)/big data technologies
  • 5+ years of experience in public cloud infrastructure (AWS or GCP)
  • Experience with Kubernetes and cloud-native technologies
  • Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)
  • Advanced knowledge of the Hadoop ecosystem and Big Data technologies
  • Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
  • Knowledge of troubleshooting techniques for Hive, Spark, YARN, Kafka, and HDFS
  • Advanced Linux system administration and scripting skills (Shell, Python)
  • Experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark with Java or Scala or Python
Job Responsibility
Job Responsibility
  • Lead day to day operation and support for Cloudera Hadoop ecosystem components (HDFS, YARN, Hive, Impala, Spark, HBase, etc)
  • Troubleshoot issues related to data ingestion, job failures, performance degradation and service unavailability
  • Monitor cluster health using Cloudera Manager and respond to alerts, logs, and metrics
  • Collaborate with engineering teams to analyze root causes and implement preventive measures
  • Collaborate patching, service restarts, failovers and rolling restarts for cluster maintenance
  • Assist in user onboarding, access control and issues in accessing the cluster services
  • Contribute to documentation for knowledge base
  • Work on data recovery, replication, and backup support tasks
  • Responsible for moving all legacy workloads to cloud platform
  • Ability to research and assess open-source technologies, public cloud tech stack (AWS/GCP) components to recommend and integrate into the design and implementation
  • Fulltime
Read More
Arrow Right
New

Registered Nurse (RN)

Are you a seasoned RN looking for a new home, a new grad looking to start your c...
Location
Location
United States , Monteagle
Salary
Salary:
Not provided
ltcrevolution.com Logo
Signature HealthCARE, LLC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Possess an Active RN license in the state of residence
  • Current/active CPR Certification
  • Customer service oriented with ability to work well under pressure
  • Strong attention to detail and accuracy, excellent organizational skills with the ability to prioritize, coordinate and simultaneously maintain multiple projects with a high level of quality and productivity
  • Excellent technical, assessment, and documentation skills with the ability to maintain confidentiality
Job Responsibility
Job Responsibility
  • Provide direct and compassionate care to our patients and residents maintaining the highest degree of quality
  • Supervision of day-to-day activities performed by assigned nursing assistants
  • Operate in accordance with Federal, State, and Local Standards, guidelines and regulations and as required by Director of Nursing
  • Confirm that all nursing personnel assigned to you comply with the written policies and procedures established by the facility
What we offer
What we offer
  • Medical, Dental and Vision – Voluntary Life/Disability
  • 401(K) and Roth 401(K)
  • Shift Differentials and Weekend Enhanced Hourly Rates
  • Tuition Forgiveness/Education Reimbursement
  • Uniform Allowance (Seventy-Five Dollars) for first-time newly hired stakeholders and continuous allotment
  • Pay Advance and Next Day Pay
  • Paid Time Off (PTO)
  • Reward & Recognition Program (HEART)
  • VitalLinks
  • Signature Inspire Foundation – providing a safety net for our stakeholders
Read More
Arrow Right
New

Licensed Practical Nurse (Lpn)

Are you a caring LPN looking to make strong connections and an impact on patient...
Location
Location
United States , Prestonsburg
Salary
Salary:
27.86 USD / Hour
ltcrevolution.com Logo
Signature HealthCARE, LLC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Active LPN license in the state of residence
  • Current/active CPR Certification
  • Strong attention to detail and accuracy, excellent organizational skills with the ability to prioritize, coordinate and simultaneously maintain multiple projects with a high level of quality and productivity
  • Excellent technical, assessment, and documentation skills with the ability to maintain confidentiality
Job Responsibility
Job Responsibility
  • Deliver exceptional nursing services to our patients and residents maintaining the highest degree of quality and compassionate care
  • Supervision of day-to-day activities performed by assigned nursing assistants
  • Operate in accordance with Federal, State, and Local Standards, guidelines and regulations and as required by Director of Nursing
  • Confirm that all nursing personnel assigned to you comply with the written policies and procedures established by the facility
What we offer
What we offer
  • Medical, Dental and Vision – Voluntary Life/Disability
  • 401(K) and Roth 401(K)
  • Shift Differentials and Weekend Enhanced Hourly Rates
  • Tuition Forgiveness/Education Reimbursement
  • Uniform Allowance (Seventy-Five Dollars) for first-time newly hired stakeholders and continuous allotment
  • Pay Advance and Next Day Pay
  • Paid Time Off (PTO)
  • Reward & Recognition Program (HEART)
  • VitalLinks
  • Signature Inspire Foundation – providing a safety net for our stakeholders
  • Fulltime
Read More
Arrow Right
New

Registered Nurse (RN)

About Us\n\n\n\nSignature HealthCARE of Memphis is a 140-bed facility that offer...
Location
Location
United States , Memphis
Salary
Salary:
Not provided
ltcrevolution.com Logo
Signature HealthCARE, LLC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Possess an Active RN license in the state of residence
  • Current/active CPR Certification
  • Customer service oriented with ability to work well under pressure
  • Strong attention to detail and accuracy, excellent organizational skills with the ability to prioritize, coordinate and simultaneously maintain multiple projects with a high level of quality and productivity
  • Excellent technical, assessment, and documentation skills with the ability to maintain confidentiality.
Job Responsibility
Job Responsibility
  • Provide direct and compassionate care to our patients and residents maintaining the highest degree of quality
  • Supervision of day-to-day activities performed by assigned nursing assistants
  • Operate in accordance with Federal, State, and Local Standards, guidelines and regulations and as required by Director of Nursing
  • Confirm that all nursing personnel assigned to you comply with the written policies and procedures established by the facility.
What we offer
What we offer
  • Medical, Dental and Vision – Voluntary Life/Disability
  • 401(K) and Roth 401(K)
  • Shift Differentials and Weekend Enhanced Hourly Rates
  • Tuition Forgiveness/Education Reimbursement
  • Uniform Allowance (Seventy-Five Dollars) for first-time newly hired stakeholders and continuous allotment
  • Pay Advance and Next Day Pay
  • Paid Time Off (PTO)
  • Reward & Recognition Program (HEART)
  • VitalLinks
  • Signature Inspire Foundation – providing a safety net for our stakeholders
  • Fulltime
Read More
Arrow Right
New

Wound Care Treatment RN

About Us Signature HealthCARE of Primacy is a 120-bed facility that offers a wi...
Location
Location
United States , Memphis
Salary
Salary:
Not provided
ltcrevolution.com Logo
Signature HealthCARE, LLC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Active RN license in the state of residence
  • Current/active CPR Certification
  • Customer service oriented with ability to work well under pressure
  • Strong attention to detail and accuracy, excellent organizational skills with the ability to prioritize, coordinate and simultaneously maintain multiple projects with a high level of quality and productivity
  • Excellent technical, assessment, and documentation skills with the ability to maintain confidentiality
  • Must be Wound Care Certified
Job Responsibility
Job Responsibility
  • Provide direct and compassionate care to patients and residents maintaining the highest degree of quality
  • Supervision of day-to-day activities performed by assigned nursing assistants
  • Operate in accordance with Federal, State, and Local Standards, guidelines and regulations and as required by Director of Nursing
  • Confirm that all nursing personnel assigned to you comply with the written policies and procedures established by the facility
What we offer
What we offer
  • Medical, Dental and Vision
  • Voluntary Life/Disability
  • 401(K) and Roth 401(K)
  • Shift Differentials and Weekend Enhanced Hourly Rates
  • Tuition Forgiveness/Education Reimbursement
  • Uniform Allowance (Seventy-Five Dollars) for first-time newly hired stakeholders and continuous allotment
  • Pay Advance and Next Day Pay
  • Paid Time Off (PTO)
  • Reward & Recognition Program (HEART)
  • VitalLinks
  • Fulltime
Read More
Arrow Right
New

Senior Application Development Lead-Senior Vice President

As the App Dev Senior Tech Lead Analyst, you will be responsible for the technic...
Location
Location
United States , Tampa
Salary
Salary:
141440.00 - 212160.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
June 23, 2026
Flip Icon
Requirements
Requirements
  • Bachelor's or Master’s degree in Computer Science, Engineering, or a related technical field
  • 10+ years of experience in software engineering, with at least 4+ years in a leadership role, leading high-performing engineering teams
  • Proven experience as a 'player-coach' who can lead from the front, contribute to the codebase, and mentor junior and senior engineers
  • A strong track record of designing, building, and launching scalable, distributed, cloud-native platforms from the ground up
  • Experience in the financial services industry (Corporate Banking, Investment Banking, FinTech) is a significant plus
  • An understanding of banking workflows and data is highly desirable
  • Exceptional ability to communicate complex technical concepts to non-technical stakeholders
  • Bachelor’s degree/University degree or equivalent experience
  • Master’s degree preferred
Job Responsibility
Job Responsibility
  • Lead the design, architecture, and hands-on development of a scalable, secure, and resilient agentic AI platform from concept to production
  • Serve as the lead engineer and technical authority, guiding critical decisions on frameworks, technologies, and infrastructure
  • Write code, build prototypes, and lead by example
  • Partner closely with product management and senior business leaders in banking to define the product strategy and technical roadmap
  • Translate complex business needs into elegant technical solutions
  • Partner effectively with horizontal AI platform teams, enterprise architecture, and external vendor partners
  • Drive the strategy for integrating and operationalizing Large Language Models (LLMs), agentic frameworks, and other AI/ML technologies
  • Implement and champion best-in-class engineering practices
  • Define, measure, and report on key performance indicators (KPIs)
  • Ensure the platform adheres to the highest standards of data privacy, security, and regulatory compliance
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • discretionary and formulaic incentive and retention awards
  • Fulltime
!
Read More
Arrow Right
New

Java Developer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
Canada , Mississauga
Salary
Salary:
79320.00 - 110680.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2-5 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right