CrawlJobs Logo

Hadoop and Bigdata Administrator

India, Indore, NOIDA · Job Posted January 02, 2026
Apply Position
Job Link Share

Job Description

You will work in a multi-functional role with a combination of expertise in System and Hadoop administration. You will work in a team that often interacts with customers on various aspects related to technical support for deployed system. You will be deputed at customer premises to assist customers for issues related to System and Hadoop administration. You will Interact with QA and Engineering team to co-ordinate issue resolution within the promised SLA to customer.

Job Responsibility

  • Deploying and administering Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem
  • Installing Linux Operating System and Networking
  • Writing Unix SHELL/Ansible Scripting for automation
  • Maintaining core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, REDIS, SPARK, HBASE etc.
  • Takes care of the day-to-day running of Hadoop clusters using Ambari/Cloudera manager/Other monitoring tools, ensuring that the Hadoop cluster is up and running all the time
  • Maintaining HBASE Clusters and capacity planning
  • Maintaining SOLR Cluster and capacity planning
  • Work closely with the database team, network team and application teams to make sure that all the big data applications are highly available and performing as expected
  • Manage KVM Virtualization environment

Requirements

  • Linux Administration
  • Experience in Python and Shell Scripting
  • Deploying and administering Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem
  • Knowledge of Hadoop core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, REDIS, SPARK etc.
  • Knowledge of HBASE Clusters

Nice to have

  • Experience in Networking Concepts
  • Working knowledge of SOLR, Elastic Search
  • Experience in Virtualization technology, KVM, OLVM

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Hadoop and Bigdata Administrator

8 matching positions

Bigdata Support Lead Engineer

The Lead Data Analytics analyst is responsible for managing, maintaining, and op...
Location
Location
India , Bengaluru; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of total IT experience
  • 5+ years of experience in supporting Hadoop (Cloudera)/big data technologies
  • 5+ years of experience in public cloud infrastructure (AWS or GCP)
  • Experience with Kubernetes and cloud-native technologies
  • Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)
  • Advanced knowledge of the Hadoop ecosystem and Big Data technologies
  • Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
  • Knowledge of troubleshooting techniques for Hive, Spark, YARN, Kafka, and HDFS
  • Advanced Linux system administration and scripting skills (Shell, Python)
  • Experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark with Java or Scala or Python
Job Responsibility
Job Responsibility
  • Lead day to day operation and support for Cloudera Hadoop ecosystem components (HDFS, YARN, Hive, Impala, Spark, HBase, etc)
  • Troubleshoot issues related to data ingestion, job failures, performance degradation and service unavailability
  • Monitor cluster health using Cloudera Manager and respond to alerts, logs, and metrics
  • Collaborate with engineering teams to analyze root causes and implement preventive measures
  • Collaborate patching, service restarts, failovers and rolling restarts for cluster maintenance
  • Assist in user onboarding, access control and issues in accessing the cluster services
  • Contribute to documentation for knowledge base
  • Work on data recovery, replication, and backup support tasks
  • Responsible for moving all legacy workloads to cloud platform
  • Ability to research and assess open-source technologies, public cloud tech stack (AWS/GCP) components to recommend and integrate into the design and implementation
  • Fulltime
Read More
Arrow Right

Bigdata Platform Admin (Hadoop)

We are looking for a highly skilled and passionate BigData Platform Admin, who a...
Location
Location
United States , Irving
Salary
Salary:
19000.00 USD / Month
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering or a related field
  • 5+ years of experience in big data environment, with a focus on Hadoop
  • Proven experience in a technical leadership or architect role, working closely with both operations and development teams
  • Experience with distributed systems, data processing frameworks (e.g. Spark, Hive) and data warehousing concepts
  • Familiarity with the cloud platforms (eg. AWS, Azure, GCP) and containerization technologies (eg. Dockets, Kebernetes) is a plus
  • Deep understanding of Hadoop ecosystem components (HDFS, YARN, MapReduce, Hive, Spark, Kafka, Etc.)
  • Strong understanding of Spark architecture and core concepts
  • Proficiency in Linux scripting for automation and system management
  • Basic to intermediate proficiency in Python/Scala for scripting and data manipulation
  • Experience with monitoring tools (eg. Grafana, Prometheus) and logging frameworks
Job Responsibility
Job Responsibility
  • Stakeholder Unification: Serve as a single point of contact and unified stakeholder for all Hadoop-related concerns, bridging the gap between platform administrators and application teams
  • Platform Upgrade Management: Review and assess upcoming Hadoop platform upgrades, including new features, libraries and patches
  • Conduct impact analysis on existing applications and services, identifying potential risks and opportunities
  • Coordinate and communicate upgrade schedules and requirements with all relevant teams
  • Technical Feature and Library Evaluation: Identify and evaluate new technical features and libraries within the Hadoop ecosystem that can benefit application teams or improve platform efficiency
  • Propose and advocate for the adoption of new technologies and methodologies to enhance the platform’s capabilities
  • Cluster Health and Optimization: Monitor overall cluster health, performance metrics, and resource utilization
  • Propose and implement optimization strategies to improve cluster efficiency, scalability and cost-effectiveness
  • Collaborate with the admin team to troubleshoot and resolve complex platform-level issues
  • Resource Management and Housekeeping: Oversee and manage the allocation of cluster resources (CPU, memory, storage) across various applications and tenants
  • Fulltime
Read More
Arrow Right
New

Mobile Associate, Store-in-Store, Retail Sales

Mobile Associates, Store-in-Store are an integral part of the Retail Team respon...
Location
Location
United States , Wichita
Salary
Salary:
18.00 - 20.00 USD / Hour
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School Diploma/GED (Required)
  • 6 months of customer service and/or sales experience, Retail environment preferred
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Proactively engages with a broad range of customers in a highly-traffic retail environment
  • Consistently leverage digital self-serve tools during customer interactions and the onboarding process
  • Identify customer needs and use solution-based selling techniques to fully demonstrate the value of T-Mobile products and services
  • Complete training on the T-Mobile in-store experience, new skills, products and processes, and knowledge of systems and reference resources
  • Review personal results, current promotions, and updates on the Hub to be Customer Ready at all times
  • Partner with nearby store locations to properly/fully on-board customers
  • Carry keys to the kiosk cabinets, lock/secure kiosk and assets, and report any lost keys or assets to your manager
  • Proactively reach out to potential customers to further drive sales activity in your location
  • Follow up with customers, capture referrals, manage Be Back processes, and build relationships with new and existing customers
  • Perform price overrides for our specialty offers specific to National Retail
What we offer
What we offer
  • Medical, dental and vision insurance
  • Flexible spending account
  • 401(k)
  • Employee stock grants
  • Employee stock purchase plan
  • Paid time off and up to 12 paid holidays
  • Paid parental and family leave
  • Family building benefits
  • Back-up care
  • Enhanced family support
  • Parttime
Read More
Arrow Right
New

Senior Care Assistant

Bluebell House: Come and be part of the great Stonehaven team in a home from hom...
Location
Location
United Kingdom , Westward Ho!
Salary
Salary:
13.68 - 14.83 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You already need to have the right to work in the UK as the Company is unable to provide sponsorship for this post
Job Responsibility
Job Responsibility
  • Set high standards for themselves and be active members of the care team
  • behave in a positive manner at all times, putting the best interests of the residents in their care at the heart of all that they do
What we offer
What we offer
  • Comprehensive training package
  • competitive rates of pay including elements of enhancements
  • Fulltime
Read More
Arrow Right
New

Year 1 Supply Teacher

Year 1 Supply Teacher | KS1 Specialist | Local Primary Schools Position: Full-T...
Location
Location
United Kingdom , Swindon
Salary
Salary:
140.00 - 233.00 GBP / Day
https://www.randstad.com Logo
Randstad
Expiration Date
June 24, 2026
Flip Icon
Requirements
Requirements
  • Hold QTS: You have Qualified Teacher Status (QTS) or an equivalent recognised teaching qualification
  • Are a KS1 Specialist: You have a deep understanding of the Year 1 curriculum and the developmental needs of 5 and 6-year-olds
  • Are Adaptable: You can walk into a new classroom and instantly command respect and curiosity through high-energy teaching
  • Are Committed: You hold an enhanced DBS on the update service (or are willing to apply) and are 100% dedicated to Safeguarding
Job Responsibility
Job Responsibility
  • Deliver engaging, age-appropriate lessons that bridge the gap between play-based learning and KS1 structure
  • Utilise your knowledge of Phonics (e.g., Read Write Inc, Jolly Phonics, or Little Wandle) to boost reading confidence
  • Quickly build rapport with new groups of children, maintaining a calm, productive, and safe learning environment
  • Differentiate tasks on the fly to support pupils with diverse needs, ensuring every child stays on track with the day's objectives
What we offer
What we offer
  • Training and education
  • Safeguarding & Prevent
  • Referral Bonus
Read More
Arrow Right
New

Sr. Administrative Associate – Radiology

At Boston Children’s Hospital, the quality of our care – and our inclusive hospi...
Location
Location
United States , Boston
Salary
Salary:
20.63 - 31.46 USD / Hour
childrenshospital.org Logo
Boston Children's Hospital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A high school level of education
  • Two years of related experience
  • Prior customer service or administrative experience preferred
  • Analytical skills to resolve problems that require the use of basic scientific, mathematical, or technical principles
  • Ability to communicate effectively both orally and in writing, and provide empathy in difficult interpersonal situations.
Job Responsibility
Job Responsibility
  • Leads and directs secretarial, clerical, and administrative support services
  • Plans work schedules to ensure coverage and compliance with hospital and departmental policies
  • Develops and maintains office systems, procedures, and policies
  • Oversees departmental recordkeeping for sensitive administrative and financial data
  • Manages database input, report generation, and data accuracy
  • Evaluates and implements system updates as needed
  • Manages daily administrative operations, including personnel records and regulatory reporting
  • Processes administrative forms such as purchase orders, payment requests, and reappointment documents
  • Assists with departmental fellowship, residency, and training programs
  • Assists with Radiologist CVs and oversees credentialing, licensure, and related documentation
What we offer
What we offer
  • flexible schedules
  • affordable health, vision and dental insurance
  • child care and student loan subsidies
  • generous levels of time off
  • 403(b) Retirement Savings plan
  • Pension
  • Tuition and certain License and Certification Reimbursement
  • cell phone plan discounts
  • discounted rates on T-passes
  • Fulltime
Read More
Arrow Right
New

Fin Solutions Lead Analyst

Citibank, N.A. seeks a Financial Solutions Lead Analyst for its Tampa, Florida l...
Location
Location
United States , Tampa
Salary
Salary:
121909.00 - 153600.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
July 07, 2026
Flip Icon
Requirements
Requirements
  • Requires a Master’s degree, or foreign equivalent, in Management Information Systems or related field and 4 years of experience as a Financial Solutions Lead Analyst, Data Quality Analytics and Reporting Lead Analyst, Risk Reporting Officer, Technology Lead, Consultant, Business Lead Analyst, Assistant Manager or related position supporting enterprise level technology initiatives within the financial services industry. Alternatively, employer will accept a Bachelor’s degree in the listed fields and 6 years of the specified progressively responsible, post-baccalaureate experience in the listed positions. Full span of experience must include: Migrating legacy reporting workflows into automated, scalable solutions
  • Project Management
  • Agile Project Management, Scrum Methodology and Release Management
  • JIRA, SQL
  • Risk management, in including risk metrics, risk governance, risk reporting and related data and technology infrastructure
  • Preparing reports for regulatory agencies including the Federal Reserve Board
  • Data governance including development of control processes
  • and Identifying optimization opportunities and performance tuning of queries.
Job Responsibility
Job Responsibility
  • Responsible for release management, delivery, and support of all aspects of project execution for each release. Liaised with business testing and technology testing coordinators, as well as with stakeholders and senior management. Serve as the product owner for the Insight Reporting Platform thus leading critical initiatives while driving enhancements and innovation. Lead requirement gathering, backlog management and sprint execution while collaborating with technology leaders, operations and regulatory teams to deliver compliant, high-quality reporting solutions. Translate complex business needs into clear, actionable user stories (JIRA) and ensuring alignment between design, development and strategic objectives. Manage product-increments, oversee UAT, resolve issues and impediments in addition to coordinating dependencies across cross-functional teams. Lead process modernization by standardizing and streamlining legacy reporting workflows into scalable, automated solutions. Enable consistent delivery, improved data quality, and adherence to regulatory mandate, ensuring each release advances the platforms overall efficiency and integrity. Provide status updates, leading scrum calls and communicating with senior management ensuring a well-defined roadmap is articulated and understood, while resolving and escalating impediments with the scrum master.
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
Read More
Arrow Right
New

Accounts Payable Specialist

We are looking for an Accounts Payable Specialist to join a fast-paced finance t...
Location
Location
United States , Houston
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 2 years of experience in accounts payable or a closely related accounting support role
  • Practical knowledge of full-cycle accounts payable in a high-volume processing environment
  • Experience using QuickBooks Online for invoice handling, payment processing, and vendor management
  • Strong Excel skills with the ability to organize data, review details, and support reconciliations
  • Familiarity with invoice coding, check processing, wire payments, and expense report review
  • Understanding of W-9 documentation and 1099 reporting support requirements
  • Clear communication skills and a collaborative approach when working with vendors and cross-functional teams
  • Formal education in accounting, finance, or a related area is welcomed, though a degree is not required
Job Responsibility
Job Responsibility
  • Manage the full accounts payable cycle, including invoice review, coding, entry, and timely payment processing
  • Prepare and process payment activity such as check runs and wire transactions while maintaining accurate supporting documentation
  • Review employee expense submissions for accuracy, policy compliance, and proper accounting treatment
  • Reconcile accounts payable subledger balances to the general ledger and investigate variances to ensure accurate financial reporting
  • Support month-end activities by assisting with accrual entries and resolving outstanding payable items
  • Communicate with vendors to address billing questions, payment status inquiries, and documentation needs in a thorough manner
  • Maintain and validate vendor records, including collection and tracking of W-9 forms and support for 1099 reporting requirements
  • Contribute to account cleanup efforts by correcting discrepancies, organizing records, and improving the accuracy of payable data
What we offer
What we offer
  • Medical
  • Vision
  • Dental
  • Life and disability insurance
  • 401(k) plan
  • Free online training
Read More
Arrow Right