CrawlJobs Logo
OPULENTSOFT Logo OPULENTSOFT · IT - Administration

Hadoop Administrator

United States, Tampa · Job Posted January 02, 2026
Apply Position
Job Link Share

Requirements

  • Strong in Big Data and Analytical skills – Min 3 Years Exp.
  • Experience in Hadoop cluster administration and configuration
  • Experience in Java and Unix based systems
  • Ability to co-ordinate with multiple technical teams, Business users and Customer
  • Strong communication
  • Strong troubleshooting skills
OPULENTSOFT - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Hadoop Administrator

8 matching positions

Hadoop Administrator

Location
Location
United States , Atlanta
Salary
Salary:
Not provided
logic-loops.com Logo
Logic Loops
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience with the Hadoop stack (HDFS, MapReduce, Hbase, Pig, Hive, Oozie)
  • Extensive experience with Oracle 10g/11g databases and PL/SQL
  • Monitor and review Oracle database instances to identify potential maintenance and tuning issues
  • Expertise in systems administration, Linux tools, configuration management in a large-scale environment
  • Troubleshoot and debug Hadoop ecosystem runtime issues
  • Recover from node failures and troubleshoot common Hadoop cluster issues
  • Document all production scenarios, issues, and resolutions
  • Teamwork in providing hardware architectural guidance, planning, estimating cluster capacity, and creating roadmaps for Hadoop cluster deployment
  • Evaluation of Hadoop infrastructure requirements and design/deploy solutions (i.e., high availability big data clusters, etc.)
  • Expertise in performance tuning, system dump analysis, and storage capacity management
Job Responsibility
Job Responsibility
  • Deploy new Hadoop infrastructure, Hadoop cluster upgrades, cluster maintenance, troubleshooting, capacity planning and resource optimization
  • Review, develop, and implement strategies that preserve the availability, stability, security and scalability of large Hadoop clusters
  • Interact with developers, architects and other operation team members to resolve job performance issues
  • Preparation of architecture, design and operational documentation
  • Participation in weekly on call rotation to provide operational support
Read More
Arrow Right

Hadoop and Bigdata Administrator

You will work in a multi-functional role with a combination of expertise in Syst...
Location
Location
India , Indore, NOIDA
Salary
Salary:
Not provided
clear-trail.com Logo
ClearTrail
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Linux Administration
  • Experience in Python and Shell Scripting
  • Deploying and administering Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem
  • Knowledge of Hadoop core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, REDIS, SPARK etc.
  • Knowledge of HBASE Clusters
Job Responsibility
Job Responsibility
  • Deploying and administering Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem
  • Installing Linux Operating System and Networking
  • Writing Unix SHELL/Ansible Scripting for automation
  • Maintaining core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, REDIS, SPARK, HBASE etc.
  • Takes care of the day-to-day running of Hadoop clusters using Ambari/Cloudera manager/Other monitoring tools, ensuring that the Hadoop cluster is up and running all the time
  • Maintaining HBASE Clusters and capacity planning
  • Maintaining SOLR Cluster and capacity planning
  • Work closely with the database team, network team and application teams to make sure that all the big data applications are highly available and performing as expected
  • Manage KVM Virtualization environment
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to support a long-term contract assignment in...
Location
Location
United States , Beverly Hills
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in data engineering, data migration, system onboarding, or similar project-based data work
  • Strong hands-on ability with structured data sets, spreadsheets, data templates, and ETL-oriented processes
  • Proficiency with Python and experience working with technologies such as Apache Spark, Hadoop, and Kafka
  • Understanding of identity and access management concepts, including users, groups, and directory-based administration in Active Directory
  • Ability to investigate data discrepancies, resolve quality issues, and maintain high levels of accuracy across integrated systems
  • Experience partnering with both technical and non-technical stakeholders, including operational teams such as Facilities
  • Preferred background with access control or identity platforms such as Genea, Okta, CCure, or similar tools
  • Genea expertise with substantial hands-on administrative experience is highly valued
Job Responsibility
Job Responsibility
  • Collaborate with Facilities and cross-functional partners to collect, cleanse, and verify access control information before deployment activities begin
  • Reconcile user, badge, and permission records across legacy tools, Workday, Active Directory, and related platforms to maintain consistent data alignment
  • Build and validate migration files, import templates, and assignment lists needed for loading records into Genea and associated systems
  • Execute data upload activities with internal stakeholders and external vendors, then perform detailed checks to confirm completeness and accuracy
  • Translate site and business access needs into structured mappings that connect users with the appropriate access groups and permissions
  • Coordinate with Identity and Security teams to ensure access group design aligns with Active Directory, Okta, and established governance standards
  • Support go-live and cutover efforts by preparing final data sets, applying last-minute updates, and assisting teams during rollout windows
  • Maintain clear documentation for templates, mappings, validation steps, and repeatable processes while incorporating lessons learned for future deployments
  • Provide post-launch support by troubleshooting data issues, correcting access assignments, and helping sites transition into steady-state operations
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Company 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Python/Pyspark Programmer Analyst - Officer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
United States , Tampa
Salary
Salary:
76560.00 - 106840.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
June 04, 2026
Flip Icon
Requirements
Requirements
  • 0-3 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
  • Hadoop Ecosystem:In-depth understanding of HDFS architecture, data storage, and fault tolerance mechanisms, coupled with experience in HDFS commands and administration
  • Solid understanding of YARN for resource management and job scheduling, and a fundamental grasp of the MapReduce programming paradigm
  • Spark Expertise:Strong proficiency in Spark Core, Spark SQL, and Spark Streaming, with Spark GraphX being a beneficial addition
  • Expert-level programming skills in PySpark for developing Spark applications and extensive experience with Spark performance optimization techniques (e.g., caching, partitioning, shuffle optimizations, memory management)
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower-level analysts
  • Identify problems, analyze information, and make evaluative judgments to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgment and autonomy
  • Acts as SME to senior stakeholders and/or other team members
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
Read More
Arrow Right

Data Platform Engineer

OneTrust’s mission is to enable innovation through the responsible use of data a...
Location
Location
United States , New York
Salary
Salary:
81150.00 - 121725.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering or related field
  • 3+ years of overall experience and 3+ years of experience with very large-scale data warehouse projects
  • Strong experience in SQL, knowledge of dimensional modeling, supporting data warehouse, scaling, optimizing and performance tuning ETL pipelines
  • 1+ years of experience with Python and manipulation of various data formats for extraction and transformation
  • 1+ years of experience with Snowflake, Airflow, ETL/Integration tools administration
  • Hands-on experience with Data Warehouse technologies (Snowflake, Redshift) and Big Data technologies (Hadoop, Hive, Spark, Kafka, Kinesis)
  • Experience evaluating new tools and enriching existing architecture
  • You are a self-starter, hands-on technical expert who continuously gather and synthesize high-impact needs from business partners, design and implement the appropriate technical platform solution, and effectively communicate about deliverables,timelines and tradeoffs
Job Responsibility
Job Responsibility
  • Build and automate modern data platforms (AWS, AZURE, Snowflake) with native technologies, deploy applications, and provision of infrastructure
  • Perform Administration, Maintenance and provide support to production systems (Snowflake, Fivetran, DBT, Power BI, Airflow)
  • Build and maintain CI/CD pipelines and infrastructure as code (IaC) practice across the platform for safe and reproducible deployments
  • Design, build and implement automation framework for scale that deliver data with measurable quality under the SLA
  • Drive technical conversations with stakeholders to understand the platform's needs and come up with a provisioning strategy
  • Work effectively using scrum with multiple team members to deliver value effectively
  • Reduce technical debt over time with root cause identification, issue resolution and promote best practices across the platform
What we offer
What we offer
  • comprehensive healthcare coverage
  • flexible PTO
  • equity RSUs
  • annual performance bonus opportunities
  • retirement account support
  • 14+ weeks of paid parental leave
  • career development opportunities
  • company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Bigdata Platform Admin (Hadoop)

We are looking for a highly skilled and passionate BigData Platform Admin, who a...
Location
Location
United States , Irving
Salary
Salary:
19000.00 USD / Month
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering or a related field
  • 5+ years of experience in big data environment, with a focus on Hadoop
  • Proven experience in a technical leadership or architect role, working closely with both operations and development teams
  • Experience with distributed systems, data processing frameworks (e.g. Spark, Hive) and data warehousing concepts
  • Familiarity with the cloud platforms (eg. AWS, Azure, GCP) and containerization technologies (eg. Dockets, Kebernetes) is a plus
  • Deep understanding of Hadoop ecosystem components (HDFS, YARN, MapReduce, Hive, Spark, Kafka, Etc.)
  • Strong understanding of Spark architecture and core concepts
  • Proficiency in Linux scripting for automation and system management
  • Basic to intermediate proficiency in Python/Scala for scripting and data manipulation
  • Experience with monitoring tools (eg. Grafana, Prometheus) and logging frameworks
Job Responsibility
Job Responsibility
  • Stakeholder Unification: Serve as a single point of contact and unified stakeholder for all Hadoop-related concerns, bridging the gap between platform administrators and application teams
  • Platform Upgrade Management: Review and assess upcoming Hadoop platform upgrades, including new features, libraries and patches
  • Conduct impact analysis on existing applications and services, identifying potential risks and opportunities
  • Coordinate and communicate upgrade schedules and requirements with all relevant teams
  • Technical Feature and Library Evaluation: Identify and evaluate new technical features and libraries within the Hadoop ecosystem that can benefit application teams or improve platform efficiency
  • Propose and advocate for the adoption of new technologies and methodologies to enhance the platform’s capabilities
  • Cluster Health and Optimization: Monitor overall cluster health, performance metrics, and resource utilization
  • Propose and implement optimization strategies to improve cluster efficiency, scalability and cost-effectiveness
  • Collaborate with the admin team to troubleshoot and resolve complex platform-level issues
  • Resource Management and Housekeeping: Oversee and manage the allocation of cluster resources (CPU, memory, storage) across various applications and tenants
  • Fulltime
Read More
Arrow Right

Cloud Solution Architecture - Cloud Infrastructure

Cloud Solution Architecture - Cloud Infrastructure
Location
Location
India , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Prior work experience in a Consulting/Architecture position within a software and/or services company such as Amazon, VMware, Google, IBM, Oracle desired
  • Bachelor’s degree in computer science, Information Technology, Engineering, Business, or related field AND 12+ years’ experience in cloud/infrastructure technologies, information technology (IT) consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or consulting OR Master's Degree in Computer Science, Information Technology, Engineering, Business, or related field AND 8+ years experience in cloud/infrastructure technologies, technology solutions, practice development, architecture, and/or consulting OR equivalent experience
  • 6+ years experience working in a customer-facing role (e.g., internal and/or external)
  • 6+ years experience working on technical projects
  • 5+ years of experience with SQL Server, SQL Server on Azure VMs, Azure SQL DB, and/or Azure SQL Managed Instance, Data Warehouses, Power BI
  • Experience in SQL Server at scale, on-premises to Azure migrations, complex SQL Server troubleshooting, performance tuning and optimization, scaling OLTP and OLAP workloads, and securing SQL Server on-premises or in Azure
  • Technical Certifications in Cloud (e.g., Azure, Azure Data Platform, Power BI, Amazon Web Services, Google, security certifications)
  • Technical experience and knowledge in Enterprise-scale technical experience with On-premises, cloud and hybrid infrastructures, architecture designs, migrations, and technology management
  • Advanced written, spoken English level with direct customer facing experience
  • Note: Microsoft is unable to sponsor a work visa for this role due to the nature of the role’s job duties
Job Responsibility
Job Responsibility
  • Develop relationships with key customer IT and business decision makers, to understand their data estate, priorities, and success measures, and design secure, scalable Data & AI solutions that deliver measurable business value
  • Understand customers’ overall data estate Business and IT priorities and success measures to design Data & Analytics solutions that drive business value and drive positive Customer Satisfaction & become a trusted advisor
  • Ensure that solution exhibits high levels of performance, security, scalability, maintainability, repeatability, appropriate reusability, and reliability upon deployment and provide feedback and insights from customers/partners
  • Develop opportunities to drive Customer Success business results & help Customers get value from their Microsoft investments and identify resolutions to Customer blockers by leveraging subject matter expertise
  • Apply technical knowledge to architect and design solutions that meet business and IT needs, create Data & Analytics roadmaps, drive Proof of Concepts (POC) and Minimal Viable Product (MVP), and ensure long term technical viability of new deployments, infusing key AI technologies where appropriate
  • Maintain technical skills and knowledge, keep up to date with market trends and competitive insights
  • collaborate and share with the AI technical community while educating customers on Azure platform
  • Accelerate customer outcomes - Share expertise, contribute to IP creation & re-use to accelerate customer outcomes and obtain relevant accreditations and certifications
  • Drive Azure consumption through accurate and complete Azure Consumption Plans and support Unified/Factory delivery models
  • Lead technical workshops, build MVPs, and guide customers through production deployments
  • Fulltime
Read More
Arrow Right

Aws Emr Sr. Administrator

We are seeking a highly skilled AWS Administrator to join our team. The ideal ca...
Location
Location
China , Shanghai
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Information Technology, or a related field
  • Proven experience with AWS services, particularly EMR, EC2, S3, and IAM
  • Strong background in administering big data technologies like Hadoop, Spark, Hive, and Presto
  • Experience with Linux/Unix systems administration
  • Experience with AWS services including Glue, Redshift, Lambda, Step Functions, S3, Kafka, KMS, Secrets Manager, IAM
  • Strong understanding of AWS security best practices, including managing IAM roles, KMS, Secrets Manager, and encryption standards
  • Experience with serverless architectures using AWS Lambda and Step Functions
  • Familiarity with data processing, ETL pipelines, and real-time data streaming using AWS Glue and MSK (Kafka)
  • Experience with infrastructure-as-code tools such as Terraform is preferred
  • Strong knowledge of AWS networking concepts, security protocols, and best practices
Job Responsibility
Job Responsibility
  • Deploy, configure, and manage AWS EMR clusters, ensuring optimal performance and scalability
  • Install, configure, and maintain applications running on EMR clusters, such as Hadoop, Spark & Hive
  • Monitor cluster performance and resource utilization, implementing tuning strategies to optimize the performance and cost-efficiency of EMR clusters
  • Implement and manage backup and recovery processes for EMR data and configurations
  • Develop and maintain scripts for automating the deployment and management of EMR clusters and applications
  • Diagnose and resolve issues related to EMR clusters, applications, and data processing jobs
  • Work closely with data engineers, data scientists, and other stakeholders to support their big data processing needs
  • Administer and manage a variety of AWS services including AWS Glue, Amazon Redshift, AWS Lambda, Amazon S3, Amazon MSK (Kafka), KMS, and Secrets Manager to support data processing, storage, security, and compute needs
  • Implement AWS Step Functions to orchestrate workflows and integrate services like Lambda and Glue for end-to-end automation
  • Configure, manage, and optimize S3 buckets for efficient data storage, including setting up lifecycle policies and access controls
  • Fulltime
Read More
Arrow Right