CrawlJobs Logo

Hadoop Admin

realign-llc.com Logo

Realign

Location Icon

Location:
United States , Austin

Category Icon
Category:
IT - Administration

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

147500.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

Role: Hadoop Admin. Location: Austin, TX (Onsite). FTE ONLY.

Job Responsibility:

  • Responsible for implementation and ongoing administration of Hadoop infrastructure
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
  • Working with data delivery teams to setup new Hadoop users/applications
  • Cluster maintenance as well as creation and removal of nodes using tools like Ambari and other home-grown tools
  • Performance tuning of Hadoop clusters and Hadoop workloads
  • Screen Hadoop cluster job performances and capacity planning at application/queue level
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files
  • File system management and monitoring
  • HDFS support and maintenance
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
  • Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required
  • Optimize analytical jobs and queries against data in the HDFS/Hive environments
  • Develop considerable bash shell or python scripts, LINUX utilities & LINUX Commands to ease day to day operations
  • Maintain central dashboards for all System, Data, Utilization and availability metrics

Requirements:

  • Performance tuning of Hadoop clusters and Hadoop workloads
  • Screen Hadoop cluster job performances and capacity planning at application/queue level
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files
  • File system management and monitoring
  • Implementation and ongoing administration of Hadoop infrastructure
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
  • Working with data delivery teams to setup new Hadoop users/applications
  • Cluster maintenance as well as creation and removal of nodes using tools like Ambari and other home-grown tools
  • HDFS support and maintenance
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
  • Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required
  • Optimize analytical jobs and queries against data in the HDFS/Hive environments
  • Develop considerable bash shell or python scripts, LINUX utilities & LINUX Commands to ease day to day operations
  • Maintain central dashboards for all System, Data, Utilization and availability metrics

Additional Information:

Job Posted:
March 21, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Realign - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Hadoop Admin

New

Bigdata Platform Admin (Hadoop)

We are looking for a highly skilled and passionate BigData Platform Admin, who a...
Location
Location
United States , Irving
Salary
Salary:
19000.00 USD / Month
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BigData Platform Admin & Strategist
  • Bachelor's or Master's degree in Computer Science, Engineering or a related field
  • 5+ years of experience in big data environment, with a focus on Hadoop
  • Proven experience in a technical leadership or architect role, working closely with both operations and development teams
  • Experience with distributed systems, data processing frameworks (e.g. Spark, Hive) and data warehousing concepts
  • Deep understanding of Hadoop ecosystem components (HDFS, YARN, MapReduce, Hive, Spark, Kafka, Etc.)
  • Strong understanding of Spark architecture and core concepts
  • Proficiency in Linux scripting for automation and system management
  • Basic to intermediate proficiency in Python/Scala for scripting and data manipulation
  • Experience with monitoring tools (eg. Grafana, Prometheus) and logging frameworks
Job Responsibility
Job Responsibility
  • Stakeholder Unification: Serve as a single point of contact and unified stakeholder for all Hadoop-related concerns
  • Platform Upgrade Management: Review and assess upcoming Hadoop platform upgrades
  • Technical Feature and Library Evaluation: Identify and evaluate new technical features and libraries within the Hadoop ecosystem
  • Cluster Health and Optimization: Monitor overall cluster health, performance metrics, and resource utilization
  • Resource Management and Housekeeping: Oversee and manage the allocation of cluster resources
  • Best Practices and Overall Excellence: Define, document and promote best practices for Hadoop application development
  • Solution Proposal and Innovation: Research and propose suitable technical solutions to address emerging business needs
  • Fulltime
Read More
Arrow Right

Bigdata Consultant

The Technical Specialist will be responsible for Medicaid Enterprise Data Wareho...
Location
Location
United States , Columbus
Salary
Salary:
Not provided
oceanbluecorp.com Logo
Ocean Blue Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience with Big Data, Hadoop on Data Warehousing or Data Integration projects
  • Analysis, Design, development, support and Enhancements of ETL/ELT in data warehouse environment with Cloudera Bigdata Technologies (with a minimum of 7 or more years’ experience in Hadoop, MapReduce, Sqoop, PySpark, Spark, HDFS, Hive, Impala, StreamSets, Kudu, Oozie, Hue, Kafka, Yarn, Python, Flume, Zookeeper, Sentry, Cloudera Navigator) along with Oracle SQL/PL-SQL, Unix commands and shell scripting
  • Strong development experience (minimum of 7 or more years) in creating Sqoop scripts, PySpark programs, HDFS commands, HDFS file formats (Parquet, Avro, ORC etc.), StreamSets pipeline creation, jobs scheduling, hive/impala queries, Unix commands, scripting and shell scripting etc.
  • Writing Hadoop/Hive/Impala scripts (minimum of 7 or more years’ experience) for gathering stats on table post data loads
  • Strong SQL experience (Oracle and Hadoop (Hive/Impala etc.))
  • Writing complex SQL queries and performed tuning based on the Hadoop/Hive/Impala explain plan results
  • Proven ability to write high quality code
  • Experience building datasets and familiarity with PHI and PII data
  • Expertise implementing complex ETL/ELT logic
  • Develop and enforce strong reconciliation process
Job Responsibility
Job Responsibility
  • Participate in Team activities, Design discussions, Stand up meetings and planning Review with team
  • Perform data analysis, data profiling, data quality and data ingestion in various layers using big data/Hadoop/Hive/Impala queries, PySpark programs and UNIX shell scripts
  • Follow the organization coding standard document, Create mappings, sessions and workflows as per the mapping specification document
  • Perform Gap and impact analysis of ETL and IOP jobs for the new requirement and enhancements
  • Create jobs in Hadoop using SQOOP, PYSPARK and Stream Sets to meet the business user needs
  • Create mockup data, perform Unit testing and capture the result sets against the jobs developed in lower environment
  • Updating the production support Run book, Control M schedule document as per the production release
  • Create and update design documents, provide detail description about workflows after every production release
  • Continuously monitor the production data loads, fix the issues, update the tracker document with the issues, Identify the performance issues
  • Performance tuning long running ETL/ELT jobs by creating partitions, enabling full load and other standard approaches
  • Fulltime
Read More
Arrow Right

Hadoop Engineer

Role - Hadoop Engineer; Experience - 6+
Location
Location
United States , Bellevue
Salary
Salary:
180000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must Have Technical/Functional Skills: Digital: Big Data and Hadoop Ecosystems, Digital: Kafka, Digital : HBase
  • Required Skills: DEVOPS ENGINEER SENIOR EMAIL SECURITY ENGINEER
Job Responsibility
Job Responsibility
  • Hadoop administration, Cloud Era, AWS, Hortonworks
  • Supporting HDInsight product team in Hadoop Admin support
  • Helping customers in providing resolutions to end customers by resolving the ICM
  • Responsibilities would include – Run prototype to migrate Big-data workloads Performance tuning for Spark, Hive, and Hadoop jobs
  • Troubleshoot production issues, identify the root cause, and provide mitigation
  • Build tools and services to improve debuggability/supportability
  • Monitoring cluster health for top customers and providing support
  • Fulltime
Read More
Arrow Right

OpenText Exstream Developer

This role is responsible for the development, installation, and maintenance of o...
Location
Location
India , Pune
Salary
Salary:
Not provided
cencora.com Logo
Cencora
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands‑on experience in OpenText Exstream 23.x / 24.x / 25.x (CloudNative)
  • Strong experience with XML, Print Miner, columnar and delimited data inputs
  • Expertise in batch and real‑time application design
  • Skilled in creating automated and complex table structures
  • Experience working with barcodes and inserter configurations
  • Proficient in generating outputs: PS, PDF, AFP, Empower, multi‑channel delivery
  • Deep knowledge of rules, formula variables, control files, document/pages setup, design layers, language layers
  • Hands‑on experience with two‑pass application design
  • Knowledge of orchestration workflows
  • Proficient in sorting, bundling, and post‑processing (AFP/PDF)
Job Responsibility
Job Responsibility
  • Develop OpenText Exstream applications
  • Design, implement, unit test, document, and deploy applications/APIs
  • Develop database solutions using SSIS, T‑SQL, and stored procedures
  • Collaborate with business teams to define logical designs aligned with data architecture
  • Perform code reviews, analyze execution plans, and optimize/re-factor code
  • Provide technical guidance to junior software engineers
  • Follow data standards, resolve data issues, perform unit testing, and document ETL processes
  • Assist managers with project documentation, progress tracking, and test plan creation
  • Work with business analysts and source system experts on data extraction & transformation requirements
  • Coordinate with IT operations and testing teams for timely, sustainable releases
  • Fulltime
Read More
Arrow Right
New

Workday Reporting & Analytics Lead

THIS ROLE IS A SENIOR, HANDS-ON WORKDAY REPORTING AND ANALYTICS POSITION FOCUSED...
Location
Location
United States , Sacramento
Salary
Salary:
73.00 - 83.00 USD / Hour
medasource.com Logo
Medasource
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • HANDS-ON WORKDAY REPORTING AND ANALYTICS POSITION FOCUSED ON BUILDING, MAINTAINING, AND OPTIMIZING COMPLEX WORKDAY REPORTS AND DATA INSIGHTS ACROSS HCM AND FINANCE
  • DEEP EXPERIENCE IN ADVANCED REPORTING AND CALCULATED FIELDS
  • NOT INTEGRATION-FOCUSED
  • NOT PRIMARILY WORKDAY STUDIO OR LARGE-SCALE INTEGRATIONS
Job Responsibility
Job Responsibility
  • DESIGN, BUILD, AND MAINTAIN ADVANCED WORKDAY REPORTS, INCLUDING: ADVANCED REPORTS
  • MATRIX REPORTS
  • COMPOSITE REPORTS
  • DASHBOARDS AND OPERATIONAL ANALYTICS
  • DEVELOP AND MANAGE COMPLEX CALCULATED FIELDS, REPORT PROMPTS, AND DATA LOGIC
  • PARTNER CLOSELY WITH HR, FINANCE, AND BUSINESS STAKEHOLDERS TO TRANSLATE REPORTING REQUIREMENTS INTO SCALABLE WORKDAY REPORTING SOLUTIONS
  • SUPPORT OPERATIONAL, COMPLIANCE, AND LEADERSHIP REPORTING NEEDS WITH A STRONG FOCUS ON DATA ACCURACY AND USABILITY
  • OPTIMIZE REPORT PERFORMANCE AND ENSURE DATA CONSISTENCY ACROSS LARGE DATASETS
  • SUPPORT WORKDAY RELEASES AND UPGRADES BY ASSESSING REPORTING IMPACTS AND PERFORMING REGRESSION TESTING
  • PROVIDE LIMITED SUPPORT FOR REPORTING-RELATED DATA EXTRACTS (E.G., RAAS) ONLY WHEN NEEDED
What we offer
What we offer
  • competitive medical
  • dental
  • vision
  • Health Savings Account
  • Dependent Care FSA
  • supplemental coverage
  • 401k plan with company match fully vested after eligibility
  • paid time off
  • sick time
  • paid company holidays
  • Fulltime
Read More
Arrow Right
New

Hgv Class 2 Driver - Regional

You’ll be delivering building materials from our branch to local customers, maki...
Location
Location
United Kingdom , Bristol
Salary
Salary:
Not provided
travisperkins.co.uk Logo
Travis Perkins
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Class 2 driving license
  • Up-to-date CPC records
  • Held a Category B license for 12+ months
  • Customer-focused
  • Safety-focused
Job Responsibility
Job Responsibility
  • Delivering building materials from branch to local customers
  • Loading vehicle with HIAB
  • Making around 14 drops a day
  • Heading back to branch to reload when needed
What we offer
What we offer
  • Sociable hours - no overnight stays or late evenings
  • Full-time, permanent hours employed directly with Travis Perkins
  • Competitive salary plus bonus earning potential you control by driving safely and efficiently (total potential bonus £2,700 per year)
  • Periodic CPC training fully funded and arranged by the branch
  • Staff discounts - 20% off at Toolstation and across Group businesses
  • 22 days holiday plus bank holidays
  • Yearly pay reviews
  • Share schemes
  • Company pension with flexible contribution options
  • Ongoing development with commitment to career progression
  • Fulltime
Read More
Arrow Right
New

Pharmacy Technician

At CVS Health, we are focused on transforming health care for our customers and ...
Location
Location
United States , Cumberland
Salary
Salary:
18.00 - 28.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
June 19, 2026
Flip Icon
Requirements
Requirements
  • Must comply with any state board of pharmacy requirements or laws governing the practice of pharmacy, which includes but is not limited to, age, education, and licensure/certification
  • If the state board of pharmacy does not address or mandate a minimum age requirement, must be at least 16 years of age
  • If the state board of pharmacy does not address or mandate a minimum educational requirement, must have a high school diploma or equivalent, or be actively enrolled in high school or high school equivalency program
  • State-level licensure and national certification requirements vary by state
Job Responsibility
Job Responsibility
  • Living our purpose by following all company SOPs at each workstation to help our Pharmacists manage and improve patient health
  • Following pharmacy workflow procedures at each pharmacy workstation (i.e., production, pick-up, drive-thru, and drop-off) for safe and accurate prescription fulfillment
  • Contributing to positive patient experiences by showing empathy and genuine care: creating heartfelt and personalized moments while serving patients at pick-up, drive-thru, and over the phone
  • keeping patients healthy by offering immunizations and other services at the register and over the phone
  • and demonstrating compassionate care by solving or escalating patient problems
  • Completing basic inventory activities, as permitted by law, and as directed by the pharmacy leadership team, such as accurately putting away medication deliveries and completing cycle counts, returns-to-stocks, waiting bin inventories, etc.
  • Contributing to a high-performing team, embracing a growth mindset, and being receptive to feedback
  • actively seeking opportunities to expand clinical and technical knowledge needed to better assist patients
  • Remaining flexible for both scheduling and business needs, while contributing to a safe, inclusive, and engaging team dynamic
  • voluntarily traveling to stores in the market to work shifts as needed by the business
What we offer
What we offer
  • dental
  • vision
  • wellness resources
  • employee discounts
  • access to certain voluntary benefits
  • other programs
  • Parttime
Read More
Arrow Right
New

Mobile Associate, Store-In-Store, Retail Sales

Mobile Associates, Store-in-Store are an integral part of the Retail Team respon...
Location
Location
United States , Eagan
Salary
Salary:
19.50 - 20.00 USD / Hour
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School Diploma/GED (Required)
  • 6 months of customer service and/or sales experience, Retail environment preferred
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Proactively engages with customers in a high-traffic retail environment
  • Uses digital tools and solution-based selling to recommend T-Mobile products and services
  • Completes training and reviews personal results and promotions
  • Provides exceptional customer service and builds relationships
  • Builds relationships with nearby leadership and teams
What we offer
What we offer
  • medical insurance
  • dental insurance
  • vision insurance
  • flexible spending account
  • 401(k)
  • employee stock grants
  • employee stock purchase plan
  • paid time off
  • up to 12 paid holidays
  • paid parental and family leave
  • Parttime
Read More
Arrow Right