CrawlJobs Logo

Hadoop Admin

realign-llc.com Logo

Realign

Location Icon

Location:
United States , Austin

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

147500.00 USD / Year

Job Description:

Role: Hadoop Admin. Location: Austin, TX (Onsite). FTE ONLY.

Job Responsibility:

  • Responsible for implementation and ongoing administration of Hadoop infrastructure
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
  • Working with data delivery teams to setup new Hadoop users/applications
  • Cluster maintenance as well as creation and removal of nodes using tools like Ambari and other home-grown tools
  • Performance tuning of Hadoop clusters and Hadoop workloads
  • Screen Hadoop cluster job performances and capacity planning at application/queue level
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files
  • File system management and monitoring
  • HDFS support and maintenance
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
  • Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required
  • Optimize analytical jobs and queries against data in the HDFS/Hive environments
  • Develop considerable bash shell or python scripts, LINUX utilities & LINUX Commands to ease day to day operations
  • Maintain central dashboards for all System, Data, Utilization and availability metrics

Requirements:

  • Performance tuning of Hadoop clusters and Hadoop workloads
  • Screen Hadoop cluster job performances and capacity planning at application/queue level
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files
  • File system management and monitoring
  • Implementation and ongoing administration of Hadoop infrastructure
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
  • Working with data delivery teams to setup new Hadoop users/applications
  • Cluster maintenance as well as creation and removal of nodes using tools like Ambari and other home-grown tools
  • HDFS support and maintenance
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
  • Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required
  • Optimize analytical jobs and queries against data in the HDFS/Hive environments
  • Develop considerable bash shell or python scripts, LINUX utilities & LINUX Commands to ease day to day operations
  • Maintain central dashboards for all System, Data, Utilization and availability metrics

Additional Information:

Job Posted:
March 21, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Hadoop Admin

Bigdata Consultant

The Technical Specialist will be responsible for Medicaid Enterprise Data Wareho...
Location
Location
United States , Columbus
Salary
Salary:
Not provided
oceanbluecorp.com Logo
Ocean Blue Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience with Big Data, Hadoop on Data Warehousing or Data Integration projects
  • Analysis, Design, development, support and Enhancements of ETL/ELT in data warehouse environment with Cloudera Bigdata Technologies (with a minimum of 7 or more years’ experience in Hadoop, MapReduce, Sqoop, PySpark, Spark, HDFS, Hive, Impala, StreamSets, Kudu, Oozie, Hue, Kafka, Yarn, Python, Flume, Zookeeper, Sentry, Cloudera Navigator) along with Oracle SQL/PL-SQL, Unix commands and shell scripting
  • Strong development experience (minimum of 7 or more years) in creating Sqoop scripts, PySpark programs, HDFS commands, HDFS file formats (Parquet, Avro, ORC etc.), StreamSets pipeline creation, jobs scheduling, hive/impala queries, Unix commands, scripting and shell scripting etc.
  • Writing Hadoop/Hive/Impala scripts (minimum of 7 or more years’ experience) for gathering stats on table post data loads
  • Strong SQL experience (Oracle and Hadoop (Hive/Impala etc.))
  • Writing complex SQL queries and performed tuning based on the Hadoop/Hive/Impala explain plan results
  • Proven ability to write high quality code
  • Experience building datasets and familiarity with PHI and PII data
  • Expertise implementing complex ETL/ELT logic
  • Develop and enforce strong reconciliation process
Job Responsibility
Job Responsibility
  • Participate in Team activities, Design discussions, Stand up meetings and planning Review with team
  • Perform data analysis, data profiling, data quality and data ingestion in various layers using big data/Hadoop/Hive/Impala queries, PySpark programs and UNIX shell scripts
  • Follow the organization coding standard document, Create mappings, sessions and workflows as per the mapping specification document
  • Perform Gap and impact analysis of ETL and IOP jobs for the new requirement and enhancements
  • Create jobs in Hadoop using SQOOP, PYSPARK and Stream Sets to meet the business user needs
  • Create mockup data, perform Unit testing and capture the result sets against the jobs developed in lower environment
  • Updating the production support Run book, Control M schedule document as per the production release
  • Create and update design documents, provide detail description about workflows after every production release
  • Continuously monitor the production data loads, fix the issues, update the tracker document with the issues, Identify the performance issues
  • Performance tuning long running ETL/ELT jobs by creating partitions, enabling full load and other standard approaches
  • Fulltime
Read More
Arrow Right
New

Hadoop Engineer

Role - Hadoop Engineer; Experience - 6+
Location
Location
United States , Bellevue
Salary
Salary:
180000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must Have Technical/Functional Skills: Digital: Big Data and Hadoop Ecosystems, Digital: Kafka, Digital : HBase
  • Required Skills: DEVOPS ENGINEER SENIOR EMAIL SECURITY ENGINEER
Job Responsibility
Job Responsibility
  • Hadoop administration, Cloud Era, AWS, Hortonworks
  • Supporting HDInsight product team in Hadoop Admin support
  • Helping customers in providing resolutions to end customers by resolving the ICM
  • Responsibilities would include – Run prototype to migrate Big-data workloads Performance tuning for Spark, Hive, and Hadoop jobs
  • Troubleshoot production issues, identify the root cause, and provide mitigation
  • Build tools and services to improve debuggability/supportability
  • Monitoring cluster health for top customers and providing support
  • Fulltime
Read More
Arrow Right

OpenText Exstream Developer

This role is responsible for the development, installation, and maintenance of o...
Location
Location
India , Pune
Salary
Salary:
Not provided
cencora.com Logo
Cencora
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands‑on experience in OpenText Exstream 23.x / 24.x / 25.x (CloudNative)
  • Strong experience with XML, Print Miner, columnar and delimited data inputs
  • Expertise in batch and real‑time application design
  • Skilled in creating automated and complex table structures
  • Experience working with barcodes and inserter configurations
  • Proficient in generating outputs: PS, PDF, AFP, Empower, multi‑channel delivery
  • Deep knowledge of rules, formula variables, control files, document/pages setup, design layers, language layers
  • Hands‑on experience with two‑pass application design
  • Knowledge of orchestration workflows
  • Proficient in sorting, bundling, and post‑processing (AFP/PDF)
Job Responsibility
Job Responsibility
  • Develop OpenText Exstream applications
  • Design, implement, unit test, document, and deploy applications/APIs
  • Develop database solutions using SSIS, T‑SQL, and stored procedures
  • Collaborate with business teams to define logical designs aligned with data architecture
  • Perform code reviews, analyze execution plans, and optimize/re-factor code
  • Provide technical guidance to junior software engineers
  • Follow data standards, resolve data issues, perform unit testing, and document ETL processes
  • Assist managers with project documentation, progress tracking, and test plan creation
  • Work with business analysts and source system experts on data extraction & transformation requirements
  • Coordinate with IT operations and testing teams for timely, sustainable releases
  • Fulltime
Read More
Arrow Right
New

Accounting and Business Operations Manager

The individual in this position is responsible to collaborate and oversight with...
Location
Location
United States , Phoenix
Salary
Salary:
Not provided
real-time-consulting.com Logo
Real Time Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Accounting
  • 10+ Years relevant and proven work experience in a corporate environment in an Accounting Manager role with same level of responsibilities
  • Strong understanding of accounting, finance, and management principles
  • Experienced knowledge of audit preparation and document retention requirements
  • 5+ years of Payroll processing
  • Strong experience with evaluating, developing, and improving department controls, systems, and procedures that increase accuracy and efficiency
  • Knowledge of QuickBooks a big PLUS
  • Experience in writing and assessing Policies and Procedures for Accounting
  • Intermediate user of MS Word, MS Outlook
  • Advanced user of MS Excel (pivot tables, linking, charting)
Job Responsibility
Job Responsibility
  • Managing and conducting efforts supporting month end & year-end close preparations
  • Review and/or preparation forecasts, analysis, project proforma and actual to budget comparisons
  • Maintaining accurate and complete financial records and participating in reconciliations and audits
  • Overseeing the daily activities of the accounting department and ensuring that all major projects, month-end, and year-end reports are completed accurately and on time
  • Qtly tax filings reconciliations and out of state filing and payment audits (collaborate with the PR company who completes them)
  • Worker’s Compensation Insurance plan administration – renewals and annual Audits
  • Oversight and audit the AP and cost processes and activities
  • Investigate and resolve discrepancies in all expense accounts under tight deadlines
  • Identify any process and procedure inefficiency and collaborate on solution implementations
  • Vendor management and service contracts renewals
What we offer
What we offer
  • 2 weeks PTO
  • 8 Holidays
  • Insurance Benefits =>Health 90%/ Dental 100%/ Vision 100%
  • 401K plan
  • flexible schedule
  • professional office environment, with casual attire
  • virtual work structure during Covid restrictions
  • Fulltime
Read More
Arrow Right
New

Sr. Technical Program Manager, Servicenow

This role is a Senior Technical Program Manager within the ServiceNow Engineerin...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 4+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 2+ years of experience managing cross-functional and/or cross-team projects
Job Responsibility
Job Responsibility
  • Own the product strategy and roadmap for Incident Management, Request Fulfillment / Service Catalog, and Change Management within the ServiceNow platform, aligned to operational priorities and platform guardrails
  • Partner with IT Operations, Service Engineering, and End Users to identify systemic pain points, define requirements, and prioritize capabilities that improve reliability, consistency, and operator experience
  • Translate operational needs into clear product requirements, including user stories, acceptance criteria, and success metrics, enabling engineering teams to deliver scalable, maintainable solutions
  • Design and evolve standardized workflows and experiences across teams and domains, reducing fragmentation and ensuring consistent execution of ITSM processes at scale
  • Leverage automation and AI capabilities within ServiceNow to increase efficiency, reduce manual effort, and support growth without proportional increases in operational load
  • Measure success through outcomes, including platform stability, reduced operational friction, improved fulfillment and resolution times, and adoption of standardized workflows
  • Fulltime
Read More
Arrow Right
New

Early Years Teaching Assistant

A welcoming and inclusive primary school in North West London is seeking a dedic...
Location
Location
United Kingdom , Barnet
Salary
Salary:
Not provided
philosophyeducation.co.uk Logo
Philosophy Education
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working with children in EYFS (school or nursery setting)
  • Strong understanding of early language development
  • A patient, caring and proactive approach
  • Excellent communication and teamwork skills
Job Responsibility
Job Responsibility
  • Supporting the class teacher with the day-to-day running of the Reception classroom
  • Delivering small-group and one-to-one support, particularly in speech, language, and communication development
  • Assisting with phonics sessions and early literacy development
  • Helping to create a warm, stimulating and safe learning environment
  • Monitoring and recording pupils’ progress and feeding back to the teaching team
  • Fulltime
Read More
Arrow Right
New

FLEX Senior Network Observability Engineer

The Senior Network Observability Engineer, Network Reliability Engineering (NRE)...
Location
Location
United States , Bethesda
Salary
Salary:
48.26 - 82.54 USD / Hour
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
March 26, 2026
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Network Engineering, or related discipline
  • advanced certifications (CCNP, AWS and Azure Networking Specialty) strongly preferred
  • 8+ years of progressive experience in network observability, telemetry engineering, and performance optimization for large-scale, mission-critical environments
  • Proven expertise in collecting, processing, and correlating telemetry data (NetFlow, IPFIX, SNMP, streaming telemetry) to enable predictive analytics and proactive incident prevention
  • Hands-on experience with enterprise-grade observability, Saas and Security platforms, including Selector.ai, NetScout, NetBrain, ThousandEyes, BigPanda, and other AI/ML-driven monitoring solutions
  • Demonstrated ability to install, configure, and optimize observability tools, integrate APIs, and build automation workflows for anomaly detection and remediation
  • Strong proficiency in administration of network tools and policy enforcement, including role-based access control and compliance frameworks
  • Expertise in developing observability requirements, architecture designs, and implementation roadmaps, ensuring alignment with SRE principles and Agile delivery models
  • Deep understanding of foundational networking protocols and technologies (ARP, TCP/IP, UDP, DHCP, DNS, NAT) and advanced routing protocols (OSPF, BGP)
  • Hands on experience with Palo, Prisma, and SDWAN Strata Cloud Manager, Including routing and switching platforms (Cisco, Juniper, HP/Aruba)
Job Responsibility
Job Responsibility
  • Designing and implementing the Network Observability strategy and platforms for the next-gen operations and engineering for all Marriott International (MI) networks including the Property Networks, Datacenter, Corporate and Client Networks and multi-cloud environments into a proactive, telemetry-driven ecosystem
  • Work closely and collaboratively with a matrix team of expert network architects and engineers to drive adoption of SRE practices and operating models across all network product towers, and around globe
  • Architect solutions that leverage AI/ML-driven insights, real-time telemetry, and automation frameworks to predict, prevent, and resolve network issues before they impact business operations
  • Collaborate with network architects, product owners, and global operations teams to define and enforce observability standards, build automation pipelines, and deliver actionable intelligence across thousands of properties worldwide
  • Overcome the limitations of traditional monitoring and implement granular instrumentation, distributed tracing, and anomaly detection at scale
What we offer
What we offer
  • 401(k) plan
  • stock purchase plan
  • discounts at Marriott properties
  • commuter benefits
  • employee assistance plan
  • childcare discounts
  • medical coverage
  • dental coverage
  • vision coverage
  • health care flexible spending account
  • Fulltime
!
Read More
Arrow Right
New

Physical Therapy Aide

Join a collaborative team dedicated to delivering exceptional patient care as a ...
Location
Location
United States , Aberdeen
Salary
Salary:
17.25 - 19.00 USD / Hour
atipt.com Logo
ATI Physical Therapy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School diploma
  • Must be 18+ years
  • Healthcare and/or customer service experience
Job Responsibility
Job Responsibility
  • Greet and interact with patients warmly both by phone and in person during the daily check-in process and throughout their appointment time
  • Promote an efficient patient intake and registration process and assist clinicians with timely scheduling
  • Effectively onboard new patients reviewing relevant paperwork, verifying benefits, and completion of medical forms
  • Support Physical Therapist by preparing and cleaning treatment areas, as well as setting up and adjusting exercise equipment
  • Monitor patient progress and provide feedback the therapy team
  • Assist patients in performing exercises and support their prescribed home exercise programs
What we offer
What we offer
  • Paid Time Off: Generous PTO, holiday pay, CEU, and “Be Well Days”
  • Medical, Dental & Vision Coverage: Flexible plan options
  • 401(k) Match: Competitive employer matching
  • Childcare Tuition Assistance: Discounted rates
  • Health Savings & Flexible Spending Accounts: Tax-saving options
  • Short- & Long-Term Disability: 100% employer paid income protection plans
  • Life Insurance: Employer-paid and voluntary options
  • Parental Leave & Adoption Assistance: Paid time for new parents and support for adoption costs
  • Wellness Programs: Including weight-loss and lifestyle coaching, digital mental-health support, and 24/7 virtual telehealth access
  • Corporate Discounts: Exclusive deals for employees
  • Fulltime
Read More
Arrow Right