CrawlJobs Logo

Sr Big Data Engineer - Oozie and Pig (GCP)

rackspace.com Logo

Rackspace

Location Icon

Location:
United States

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

116100.00 - 198440.00 USD / Year

Job Description:

We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven track record of writing production-grade code and building robust data workflows. This is a fully remote position and requires an independent, self-driven engineer who thrives in complex technical environments and communicates effectively across teams.

Job Responsibility:

  • Design and develop scalable batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, MapReduce, and HBase, with hands-on coding in Java or Python (Java is a must)
  • Must be able to lead Jira Epics
  • Write clean, efficient, and production-ready code with a strong focus on data structures and algorithmic problem-solving applied to real-world data engineering tasks
  • Develop, manage, and optimize complex data workflows within the Apache Hadoop ecosystem, with a strong focus on Oozie orchestration and job scheduling
  • Leverage Google Cloud Platform (GCP) tools such as Dataproc, GCS, and Composer to build scalable and cloud-native big data solutions
  • Implement DevOps and automation best practices, including CI/CD pipelines, infrastructure as code (IaC), and performance tuning across distributed systems
  • Collaborate with cross-functional teams to ensure data pipeline reliability, code quality, and operational excellence in a remote-first environment

Requirements:

  • Bachelor's degree in Computer Science, software engineering or related field of study
  • Experience with managed cloud services and understanding of cloud-based batch processing systems
  • Proficiency in Oozie, Airflow, Map Reduce, Java
  • Strong programming skills with Java (specifically Spark), Python, Pig, and SQL
  • Expertise in public cloud services, particularly in GCP
  • Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce
  • Familiarity with BigTable and Redis
  • Experienced in Infrastructure and Applied DevOps principles in daily work
  • Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform
  • Proven experience in engineering batch processing systems at scale
  • 5+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with “on-premises to cloud” migrations or IT transformations
  • 5+ years of experience building, and operating solutions built on GCP
  • Proficiency in Oozie and Pig
  • Must be able to lead Jira Epics
  • Proficiency in Java or Python

Additional Information:

Job Posted:
January 05, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Sr Big Data Engineer - Oozie and Pig (GCP)

New

Automotive Technician/Mechanic

Elite Acura is part of the fast growing Group 1 Automotive, a leader in automoti...
Location
Location
United States , Maple Shade
Salary
Salary:
16.20 - 52.88 USD / Hour
Group 1 Automotive
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Automotive technician or mechanic experience
  • A Positive & Friendly Attitude
  • Tools based on your experience
  • Communication Skills
  • Basic Computer Skills
  • Ability to Achieve Targeted Goals
  • High School Diploma or Equivalent
  • Must have a Valid Driver’s License
What we offer
What we offer
  • Market Leading Pay, based on experience, Plus Bonuses
  • A Great Working Environment with the Latest Equipment
  • Structured, Self-paced and paid Training Opportunities Leading to Manufacturer and Group 1 Recognition
  • Health, Dental & Vision Insurance
  • Life & Disability Insurance
  • 401(k) with Company Match
  • Paid Time off
  • Employee Vehicle Purchase Program
  • Employee Stock Purchase Plan
  • Fulltime
Read More
Arrow Right
New

Automotive Technician/Mechanic

BMW of Atlantic City is part of Group 1 Automotive, a leader in automotive retai...
Location
Location
United States , Egg Harbor Township
Salary
Salary:
19.46 - 69.23 USD / Hour
Group 1 Automotive
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master or Certified Technicians, but welcome other Experienced Technicians
  • National Institute of Automotive Service Excellence (ASE) certification(s) or certification(s) in: brakes, electrical/electronic systems or engine performance preferred
  • A passion for what you do
  • A Positive & Friendly Attitude
  • Tools based on your experience
  • Communication Skills
  • Basic Computer Skills
  • Strong Desire to Provide an Exceptional Client Experience
  • Ability to Achieve Targeted Goals
  • Must have a Valid Driver’s License
What we offer
What we offer
  • Market Leading Pay, Plus Bonuses
  • A Great Working Environment with the Latest Equipment
  • Health, Dental & Vision Insurance
  • Life & Disability Insurance
  • 401(k) with Company Match
  • Paid Time off
  • Structured, Self-paced and paid Training Opportunities Leading to Manufacturer and Group 1 Recognition
  • Employee Vehicle Purchase Program
  • Employee Stock Purchase Plan
  • Opportunities for Advancement
  • Fulltime
Read More
Arrow Right
New

Honda Certified Technician

Boardwalk Honda is part of the fast growing Group 1 Automotive, a leader in auto...
Location
Location
United States , Egg Harbor Township
Salary
Salary:
15.14 - 57.69 USD / Hour
Group 1 Automotive
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Honda certification
  • A Positive & Friendly Attitude
  • Tools based on your experience
  • Communication Skills
  • Basic Computer Skills
  • Strong Desire to Provide an Exceptional Client Experience
  • Ability to Achieve Targeted Goals
  • High School Diploma or Equivalent
  • Must have a Valid Driver’s License
What we offer
What we offer
  • $5,000 Sign on Bonus (terms & limits apply)
  • Market Leading Pay, based on experience, Plus Bonuses
  • A Great Working Environment with the Latest Equipment
  • Structured, Self-paced and paid Training Opportunities Leading to Manufacturer and Group 1 Recognition
  • Pinnacle Awards Program
  • Health, Dental & Vision Insurance
  • Life & Disability Insurance
  • 401(k) with Company Match
  • Paid Time off
  • Employee Vehicle Purchase Program
  • Fulltime
Read More
Arrow Right
New

Used Car Technician/mechanic

Ira BMW of Stratham is looking for Quality, Used Car Service Technicians/Mechani...
Location
Location
United States , Stratham
Salary
Salary:
Not provided
Group 1 Automotive
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Automotive Technician/Mechanic Experience
  • A Love of Everything Automotive
  • A Positive & Friendly Attitude
  • Tools based on your experience
  • Communication Skills
  • Basic Computer Skills
  • Strong Desire to Provide an Exceptional Client Experience
  • Ability to Achieve Targeted Goals
  • High School Diploma or Equivalent
  • Must have a Valid Driver’s License
What we offer
What we offer
  • A True Four Day Work Schedule
  • Market Leading Pay, based on experience, Plus Bonuses
  • A Great Working Environment with the Latest Equipment
  • Structured, Self-paced and paid Training Opportunities Leading to Manufacturer and Group 1 Recognition
  • Health, Dental & Vision Insurance
  • Life & Disability Insurance
  • 401(k) with Company Match
  • Paid Time off
  • Employee Vehicle Purchase Program
  • Employee Stock Purchase Plan
  • Fulltime
Read More
Arrow Right
New

Entry Level Automotive Technician/Mechanic

Kickstart Your Automotive Career with a Winning Team! Join Ira Toyota of Manches...
Location
Location
United States , Manchester
Salary
Salary:
18.00 USD / Hour
Group 1 Automotive
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A positive, team-oriented attitude
  • Desire to grow and build a successful career in automotive service
  • Basic computer and communication skills
  • Commitment to delivering excellent customer service
  • Valid driver’s license and clean driving record
  • High school diploma or equivalent preferred
  • Must pass pre-employment screenings including background check, MVR, and drug test
What we offer
What we offer
  • Flexible schedules – 3, 4, or 5-day work options
  • Toyota Technician Mentoring Program
  • Toyota Certification and ongoing paid training
  • Weekly employee appreciation lunches
  • Paid Time Off (PTO)
  • Medical, Dental, Vision, Life & Disability Insurance
  • 401(k) plan with company match
  • Employee Stock Purchase Plan
  • Employee Vehicle Purchase Program
  • Professional work environment with advancement opportunities
  • Fulltime
Read More
Arrow Right
New

Automotive Technician/Mechanic

Ira Subaru Manchester is part of fast-growing Group 1 Automotive, a leader in au...
Location
Location
United States , Manchester
Salary
Salary:
Not provided
Group 1 Automotive
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Automotive Technician/Mechanic Experience
  • A Love of Everything Automotive
  • A Positive & Friendly Attitude
  • Tools Based on your Experience
  • Communication Skills
  • Basic Computer Skills
  • Strong Desire to Provide an Exceptional Client Experience
  • Ability to Achieve Targeted Goals
  • High School Diploma or Equivalent
  • Must have a Valid Driver’s License
What we offer
What we offer
  • A True Four Day Work Schedule
  • Health, Dental & Vision Insurance
  • Life and Disability Insurance
  • 401(k) with company match
  • Paid Time-off
  • Employee Vehicle Purchase Program
  • Employee Stock Purchase Plan
  • Structured, Self-paced and Paid Training Opportunities Leading to Manufacturer and Group 1 Recognition
  • Pinnacle Awards Program
  • Fulltime
Read More
Arrow Right
New

Automotive technician/mechanic

New England’s Fastest Growing Mercedes-Benz Dealer! Mercedes-Benz of Manchester ...
Location
Location
United States , Manchester
Salary
Salary:
30.00 - 50.00 USD / Hour
Group 1 Automotive
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Passion for customer service
  • Pride in work
  • Ability to work as part of a team
  • Must pass pre-employment testing: background checks, MVR, and drug testing
What we offer
What we offer
  • Sign-On Bonus: Up to $2,500.00 for experienced Technicians/Mechanics
  • Up to $5,000.00 for Mercedes-Benz Technicians/Mechanics (1 year minimum)
  • State-of-the-art tools and equipment
  • Flexible work schedules
  • Training opportunities
  • Recognition programs
  • Food, fun, and celebrations
  • Fulltime
Read More
Arrow Right
New

Experienced Automotive Technician/Mechanic

Ira Subaru Manchester is part of fast-growing Group 1 Automotive, a leader in au...
Location
Location
United States , Manchester
Salary
Salary:
Not provided
Group 1 Automotive
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Automotive Technician/Mechanic Experience
  • A Love of Everything Automotive
  • A Positive & Friendly Attitude
  • Tools Based on your Experience
  • Communication Skills
  • Basic Computer Skills
  • Strong Desire to Provide an Exceptional Client Experience
  • Ability to Achieve Targeted Goals
  • High School Diploma or Equivalent
  • Must have a Valid Driver’s License
What we offer
What we offer
  • A True Four Day Work Schedule
  • Health, Dental & Vision Insurance
  • Life and Disability Insurance
  • 401(k) with company match
  • Paid Time-off
  • Employee Vehicle Purchase Program
  • Employee Stock Purchase Plan
  • Structured, Self-paced and Paid Training Opportunities Leading to Manufacturer and Group 1 Recognition
  • Pinnacle Awards Program
  • Fulltime
Read More
Arrow Right