CrawlJobs Logo

Sr Big Data Engineer - Oozie and Pig (GCP)

rackspace.com Logo

Rackspace

Location Icon

Location:
United States

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Requirements:

  • Strongest programming language (Java or Python)
  • Experience with data structures and algorithms
  • Experience with frameworks in that language
  • Recent coding experience in that language
  • Years of coding experience in that language
  • Percentage of a week spent coding in that language
  • Specific time frame of experience with Oozie
  • Number of DAGs created in Oozie
  • Number of DAGs refactored in Oozie
  • Specific time frame of experience with Pig
  • Number of scripts created in Pig
  • Number of scripts refactored in Pig
  • Experience with Java UDF with Pig
  • Years of GCP experience

Additional Information:

Job Posted:
February 18, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Sr Big Data Engineer - Oozie and Pig (GCP)

Sr Big Data Engineer - Oozie and Pig (GCP)

We are seeking a Senior Big Data Engineer with deep expertise in distributed sys...
Location
Location
United States
Salary
Salary:
116100.00 - 198440.00 USD / Year
rackspace.com Logo
Rackspace
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, software engineering or related field of study
  • Experience with managed cloud services and understanding of cloud-based batch processing systems
  • Proficiency in Oozie, Airflow, Map Reduce, Java
  • Strong programming skills with Java (specifically Spark), Python, Pig, and SQL
  • Expertise in public cloud services, particularly in GCP
  • Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce
  • Familiarity with BigTable and Redis
  • Experienced in Infrastructure and Applied DevOps principles in daily work
  • Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform
  • Proven experience in engineering batch processing systems at scale
Job Responsibility
Job Responsibility
  • Design and develop scalable batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, MapReduce, and HBase, with hands-on coding in Java or Python (Java is a must)
  • Must be able to lead Jira Epics
  • Write clean, efficient, and production-ready code with a strong focus on data structures and algorithmic problem-solving applied to real-world data engineering tasks
  • Develop, manage, and optimize complex data workflows within the Apache Hadoop ecosystem, with a strong focus on Oozie orchestration and job scheduling
  • Leverage Google Cloud Platform (GCP) tools such as Dataproc, GCS, and Composer to build scalable and cloud-native big data solutions
  • Implement DevOps and automation best practices, including CI/CD pipelines, infrastructure as code (IaC), and performance tuning across distributed systems
  • Collaborate with cross-functional teams to ensure data pipeline reliability, code quality, and operational excellence in a remote-first environment
  • Fulltime
Read More
Arrow Right
New

Global Demand Generation Manager

Shape the future of growth at Payhawk. This is a high-impact global role, workin...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
payhawk.com Logo
Payhawk
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years Demand-Gen experience, ideally in B2B SaaS or fintech
  • Proven experience developing marketing strategies that support an Outbound motion
  • Proven track record of generating demand with Enterprise accounts
  • Experience creating global “one-to-many” Account-Based Marketing campaigns
  • Experience in building programmatic marketing campaigns
  • Experience working within a “growth” mindset, i.e. running high volumes of structured experiments to improve marketing effectiveness
  • Hands-on – You’re not just setting strategy—you’re writing copy, building landing pages, and testing new tools
  • Exceptional leadership, communication, and collaboration skills
  • Fluent in English
  • Willingness to work from our office 4 days per week
Job Responsibility
Job Responsibility
  • Demand-generation strategy: Define the strategy for generating demand for the Product
  • GTM Pod Leadership: Alongside a Product Marketing Manager, you will be responsible for steering a cross-functional marketing team (a “GTM Pod”). You will make decisions regarding the demand-generation initiatives
  • GTM Pod Reporting: Contribute to Monthly Reports and leadership discussions. In particular, justifying spending decisions and marketing ROI
  • Ultimate budget owner: Decide how to allocate the budget across demand-generation and demand-capture channels and initiatives, to maximise cost-efficiency and marketing ROI
  • ABM strategy & architecture: Define our campaign structure, hypotheses, personas, and targeting aligned to the new Named Accounts structure in the Revenue Org
  • Account funnel design: Build and maintain the framework and rules for progression through ABM funnel stages
  • Growth-focused execution: Launch campaigns fast, test relentlessly, and refine based on real-world feedback
  • Content creation: Develop key campaign assets (ads, emails, landing pages), and partner with the Content Team for localization
  • Multi-touch and multi-channel orchestration: Activate campaigns across multiple channels including digital ads, outbound email, and gifting
  • AI-powered personalization: Use AI and martech tools to tailor messaging and campaigns to account segments
What we offer
What we offer
  • 30 days of paid time off + 12 work-from-anywhere days
  • Exchange policy to another Payhawk office (Amsterdam, Paris, Barcelona, Berlin, Sofia)
  • Health and fitness membership
  • Two company on-sites per year
  • Opportunity to use the Payhawk product, with a monthly commuting allowance of 150EUR
  • Fulltime
Read More
Arrow Right
New

Sterility Assurance Microbiology Engineer

Baxter Thetford have a fantastic opportunity for Microbiology Engineer to join t...
Location
Location
United Kingdom , Thetford
Salary
Salary:
Not provided
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in Microbiology, Biomedical Science, Bioscience OR Pharmaceutical Science
  • Working in an environment where accuracy, numeracy, clear documentation and attention to detail are key requirements
Job Responsibility
Job Responsibility
  • Operate as part of the Sterility Assurance group
  • Quality System & Regulatory Compliance: Maintain alignment with EU GMP & Guidelines
  • Sample preparation and processing of biological indicators
  • Carry out environmental monitoring for classified areas
  • Support with atypical sterilisation investigations
  • Support with heat studies
  • Investigation and communication of “Out of specification” results and the identification and implementation of CAPA
  • Support for projects relating to environmental monitoring
  • Compliance with EHS/GMP/GDP/Company and corporate policies and external regulatory requirements
  • Other Activities as deemed to be required to support the Thetford manufacturing operation
What we offer
What we offer
  • 25 days annual leave + bank holidays
  • Employee discount scheme
  • Blue light card
  • Fantastic internal progression opportunities
  • Subsided canteen
  • Westfield healthcare
  • Up to 8% pension contribution
  • Employee assistance program
  • Support for Parents
  • Continuing Education/ Professional Development
  • Fulltime
Read More
Arrow Right
New

Order picker

As an Order Picker at Bidfood in Hoofddorp, you will earn a great base salary of...
Location
Location
Netherlands , Hoofddorp
Salary
Salary:
14.98 EUR / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
March 09, 2028
Flip Icon
Requirements
Requirements
  • You are 18 years of age or older
  • You speak the Dutch or English language
  • You are available full-time Monday to Friday
  • You are willing to work in 2 shifts from 09:00 - 17:00 and 18:00 - 02:00
  • You have your own transport to the location (Car or Scooter)
  • You are able to apply for VOG (Conduct of good behavior)
  • You are willing to work in cold 4 degrees or freezer -20 degrees
Job Responsibility
Job Responsibility
  • Collecting orders via voice picking
  • Scanning products with a handheld scanner
  • Preparing orders for shipment
  • Lifting and moving products up to 20 kg
What we offer
What we offer
  • Travel allowance of €0.23 per km (from 10 km)
  • Evening and night allowances between 25% and 100%
  • Chance to earn a permanent contract later
  • Extra allowance for cold/freezer storage
  • Working in a fun and close-knit team
  • Fulltime
Read More
Arrow Right
New

Global Demand Generation Manager

Shape the future of growth at Payhawk. This is a high-impact global role, workin...
Location
Location
Bulgaria , Sofia
Salary
Salary:
Not provided
payhawk.com Logo
Payhawk
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years Demand-Gen experience, ideally in B2B SaaS or fintech
  • Proven experience developing marketing strategies that support an Outbound motion
  • Proven track record of generating demand with Enterprise accounts
  • Experience creating global “one-to-many” Account-Based Marketing campaigns
  • Experience in building programmatic marketing campaigns
  • Experience working within a “growth” mindset, i.e. running high volumes of structured experiments to improve marketing effectiveness
  • Hands-on – You’re not just setting strategy—you’re writing copy, building landing pages, and testing new tools
  • Exceptional leadership, communication, and collaboration skills
  • Fluent in English
  • Willingness to work from our office 4 days per week
Job Responsibility
Job Responsibility
  • Demand-generation strategy: Define the strategy for generating demand for the Product
  • GTM Pod Leadership: Alongside a Product Marketing Manager, you will be responsible for steering a cross-functional marketing team (a “GTM Pod”). You will make decisions regarding the demand-generation initiatives
  • GTM Pod Reporting: Contribute to Monthly Reports and leadership discussions. In particular, justifying spending decisions and marketing ROI
  • Ultimate budget owner: Decide how to allocate the budget across demand-generation and demand-capture channels and initiatives, to maximise cost-efficiency and marketing ROI
  • ABM strategy & architecture: Define our campaign structure, hypotheses, personas, and targeting aligned to the new Named Accounts structure in the Revenue Org
  • Account funnel design: Build and maintain the framework and rules for progression through ABM funnel stages
  • Growth-focused execution: Launch campaigns fast, test relentlessly, and refine based on real-world feedback
  • Content creation: Develop key campaign assets (ads, emails, landing pages), and partner with the Content Team for localization
  • Multi-touch and multi-channel orchestration: Activate campaigns across multiple channels including digital ads, outbound email, and gifting
  • AI-powered personalization: Use AI and martech tools to tailor messaging and campaigns to account segments
What we offer
What we offer
  • 30 days of paid time off + 12 work-from-anywhere days
  • Exchange policy to another Payhawk office (Amsterdam, Paris, Berlin, London, Barcelona)
  • Health and fitness membership
  • Two company on-sites per year
  • Opportunity to use the Payhawk product, with a monthly commuting allowance of 150EUR
  • Fulltime
Read More
Arrow Right
New

Production Technician

We are recruiting for Production Technicians to join our compounding team in The...
Location
Location
United Kingdom , Thetford
Salary
Salary:
25600.00 GBP / Year
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Previous experience in a manufacturing or production environment
  • Comfortable working with processes and following detailed instructions
  • Experience in manufacturing, production, or a similar hands‑on operational role
  • A strong focus on quality, safety, and accuracy
  • The ability to follow standard operating procedures and work as part of a team
  • Reliability, attention to detail, and a proactive approach
  • Able to communicate effectively and respectively
Job Responsibility
Job Responsibility
  • Manufacture life saving products in accordance to approved Standard Operating Procedures (SOP’s)
  • Perform routine quality checks on the product as part of the manufacturing process
  • Correctly record detailed data on batch paperwork and quality documents following Good Documentation Practices
  • Perform and record all cleaning for the equipment and areas of work as defined in the relevant SOP’s
  • Notify Team Leader/Supervisor/Manager/Quality assurance of any deviations from the process and take part in correcting mistakes
What we offer
What we offer
  • Weekly shift allowance of £45.35
  • Fulltime
Read More
Arrow Right
New

Catering Assistant

As a Catering Assistant, you'll be part of a dynamic, fast-paced team, contribut...
Location
Location
United Kingdom , Woolpit, Bury St Edmunds
Salary
Salary:
13.00 GBP / Hour
14forty.co.uk Logo
14forty
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bring a positive, can-do attitude to everything you do
  • Show genuine passion for delivering exceptional customer service
  • Excel as a supportive and collaborative team player
  • Embrace the excitement of thriving under pressure
  • Demonstrate impeccable time management and reliability
  • Prioritise safety in every task you undertake
Job Responsibility
Job Responsibility
  • Preparing delicious, high-quality food that delights our clients and customers
  • Crafting eye-catching food and counter displays that draw customers in
  • Proudly representing CH&CO and and embodying our positive brand image
  • Handling transactions with ease and operating the cash register efficiently
  • Upholding the highest standards of Food Handling & Hygiene
  • Ensuring a safe and healthy work environment by adhering to Health & Safety regulations
What we offer
What we offer
  • Great operational training and development
  • Life assurance scheme
  • Personal Development and Training opportunities
  • A great wellbeing strategy - including access to our Employee Assistance Programme
  • Regular social events and communication with our leaders
  • A holiday purchase scheme
  • Access to some great high street discount vouchers
  • Parttime
Read More
Arrow Right
New

Chef de partie

We have an exciting opportunity for an ambitious Chef de Partie to help us creat...
Location
Location
United Kingdom , Harrogate
Salary
Salary:
14.00 GBP / Hour
14forty.co.uk Logo
14forty
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Be a brilliant communicator and easily build relationships
  • Strive for excellence in an eager and motivated manner
  • Take initiative and make decisions that are right for our customers
  • Have a desire to succeed in your role
  • Possess the ability to work under pressure
  • Demonstrate exceptional timekeeping and reliability
  • Have a safety-first mind set
  • Passionate about food
Job Responsibility
Job Responsibility
  • Preparing delicious, high-quality food that delights our clients and customers
  • Being an enthusiastic team player and excellent communicator
  • Representing CH&CO and maintaining a positive brand image
  • Complying with Food Handling & Hygiene standards
  • Complying with Health & Safety regulations
What we offer
What we offer
  • Great operational training and development
  • Life assurance scheme
  • Personal Development and Training opportunities
  • A great wellbeing strategy - including access to our Employee Assistance Programme
  • Regular social events and communication with our leaders
  • A holiday purchase scheme
  • Access to some great high street discount vouchers
  • Fulltime
Read More
Arrow Right