CrawlJobs Logo

Sr Big Data Engineer - Oozie and Pig (GCP)

rackspace.com Logo

Rackspace

Location Icon

Location:
United States

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

116100.00 - 198440.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven track record of writing production-grade code and building robust data workflows. This is a fully remote position and requires an independent, self-driven engineer who thrives in complex technical environments and communicates effectively across teams.

Job Responsibility:

  • Design and develop scalable batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, MapReduce, and HBase, with hands-on coding in Java or Python (Java is a must)
  • Must be able to lead Jira Epics
  • Write clean, efficient, and production-ready code with a strong focus on data structures and algorithmic problem-solving applied to real-world data engineering tasks
  • Develop, manage, and optimize complex data workflows within the Apache Hadoop ecosystem, with a strong focus on Oozie orchestration and job scheduling
  • Leverage Google Cloud Platform (GCP) tools such as Dataproc, GCS, and Composer to build scalable and cloud-native big data solutions
  • Implement DevOps and automation best practices, including CI/CD pipelines, infrastructure as code (IaC), and performance tuning across distributed systems
  • Collaborate with cross-functional teams to ensure data pipeline reliability, code quality, and operational excellence in a remote-first environment

Requirements:

  • Bachelor's degree in Computer Science, software engineering or related field of study
  • Experience with managed cloud services and understanding of cloud-based batch processing systems
  • Proficiency in Oozie, Airflow, Map Reduce, Java
  • Strong programming skills with Java (specifically Spark), Python, Pig, and SQL
  • Expertise in public cloud services, particularly in GCP
  • Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce
  • Familiarity with BigTable and Redis
  • Experienced in Infrastructure and Applied DevOps principles in daily work
  • Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform
  • Proven experience in engineering batch processing systems at scale
  • 5+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with “on-premises to cloud” migrations or IT transformations
  • 5+ years of experience building, and operating solutions built on GCP
  • Proficiency in Oozie and Pig
  • Must be able to lead Jira Epics
  • Proficiency in Java or Python

Additional Information:

Job Posted:
January 05, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
Rackspace - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon
PREMIUM
More languages and countries
+ Unlock 31698 hidden job offers
Languages
English Čeština Deutsch Ελληνικά Español Français +15
Countries
United States United Kingdom India Canada Australia +
See plans
Plans from $2.99 / month

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Sr Big Data Engineer - Oozie and Pig (GCP)

Sr Big Data Engineer - Oozie and Pig (GCP)

Location
Location
United States
Salary
Salary:
Not provided
rackspace.com Logo
Rackspace
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strongest programming language (Java or Python)
  • Experience with data structures and algorithms
  • Experience with frameworks in that language
  • Recent coding experience in that language
  • Years of coding experience in that language
  • Percentage of a week spent coding in that language
  • Specific time frame of experience with Oozie
  • Number of DAGs created in Oozie
  • Number of DAGs refactored in Oozie
  • Specific time frame of experience with Pig
  • Fulltime
Read More
Arrow Right

Electrical/Mechanical Pump Manager

We are looking for an experienced and motivated Mechanical / Electrical Pump Man...
Location
Location
United Kingdom , Birmingham
Salary
Salary:
50000.00 GBP / Year
metrorod.co.uk Logo
Metro Rod
Expiration Date
June 06, 2026
Flip Icon
Requirements
Requirements
  • NVQ Level 3 in Electrical Installation or equivalent
  • 18th Edition Wiring Regulations qualification
  • Minimum 4 years’ post-qualification experience
  • Experience carrying out electrical testing and inspections
  • Strong mechanical and electrical fault-finding skills
  • Ability to lead teams and manage workloads effectively
  • Experience in quoting work
  • Full UK driving licence
  • Willingness to travel
Job Responsibility
Job Responsibility
  • Oversee mechanical and electrical pump operations and maintenance activities
  • Be the Electrical supervisor/Appointed person NICEIC/NAPIT for the Company
  • Support and manage engineers across multiple sites
  • Carry out and review electrical testing and inspections
  • Conduct site audits and ensure compliance with health & safety standards
  • Diagnose faults and support technical problem solving
  • Assist with planning and delivery of maintenance and installation projects
  • Provide training, mentoring, and technical support to engineers and apprentices
  • Maintain high standards of workmanship, safety, and customer service
What we offer
What we offer
  • 25 days annual leave – plus bank holidays
  • Paid expenses for travel, meals and accommodation
  • Royal London, Company Pension
  • Group Life Assurance
  • Additional Paid Leave / Special Leave
  • Company Events
  • Laptop / Company Mobile
  • Free Eye Tests / Subsidy for Glasses
  • Employee Assistance Programme
  • Occupational Health Support
  • Fulltime
Read More
Arrow Right

Shift Supervisor

We're building a world of health around every individual — shaping a more connec...
Location
Location
United States , Exton
Salary
Salary:
16.50 - 24.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 05, 2026
Flip Icon
Requirements
Requirements
  • Deductive reasoning ability, analytical skills and computer skills
  • Advanced communication skills and supervision skills
  • Ability to work a flexible schedule, including some early morning, overnight and weekend shifts, to work overtime as needed, and to respond to urgent issues at the store when they arise
Job Responsibility
Job Responsibility
  • Work effectively with store management and store crews
  • Supervise the store's crew through assigning, directing and following up of all activities
  • Effectively communicate information both to and from store management and crews
  • Assist customers with their questions, problems and complaints
  • Promote CVS customer service culture (Greet, offer help, and thank)
  • Handle all customer relations issues in accordance with company policy and promote a positive shopping experience for all CVS customers
  • Maintain customer/patient confidentiality
  • Price merchandise
  • Stock shelves
  • Execute the displays, sign and inventory of weekly, promotional, and seasonal merchandise
What we offer
What we offer
  • Medical coverage
  • Dental coverage
  • Vision coverage
  • Paid time off
  • Retirement savings options
  • Wellness programs
  • Fulltime
Read More
Arrow Right

Controller

We are looking for an experienced Controller to oversee core accounting activiti...
Location
Location
United States , Birmingham
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Accounting, Finance, or a related discipline
  • At least 7+ years of accounting experience within hospitality, hotel, commercial real estate, or a similar environment is preferred but not mandatory
  • Hands-on experience with month-end close, general ledger activity, journal entries, and account reconciliations
  • Proficiency with QuickBooks Online and strong working knowledge of Microsoft Office applications
  • Familiarity with payroll input processes and exposure to accounts payable and accounts receivable functions
  • Strong analytical, organizational, and problem-solving abilities with close attention to accuracy and timeliness
  • Effective written and verbal communication skills, along with the ability to work independently and manage competing deadlines
Job Responsibility
Job Responsibility
  • Manage recurring payroll data entry and coordinate timely submission to the external payroll provider for bi-weekly processing
  • Prepare supporting schedules and reporting for sales tax and occupancy tax filings, ensuring accuracy and compliance with deadlines
  • Produce monthly and annual financial statements by gathering, reviewing, and interpreting accounting data from multiple sources
  • Lead the month-end and year-end close process, including journal entries, general ledger review, and completion of supporting workpapers
  • Reconcile bank and balance sheet accounts each month, investigate discrepancies, and maintain accurate cash records
  • Organize financial documentation and provide requested materials to support internal audit activity and management review
  • Maintain accounting records in alignment with internal policies, established procedures, and sound financial controls
  • Support accounts payable and accounts receivable activities by reviewing invoice submissions, validating payment details, and assisting with regular check processing
  • Partner with the Bookkeeper to research guest account activity, verify charges, and help resolve disputed transactions or chargebacks
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Enrollment in company 401(k) plan
Read More
Arrow Right

Invoicing and Accounts Assistant

To manage Metro Rod LTD invoicing for a variety of clients via their associated ...
Location
Location
United Kingdom , Macclesfield
Salary
Salary:
25077.00 GBP / Year
metrorod.co.uk Logo
Metro Rod
Expiration Date
June 28, 2026
Flip Icon
Requirements
Requirements
  • Experience working within a fast-paced office environment is essential
  • Team player with excellent presentation, communication and interpersonal skills (both written and verbal)
  • Experience working within a financial team is preferred, although a busy call-centre environment will be considered
  • SAGE/ NetSuite experience is beneficial but not required
  • Experience providing excellent customer service essential
  • Advanced literacy and numeracy with well-developed IT skills and understanding of complex digital technology and processes
  • Advanced competency in Microsoft Office including Word and Excel
  • Inquisitive mindset and approach
  • Attention to detail is essential, with good time management and ability to work under pressure
Job Responsibility
Job Responsibility
  • Daily upload of invoices and financial information and cost breakdown
  • Liaising with different departments within Metro Rod and our franchisee network to ensure queries are promptly resolved
  • Communicating with the clients via telephone and email when required and ensuring that any queries are escalated and resolved promptly and professional
  • Work closely with credit controllers within the team to ensure accurate and timely invoicing of customers leads to maximised cash collection
  • Attending business and clients’ meetings to discuss current processes and potential improvements to the service being provided to them
  • To work cohesively within the Digital Team to ensure KPI targets are met within the team and across the business for our national account customers
What we offer
What we offer
  • 25 days annual leave – plus bank holidays
  • Royal London, Company Pension
  • Group Life Assurance
  • Additional Paid Leave / Special Leave
  • Cycle to Work Scheme
  • Free Eye Tests / Subsidy for Glasses
  • Free Standard Parking
  • Employee Assistance Programme
  • Occupational Health Support
  • Employee Discounts Platform - Mintago
  • Fulltime
Read More
Arrow Right

Invoicing and Accounts Assistant

To manage Metro Rod LTD invoicing for a variety of clients via their associated ...
Location
Location
United Kingdom , Macclesfield
Salary
Salary:
25077.00 GBP / Year
metrorod.co.uk Logo
Metro Rod
Expiration Date
June 28, 2026
Flip Icon
Requirements
Requirements
  • Experience working within a fast-paced office environment is essential
  • Team player with excellent presentation, communication and interpersonal skills (both written and verbal)
  • Experience working within a financial team is preferred, although a busy call-centre environment will be considered
  • SAGE/ NetSuite experience is beneficial but not required
  • Experience providing excellent customer service essential
  • Advanced literacy and numeracy with well-developed IT skills and understanding of complex digital technology and processes
  • Advanced competency in Microsoft Office including Word and Excel
  • Inquisitive mindset and approach
  • Attention to detail is essential, with good time management and ability to work under pressure
Job Responsibility
Job Responsibility
  • Daily upload of invoices and financial information and cost breakdown
  • Liaising with different departments within Metro Rod and our franchisee network to ensure queries are promptly resolve
  • Communicating with the clients via telephone and email when required and ensuring that any queries are escalated and resolved promptly and professional
  • Work closely with credit controllers within the team to ensure accurate and timely invoicing of customers leads to maximised cash collection
  • Attending business and clients’ meetings to discuss current processes and potential improvements to the service being provided to them
  • To work cohesively within the Digital Team to ensure KPI targets are met within the team and across the business for our national account customers
What we offer
What we offer
  • 25 days annual leave – plus bank holidays
  • Royal London, Company Pension
  • Group Life Assurance
  • Additional Paid Leave / Special Leave
  • Cycle to Work Scheme
  • Free Eye Tests / Subsidy for Glasses
  • Free Standard Parking
  • Employee Assistance Programme
  • Occupational Health Support
  • Employee Discounts Platform - Mintago
  • Fulltime
Read More
Arrow Right

Executive Scorecards, Vice President

Whether you’re at the start of your career or looking to discover your next adve...
Location
Location
India , Mumbai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in Financial Services with a proven track record of a change agent
  • Exceptional communication skills, including well-developed verbal, written and presentation skills
  • Must be able to quickly create concise, informative executive summaries for internal and external stakeholders that convey a well-developed story and advocate for a well-reasoned point of view
  • Strong background in accounting, financial analysis or internal audit, with demonstrated understanding of substantive reviews and internal controls
  • Creative skills necessary to craft persuasive, well-researched narratives for senior consumption
  • Aptitude for translating strategy into execution in a complex and cross-functional organization
  • Strong attention to detail with proven ability to distil complex ideas into simple stories
  • Previous experience(s) in Finance functions is preferred
  • Understanding of capital markets, retail banking and/or institutional banking is a must
  • Minimum 10 years of proven experience in driving results with a strong understanding of the financial services industry
Job Responsibility
Job Responsibility
  • Lead workstreams responsible for the improvement of production, review and correspondence of metrics across the spectrum of Executive Scorecards
  • Responsible for overseeing and prioritizing a significant segment of the portfolio of projects geared towards strengthening the effectiveness and efficiency of controls environment (i.e., re-engineering)
  • Enhance the existing controls framework by identifying gaps, perform root cause analysis and driving technology and process solutions towards remediation
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Delivering thought leadership and supporting the implementation of changes necessary to enhance Citi’s Executive Scorecard production processes and satisfy evolving senior management and board of directors’ requests (i.e., AI use cases, enhancing user experience, etc.)
  • Developing a strong working relationship with stakeholders across the organization in support of their individual responsibilities and in support of creating a holistic framework in which the firm executes its strategic priorities
  • Team member of several professionals interacting with members across multiple locations on a daily basis
  • Fulltime
Read More
Arrow Right

Housekeeping Manager

The Housekeeping Assistant Manager ensures our guest accommodation and all areas...
Location
Location
United States of America , Las Vegas
Salary
Salary:
Not provided
fourseasons.com Logo
Four Seasons
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Two years experience in a supervisory role in Rooms division
  • College degree or diploma preferably specializing in Hotel management or equivalent experience
Job Responsibility
Job Responsibility
  • Ensure guest accommodation and all areas front and back of house are maintained in a spotless condition
  • Assume hands on management of day to day operation of Housekeeping Department by establishing and controlling planned cleaning schedules
  • Work closely with Front Office to ensure guest accommodations are ready in a timely manner to Four Seasons standards
  • Assist Supervisors with training and supervision of Housekeeping staff
  • Assume responsibility for the Department in the absence of the Director or Assistant Director of Housekeeping
  • Fulltime
Read More
Arrow Right