CrawlJobs Logo

Sr Big Data Engineer - Oozie and Pig (GCP)

rackspace.com Logo

Rackspace

Location Icon

Location:
United States

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

116100.00 - 198440.00 USD / Year

Job Description:

We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven track record of writing production-grade code and building robust data workflows. This is a fully remote position and requires an independent, self-driven engineer who thrives in complex technical environments and communicates effectively across teams.

Job Responsibility:

  • Design and develop scalable batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, MapReduce, and HBase, with hands-on coding in Java or Python (Java is a must)
  • Must be able to lead Jira Epics
  • Write clean, efficient, and production-ready code with a strong focus on data structures and algorithmic problem-solving applied to real-world data engineering tasks
  • Develop, manage, and optimize complex data workflows within the Apache Hadoop ecosystem, with a strong focus on Oozie orchestration and job scheduling
  • Leverage Google Cloud Platform (GCP) tools such as Dataproc, GCS, and Composer to build scalable and cloud-native big data solutions
  • Implement DevOps and automation best practices, including CI/CD pipelines, infrastructure as code (IaC), and performance tuning across distributed systems
  • Collaborate with cross-functional teams to ensure data pipeline reliability, code quality, and operational excellence in a remote-first environment

Requirements:

  • Bachelor's degree in Computer Science, software engineering or related field of study
  • Experience with managed cloud services and understanding of cloud-based batch processing systems
  • Proficiency in Oozie, Airflow, Map Reduce, Java
  • Strong programming skills with Java (specifically Spark), Python, Pig, and SQL
  • Expertise in public cloud services, particularly in GCP
  • Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce
  • Familiarity with BigTable and Redis
  • Experienced in Infrastructure and Applied DevOps principles in daily work
  • Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform
  • Proven experience in engineering batch processing systems at scale
  • 5+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with “on-premises to cloud” migrations or IT transformations
  • 5+ years of experience building, and operating solutions built on GCP
  • Proficiency in Oozie and Pig
  • Must be able to lead Jira Epics
  • Proficiency in Java or Python

Additional Information:

Job Posted:
January 05, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:
PREMIUM
More languages and countries
+ Unlock 31698 hidden job offers
Languages
English Čeština Deutsch Ελληνικά Español Français +15
Countries
United States United Kingdom India Canada Australia +
See plans
Plans from $2.99 / month

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Sr Big Data Engineer - Oozie and Pig (GCP)

Sr Big Data Engineer - Oozie and Pig (GCP)

Location
Location
United States
Salary
Salary:
Not provided
rackspace.com Logo
Rackspace
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strongest programming language (Java or Python)
  • Experience with data structures and algorithms
  • Experience with frameworks in that language
  • Recent coding experience in that language
  • Years of coding experience in that language
  • Percentage of a week spent coding in that language
  • Specific time frame of experience with Oozie
  • Number of DAGs created in Oozie
  • Number of DAGs refactored in Oozie
  • Specific time frame of experience with Pig
  • Fulltime
Read More
Arrow Right

Pharmacy Technician

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Northport
Salary
Salary:
16.00 - 24.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 06, 2026
Flip Icon
Requirements
Requirements
  • Must comply with any state board of pharmacy requirements or laws governing the practice of pharmacy, which includes but is not limited to, age, education, and licensure/certification
  • If the state board of pharmacy does not address or mandate a minimum age requirement, must be at least 16 years of age
  • If the state board of pharmacy does not address or mandate a minimum educational requirement, must have a high school diploma or equivalent, or be actively enrolled in high school or high school equivalency program
  • State-level licensure and national certification requirements vary by state
  • Ability to complete required training within designated timeframe
  • Attention and Focus: Ability to concentrate on a task over a period of time, Ability to pivot quickly from one task to another to meet patient and business needs, Ability to confirm prescription information and label accuracy, ensuring patient safety
  • Customer Service and Team Orientation: Actively look for ways to help people, and do so in a friendly manner, Notice and understand patients’ reactions, and respond appropriately
  • Communication Skills: Use and understand verbal and written communication to interact with patients and colleagues, Utilize active listening by giving full attention to what others are saying, taking time to understand the points being made, asking questions as appropriate, and not interrupting at inappropriate times
  • Mathematical Reasoning: Ability to use math to solve a problem, such as determining the total number of tablets to dispense, day’s supply, and/or number of full bottles and additional bottles needed to fill a prescription
  • Problem Resolution: Identifying challenging patient or colleague interactions and choosing the best course of action when faced multiple options
Job Responsibility
Job Responsibility
  • Living our purpose by following all company SOPs at each workstation to help our Pharmacists manage and improve patient health
  • Following pharmacy workflow procedures at each pharmacy workstation (i.e., production, pick-up, drive-thru, and drop-off) for safe and accurate prescription fulfillment
  • Contributing to positive patient experiences by showing empathy and genuine care: creating heartfelt and personalized moments while serving patients at pick-up, drive-thru, and over the phone
  • keeping patients healthy by offering immunizations and other services at the register and over the phone
  • and demonstrating compassionate care by solving or escalating patient problems
  • Completing basic inventory activities, as permitted by law, and as directed by the pharmacy leadership team, such as accurately putting away medication deliveries and completing cycle counts, returns-to-stocks, waiting bin inventories, etc.
  • Contributing to a high-performing team, embracing a growth mindset, and being receptive to feedback
  • actively seeking opportunities to expand clinical and technical knowledge needed to better assist patients
  • Remaining flexible for both scheduling and business needs, while contributing to a safe, inclusive, and engaging team dynamic
  • voluntarily traveling to stores in the market to work shifts as needed by the business
What we offer
What we offer
  • medical, dental, and vision coverage
  • paid time off
  • retirement savings options
  • wellness programs
  • Fulltime
Read More
Arrow Right

Patient Services Specialist

The Patient Services Specialist 1, with direct oversight, provides administrativ...
Location
Location
United States , Plano
Salary
Salary:
Not provided
bswhealth.com Logo
Baylor Scott & White Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • H.S. Diploma/GED Equivalent
  • Less than 1 Year of Experience
  • Good listening, interpersonal and communication (oral and written), and professional, pleasant and respectful telephone etiquette
  • Ability to adapt communication style to suit different audiences
  • Empathetic listener, sensitive, upbeat, optimistic, articulate, gracious and tactful
  • Ability to promptly assess requests by using electronic and paper resource materials and correctly respond to patient inquiries
  • Ability to calm upset patients in a composed and professional demeanor
  • Excellent data entry, numeric, typing and computer navigational skills, with attention to details
  • Comfortable working in a fast paced, constantly changing and stressful environment
Job Responsibility
Job Responsibility
  • Assists with patient duties including patient relations, check-in or check-out, scheduling, insurance verification, and answering phones
  • Arranges follow-up visits and referral appointments
  • Assists with patient registration duties by collecting and verifying insurance information
  • Verifies patient demographics and enters changes into computer system
  • Directs patient to appropriate waiting areas
  • Accepts payments for physician/clinic services according to established guidelines
  • Posts payments and enters charges into computer utilizing appropriate codes
  • Generates daily payment reports and verifies cash drawer against report
  • Provides accurate patient, medical, financial or procedural information to patients or approved outside entities
  • May be required to discuss financial arrangements with patients
What we offer
What we offer
  • Immediate eligibility for health and welfare benefits
  • 401(k) savings plan with dollar-for-dollar match up to 5%
  • Tuition Reimbursement
  • PTO accrual beginning Day 1
  • Fulltime
Read More
Arrow Right

Senior Premier Banker

About this role: Wells Fargo is seeking a Senior Branch Premier Banker (SAFE) t...
Location
Location
United States , Rio Rancho; Albuquerque
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
June 12, 2026
Flip Icon
Requirements
Requirements
  • 4+ years of customer service experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 3+ years of experience building and maintaining effective relationships with customers and partners
  • 3+ years of experience recommending products and services
Job Responsibility
Job Responsibility
  • Proactively acquire new affluent consumer and business customers while deepening existing relationships through strategic outreach, referrals, and pre-planned customer appointments
  • Lead discovery‑driven conversations to understand customer goals and deliver tailored banking and credit strategies that strengthen relationships, increase retention, and drive balanced growth across deposits, lending, and investments
  • Serve as the primary financial partner delivering comprehensive, multi‑product guidance and ongoing reviews across life stages and evolving financial needs
  • Partner with a team of professionals across Wealth, Home Lending, and Business Banking to deliver integrated solutions by coordinating warm introductions, setting clear expectations, and taking personal ownership to convert qualified opportunities into closed outcomes
  • Champion digital adoption by educating customers on self-service and mobile banking options to elevate satisfaction, engagement, and service efficiency
  • Serve as an active member of the branch team by advising colleagues on relationship development and the management of complex client needs
  • Demonstrate risk excellence through accurate documentation, sound judgment, timely issue escalation, and adherence to policies and regulations to support strong control outcomes
  • Fulltime
Read More
Arrow Right

Private Banker - French Market

Citi Private Bank is a trusted advisor to the world's wealthiest, most influenti...
Location
Location
France , Paris
Salary
Salary:
86000.00 - 142000.00 EUR / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in UHNW Private Banking or the institutional/corporate banking market, specifically covering the French Market
  • Demonstrated track record in relationship acquisition
  • Proven success in building a new business, prospecting for new clients and business, identifying new business opportunities and closing transactions
  • Extensive experience in selling new products, based on client needs
  • Experience in working on teams and influencing diverse resources and stakeholders
  • Fluent in French & English (written and spoken)
  • Excellent relationship building skills
  • Thrives in a business development environment
  • Strong IT skills including Excel and Word
  • Creative and innovative
Job Responsibility
Job Responsibility
  • Build Client Relationships - Demonstrates an in-depth understanding of clients' businesses and sources of wealth generation as well as serve as a trusted advisor to the Private Banks clients
  • Develop Client Solutions - Develop tailored solutions that address clients' unique investment, risk management, and financing/liquidity needs
  • Execute and Drive Results - Set challenging goals, regularly monitoring progress and making adjustments to achieve objectives
  • Teamwork - Help team members to acquire the experience necessary to establish credibility with clients and intermediaries
  • Build & Maintain Relationships with Business Partners, Colleagues and Staff - Develop strong relationships and partners with support functions across the Private Bank to maintain control, find solutions and resolve issues
  • Promote Integrity and Trust - Understand and communicate the risk involved with various investment strategies
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Valkey

We are looking for a Senior Software Engineer to work on our cloud operations pl...
Location
Location
Finland , Helsinki
Salary
Salary:
Not provided
aiven.io Logo
Aiven Deutschland GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Excellent development skills in Python
  • 3+ years of experience working with one of these databases - PostgreSQL, MySQL, MariaDB, SQL Server, OracleDB
  • 2+ years of experience working with an in-memory database: Valkey, Redis, Dragonfly, KeyDB
  • Experience with backup solutions and backup strategies
  • Advanced understanding of Linux OS
  • Experience with automated testing
  • Distributed systems knowledge
  • Experience with performance improvements, bug fixes, and security vulnerability resolution
  • Fluency in English, verbal and written.
Job Responsibility
Job Responsibility
  • Write high-quality, maintainable code and release quality features
  • Participate in technical discussions and perform PR reviews
  • Contribute to technical planning and backlog management
  • Help investigate and resolve customer issues
  • Mentor and empower other engineers
  • Automate processes to eliminate repetitive manual work
  • Develop and improve the scalability and reliability of Valkey service
What we offer
What we offer
  • Participate in Aiven’s equity plan
  • Balance work and life with our hybrid work policy
  • Choose the equipment you need to set yourself up for success
  • Use your Professional Development Plan budget for learning opportunities
  • Receive holistic wellbeing support through our global Employee Assistance Program
  • Inquire about our Global Time Off Commitment (Parental and Sick Leave, as well as Personal Time)
  • Enjoy country-specific benefits for our global cast
  • Fulltime
Read More
Arrow Right

Teller

Wells Fargo is seeking a Teller in our Consumer Banking and Lending division, as...
Location
Location
United States , Los Angeles
Salary
Salary:
22.00 - 27.50 USD / Hour
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
May 30, 2026
Flip Icon
Requirements
Requirements
  • 6+ months of interacting with customers experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
Job Responsibility
Job Responsibility
  • Support customer engagement by processing teller transactions, sharing digital solutions, and making appropriate introductions to bankers
  • Complete operational activities while minimizing risks under established policies
  • Perform routine transactional, operational, and customer support tasks efficiently through knowledge of bank procedures and products, as well as partners across the organization
  • Receive direction from managers and exercises judgment within defined policies and procedures
  • Escalate questions and issues to more experienced roles
  • Interact with customers and individuals to demonstrate care, build relationships, and complete requested transactions
  • Identify information and services to meet customers financial needs
What we offer
What we offer
  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Parttime
!
Read More
Arrow Right

Pharmacy Technician

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Dracut
Salary
Salary:
17.00 - 27.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 04, 2026
Flip Icon
Requirements
Requirements
  • Must comply with any state board of pharmacy requirements or laws governing the practice of pharmacy, which includes but is not limited to, age, education, and licensure/certification
  • If the state board of pharmacy does not address or mandate a minimum age requirement, must be at least 16 years of age
  • If the state board of pharmacy does not address or mandate a minimum educational requirement, must have a high school diploma or equivalent, or be actively enrolled in high school or high school equivalency program
  • State-level licensure and national certification requirements vary by state
  • Regular and predictable attendance, including nights and weekends
  • Ability to complete required training within designated timeframe
  • Attention and Focus: Ability to concentrate on a task over a period of time
  • Ability to pivot quickly from one task to another to meet patient and business needs
  • Ability to confirm prescription information and label accuracy, ensuring patient safety
  • Customer Service and Team Orientation: Actively look for ways to help people, and do so in a friendly manner
Job Responsibility
Job Responsibility
  • Living our purpose by following all company SOPs at each workstation to help our Pharmacists manage and improve patient health
  • Following pharmacy workflow procedures at each pharmacy workstation (i.e., production, pick-up, drive-thru, and drop-off) for safe and accurate prescription fulfillment
  • Contributing to positive patient experiences by showing empathy and genuine care: creating heartfelt and personalized moments while serving patients at pick-up, drive-thru, and over the phone
  • keeping patients healthy by offering immunizations and other services at the register and over the phone
  • and demonstrating compassionate care by solving or escalating patient problems
  • Completing basic inventory activities, as permitted by law, and as directed by the pharmacy leadership team, such as accurately putting away medication deliveries and completing cycle counts, returns-to-stocks, waiting bin inventories, etc.
  • Contributing to a high-performing team, embracing a growth mindset, and being receptive to feedback
  • actively seeking opportunities to expand clinical and technical knowledge needed to better assist patients
  • Remaining flexible for both scheduling and business needs, while contributing to a safe, inclusive, and engaging team dynamic
  • voluntarily traveling to stores in the market to work shifts as needed by the business
What we offer
What we offer
  • dental
  • vision
  • wellness resources
  • employee discounts
  • access to certain voluntary benefits
  • other programs
  • Parttime
Read More
Arrow Right