CrawlJobs Logo

Sr Big Data Engineer - Oozie and Pig (GCP)

rackspace.com Logo

Rackspace

Location Icon

Location:
United States

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Requirements:

  • Strongest programming language (Java or Python)
  • Experience with data structures and algorithms
  • Experience with frameworks in that language
  • Recent coding experience in that language
  • Years of coding experience in that language
  • Percentage of a week spent coding in that language
  • Specific time frame of experience with Oozie
  • Number of DAGs created in Oozie
  • Number of DAGs refactored in Oozie
  • Specific time frame of experience with Pig
  • Number of scripts created in Pig
  • Number of scripts refactored in Pig
  • Experience with Java UDF with Pig
  • Years of GCP experience

Additional Information:

Job Posted:
February 18, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Sr Big Data Engineer - Oozie and Pig (GCP)

Sr Big Data Engineer - Oozie and Pig (GCP)

We are seeking a Senior Big Data Engineer with deep expertise in distributed sys...
Location
Location
United States
Salary
Salary:
116100.00 - 198440.00 USD / Year
rackspace.com Logo
Rackspace
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, software engineering or related field of study
  • Experience with managed cloud services and understanding of cloud-based batch processing systems
  • Proficiency in Oozie, Airflow, Map Reduce, Java
  • Strong programming skills with Java (specifically Spark), Python, Pig, and SQL
  • Expertise in public cloud services, particularly in GCP
  • Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce
  • Familiarity with BigTable and Redis
  • Experienced in Infrastructure and Applied DevOps principles in daily work
  • Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform
  • Proven experience in engineering batch processing systems at scale
Job Responsibility
Job Responsibility
  • Design and develop scalable batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, MapReduce, and HBase, with hands-on coding in Java or Python (Java is a must)
  • Must be able to lead Jira Epics
  • Write clean, efficient, and production-ready code with a strong focus on data structures and algorithmic problem-solving applied to real-world data engineering tasks
  • Develop, manage, and optimize complex data workflows within the Apache Hadoop ecosystem, with a strong focus on Oozie orchestration and job scheduling
  • Leverage Google Cloud Platform (GCP) tools such as Dataproc, GCS, and Composer to build scalable and cloud-native big data solutions
  • Implement DevOps and automation best practices, including CI/CD pipelines, infrastructure as code (IaC), and performance tuning across distributed systems
  • Collaborate with cross-functional teams to ensure data pipeline reliability, code quality, and operational excellence in a remote-first environment
  • Fulltime
Read More
Arrow Right
New

Aircraft Systems Installer - A220

The Aircraft Systems Installation Mechanic is responsible for the systems instal...
Location
Location
United States , Mobile
Salary
Salary:
Not provided
airbus.com Logo
Airbus
Expiration Date
February 24, 2026
Flip Icon
Requirements
Requirements
  • 2 years minimum experience in Aviation Production or equivalent required
  • High School Diploma, GED or an equivalent combination of training/experience
  • Vision: adequate to enter and read material on computer screens. Able to identify individuals to initiate greetings, the giving of directions and other business interactions
  • Hearing: able to hear sufficiently to engage in conversation in office settings. Able to hear safety alerts and warning signals
  • Speaking: able to engage in conversations in person and via electronic means and deliver information to groups of varying size with or without amplification
  • Equipment Operation: Able to operate a wide range of personal and office electronic equipment. Working on jigs at the fuselage at a height of 15 feet. Able to work on hydraulic lifts sometimes at a height of up to 40 feet
  • Carrying: able to occasionally carry up to 55lbs/25kg while engaging in training, addressing production issues or as part of continuous improvement projects
  • Lifting: able to occasionally lift up to 55lbs/25kg
  • Pushing/Pulling: able to push/pull items in office areas
  • Sitting: able to sit for extended periods of time at the computer and in meetings
Job Responsibility
Job Responsibility
  • Prepare mechanical components at the station/work place/aircraft parking space
  • Installation and manufacture: mark, prepare, assemble, adapt, torque and secure mechanical components and parts
  • Inspect bonding as per order/GTI, drawing and specifications
  • Check system functions
  • Specialized in the one Area mentioned below: VTP and HTP installation, Hydraulic lines installation
  • Installation in the Area of the Belly fairing and Flap installation
  • Installation concerning Air conditioning and Fuel system
  • MLG & Tank Test
  • Gauging Test
  • Fulltime
!
Read More
Arrow Right
New

Stand Two Dishwasher

Delaware North Sportservice is hiring seasonal Stand Two Dishwashers to join our...
Location
Location
United States , Cincinnati
Salary
Salary:
14.00 - 15.00 USD / Hour
casinocareers.com Logo
Casino Careersv
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ability to understand and follow directions
  • Capacity to work cooperatively with others
  • No experience required
  • Must be able to carry up to 60 lbs, placing items above and below head height
  • Standing, walking, bending for the duration of the shift, occasionally pushing and pulling to move equipment, mops, and brooms
  • Exposed to variable temperatures
Job Responsibility
Job Responsibility
  • Using hands or a dishwasher to clean dishes, glassware, pots, pans, flatware, and kitchen items, ensuring all sanitizer levels on dish machines and pot sinks are at the specific requirements for health standards
  • Store clean dishes, utensils, and cooking equipment
  • Clean work area including equipment, floors, walls, and cooking area, keeping the kitchen wares storage organized
  • Remove trash from the dish room and transport it to the dumpster, as well as clean and sanitize the garbage cans
What we offer
What we offer
  • Weekly pay
  • Training and development opportunities
  • Employee discounts
  • Flexible work schedules
  • Health, dental, and vision insurance
  • 401(k) with company match
  • Paid vacation days and holidays
  • Paid parental bonding leave
  • Employee assistance program
  • Tuition and/or professional certification reimbursement
Read More
Arrow Right
New

Account Executive

Account Executive (French-speaking) for the Categories and Expansion team at Wha...
Location
Location
United Kingdom; Germany , London; Berlin
Salary
Salary:
75000.00 - 115000.00 GBP; EUR / Year
whatnot.com Logo
Whatnot
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in a fast-paced, client-facing role
  • Track record of working quickly and iteratively
  • Fast learner and self-starter energized by talking to people, solving challenges, and driving towards sales goals
  • Fluent French and English speaker with a deep understanding of the French market
  • Passion for Whatnot's mission
  • Scrappy and flexible enough to work in an ambiguous environment with limited guidance
  • Experience selling and closing deals
  • Ability to manage multiple accounts and client needs at the same time
  • Proficiency with a CRM software
  • Business acumen, deeply analytical, and comfortable understanding and manipulating data
Job Responsibility
Job Responsibility
  • Drive the expansion of Whatnot’s supply by acquiring and nurturing new livestream sellers
  • Oversee your own portfolio and manage the entire sales cycle
  • Deeply understand our end-to-end sales process and collaborate with the team to bring high-potential sellers to Whatnot
  • Become the go-to expert on how SMBs can scale their business with Whatnot
  • Source and prospect sellers, securing initial discovery and onboarding calls
  • Lead sales calls with seller prospects, primarily over video and phone calls
  • Close sellers, ultimately onboarding them onto the platform, and setting them up for success
  • Utilize key data points to assess seller growth, success, and areas for improvement
  • Collaborate with internal partners to develop business growth strategies and communicate product improvements and feedback
What we offer
What we offer
  • Generous Holiday and Time off Policy
  • Health Insurance options including Medical, Dental, Vision
  • Work From Home Support
  • Home office setup allowance
  • Monthly allowance for cell phone and internet
  • Care benefits
  • Monthly allowance for wellness
  • Annual allowance towards Childcare
  • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement
  • Fulltime
Read More
Arrow Right
New

Sr./Staff Data Scientist

Shape the future of trust in the age of AI. At Oscilar, we're building the most ...
Location
Location
Salary
Salary:
Not provided
oscilar.com Logo
Oscilar
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in data science, machine learning, or a related field, with a focus on fraud prevention and/or anti-money laundering
  • Proficiency in Python
  • Fluency in cloud development (AWS, GCP, Azure, etc.) and MLOps is a plus
  • Strong knowledge of machine learning algorithms and statistical techniques, with a focus on their application in fraud detection
  • Experience working with large datasets using distributed systems like Apache Spark and Dask, handling data-related challenges such as data cleaning, data quality, and data transformation and feature engineering at scale
  • Excellent analytical and problem-solving skills, with the ability to derive actionable insights from complex data
  • Strong communication skills, with the ability to explain complex concepts and findings to both technical and non-technical audiences
  • Ability to work independently and collaboratively in a fast-paced, dynamic startup environment
Job Responsibility
Job Responsibility
  • Develop and implement advanced fraud detection models, leveraging machine learning and statistical techniques, to identify and prevent fraudulent activities across our platform
  • Collaborate with cross-functional teams, including engineering, product, and operations, to design and implement fraud detection systems and processes
  • Analyze large volumes of data to identify patterns, trends, and anomalies indicative of fraudulent behavior, and develop data-driven insights to improve fraud prevention strategies
  • Evaluate the performance of existing fraud detection models and systems, and continuously optimize and update them to adapt to changing fraud trends and tactics
  • Stay up-to-date with the latest trends and advancements in fraud detection, data science, and machine learning, and apply this knowledge to enhance our fraud prevention capabilities
  • Communicate complex data analysis and model performance results to both technical and non-technical stakeholders, driving data-driven decision-making across the organization
  • Ensure data privacy and security compliance in all aspects of fraud detection and data analysis
What we offer
What we offer
  • Competitive salary and equity packages, including a 401k
  • Remote-first culture — work from anywhere
  • 100% Employer covered comprehensive health, dental, and vision insurance with a top tier plan for you and your dependents (US)
  • Unlimited PTO policy
  • AI First company
  • both Co-Founders are engineers at heart
  • and over 50% of the company is Engineering and Product
  • Family-Friendly environment
  • Regular team events and offsites
  • Unparalleled learning and professional development opportunities
  • Fulltime
Read More
Arrow Right
New

Customer Success Manager - Strategic Accounts

In this role, you’ll work regularly with our largest, “Strategic” customer accou...
Location
Location
United States , New York City
Salary
Salary:
130000.00 - 170000.00 USD / Year
assembled.com Logo
Assembled
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of working experience
  • At least 3 years in customer-facing, highly strategic, operational, and analytical environments (e.g., business operations, management consulting or customer success)
  • Relationship building & managing up
  • Grit, determination and tenacity
  • Track record for getting things done
  • Ability to think strategically while being in the weeds
  • Growth mindset
  • Nose for value
  • Great team member
  • Willing and able to travel to meet with customers in person
Job Responsibility
Job Responsibility
  • Account manage a portfolio of our most strategic customers
  • Project-manage customer initiatives with internal & external stakeholders
  • Actively gather and communicate learnings and customer feedback to product and engineering teams
  • Drive and own retention efforts to identify upsell opportunities, lead renewal negotiations and own churn mitigation
  • Lead strategic initiatives to improve our Customer team processes
  • Maintain and build our systems
  • Work in tandem with Solutions, AI Deployment Strategists and Technical Support
What we offer
What we offer
  • Generous medical, dental, and vision benefits
  • Paid company holidays, sick time, and unlimited time off
  • Monthly credits to spend on each: professional development, general wellness, Assembled customers, and commuting
  • Paid parental leave
  • Hybrid work model with catered lunches everyday (M-F), snacks, and beverages in our SF & NY offices
  • 401(k) plan enrollment
  • Stock options
  • Fulltime
Read More
Arrow Right
New

Engineering Coordinator

Job Title Engineering CoordinatorJob Location Jagiroad, Assam (On Site)Roles & R...
Location
Location
India , Jagiroad, Assam
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
March 20, 2026
Flip Icon
Requirements
Requirements
  • Candidate preferred from design consultancy background
  • Bachelor’s degree in engineering in (Mechanical or Electrical). Mech. Discipline will be first preference
  • 14+ years' experience in engineering coordination/project engineering, with at least 5 years in EPC projects for Oil & Gas, Refinery, Petrochemical, Solar, Datacenter, Pharmaceuticals
  • Solid understanding of multidisciplinary engineering workflows (civil, piping, electrical, automation, process)
  • Strong familiarity with EPC project execution tools (3D model reviews, document control systems, scheduling tools)
  • Excellent organizational, communication, and coordination skills
  • Proven ability to work under pressure in a fast-paced EPC environment
Job Responsibility
Job Responsibility
  • Act as the central coordination point between engineering disciplines (civil, structural, mechanical, piping, electrical, automation, and process)
  • Monitor and track engineering deliverables, schedules, and progress, ensuring alignment with EPC milestones
  • Facilitate interdisciplinary reviews, design freeze meetings, and technical interface resolution
  • Support preparation and consolidation of project engineering reports, forecasts, and dashboards for project management and client reporting
  • Review and verify technical documents to ensure completeness, consistency, and compliance with project requirements
  • Liaise with procurement, construction, and commissioning teams to ensure smooth transfer of engineering data and deliverables
  • Interface with clients, vendors, and subcontractors, resolving technical coordination issues
  • Support the enforcement of HSE, quality, and compliance standards across engineering deliverables
  • Assist the Engineering Manager in managing workload distribution and resource planning
  • Fulltime
Read More
Arrow Right
New

Food and Beverage Vendor

Delaware North Sportservice is hiring seasonal Food and Beverage Vendors to join...
Location
Location
United States , Cincinnati
Salary
Salary:
11.00 USD / Hour
casinocareers.com Logo
Casino Careersv
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must possess a high level of self-confidence, with the ability to sell assigned items
  • Basic math skills
  • ability to accurately account for cash and inventory
  • Strong communication skills, including listening skills and the ability to communicate with guests and respond to inquiries
  • Frequent walking throughout the venue and project voice to market and sell products for long periods of time
  • Ability to lift and carry up to 100 lbs
Job Responsibility
Job Responsibility
  • Circulate among guests within assigned sections
  • call out and sell alcohol or other food and beverage products
  • Serve alcoholic beverages responsibly, request identification and adhere to unit and company alcohol service policies
What we offer
What we offer
  • Weekly pay
  • Training and development opportunities
  • Employee discounts
  • Flexible work schedules
  • health, dental, and vision insurance
  • 401(k) with company match
  • paid vacation days and holidays
  • paid parental bonding leave
  • employee assistance program
  • tuition and/or professional certification reimbursement
Read More
Arrow Right