CrawlJobs Logo

Big Data Engineer

https://www.citi.com/ Logo

Citi

Location Icon

Location:
India, Chennai

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

We are looking for a Big Data Engineer with expertise in PySpark and Apache Iceberg to design and implement scalable data pipelines. The candidate will work on processing large datasets, optimizing data workflows, and ensuring data quality and reliability.

Job Responsibility:

  • design, develop, and maintain big data pipelines using PySpark and Apache Iceberg
  • optimize data workflows for performance and scalability
  • implement data transformation, cleansing, and enrichment processes
  • collaborate with data scientists and analysts to deliver actionable insights
  • ensure data quality, consistency, and security across all pipelines
  • monitor and troubleshoot data pipeline issues in production

Requirements:

  • 8+ strong experience with PySpark and Apache Iceberg
  • proficiency in distributed data processing and big data technologies
  • knowledge of data modeling and schema design
  • familiarity with cloud platforms like AWS, Azure, or GCP
  • experience with version control tools like Git
  • bachelor’s degree/University degree or equivalent experience

Additional Information:

Job Posted:
August 01, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.