CrawlJobs Logo

Lead Data Engineer

https://www.citi.com/ Logo

Citi

Location Icon

Location:
India, Bengaluru

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

We are seeking an exceptionally skilled and experienced Lead Data Engineer to spearhead the re-engineering and automation of our Management Information Systems (MIS) reporting processes. The ideal candidate will possess deep expertise in data engineering, automation, and Big Data technologies, particularly SAS and PySpark. You will collaborate extensively with our larger MIS reporting team, understand the existing operational models, standardize disparate processes, and implement end-to-end automation solutions.

Job Responsibility:

  • Conduct in-depth analysis of existing manual MIS reporting processes and data flows within USPB MIS reporting team
  • Design, architect, and develop robust, scalable, and automated data pipelines and reporting solutions
  • Implement automation solutions using advanced programming techniques with a strong focus on SAS and PySpark in a Big Data environment
  • Drive the adoption of consistent reporting standards, data governance principles, and best practices across all MIS reporting activities
  • Work closely with the MIS reporting team, business stakeholders, and IT partners to gather requirements and define technical specifications
  • Ensure the highest levels of data quality, integrity, and security throughout the automated reporting lifecycle
  • Stay abreast of emerging data engineering, Big Data, and automation technologies
  • Create comprehensive technical documentation for all developed solutions, data models, and processes

Requirements:

  • 8-12 years of progressive experience in data engineering, data warehousing, business intelligence, and process automation
  • Extensive hands-on experience with Big Data technologies and ecosystems (e.g., Hadoop, Spark, Hive, Kafka)
  • Strong proficiency in SAS programming for complex data manipulation, statistical analysis, and reporting
  • Demonstrated expertise in PySpark for large-scale data processing, ETL/ELT, and automation within a Big Data context
  • Solid understanding of relational databases (SQL Server, Oracle, etc.), SQL, data modeling (dimensional, normalized), and database performance tuning
  • Proven track record of designing and implementing end-to-end data automation solutions
  • Exceptional analytical, problem-solving, and critical thinking skills
  • Excellent verbal and written communication skills
  • Ability to work effectively in a team-oriented, collaborative environment
  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related quantitative field

Additional Information:

Job Posted:
October 28, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.