CrawlJobs Logo

Lead Big Data Developer

https://www.citi.com/ Logo

Citi

Location Icon

Location:
India, Chennai

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

Not provided

Job Description:

We are seeking an experienced and highly motivated Lead Big Data Developer (C12) to drive the development, standardization, and governance of data across our Big Data Portfolio. This role is crucial in ensuring compliance with regulatory mandates, consent orders, and data governance policies, while also optimizing data pipelines and architectures for high-performance applications. The successful candidate will work closely with business stakeholders, data scientists, and engineering teams to establish enterprise-wide data consistency and improve data quality, lineage, and reconciliation processes. The ideal candidate will have a strong background in Big Data technologies, data standardization frameworks, and regulatory compliance related to financial data management.

Job Responsibility:

  • Lead the design, implementation, and optimization of scalable and standardized Big Data architectures
  • Drive data standardization efforts in alignment with regulatory requirements, consent orders, and enterprise data policies
  • Ensure data lineage, quality, and governance compliance across all critical data elements (CDEs)
  • Collaborate with Risk, Compliance, and Regulatory teams to address consent order requirements related to data controls, reconciliation, and validation
  • Implement data quality frameworks, metadata management, and lineage tracking for improved data transparency and regulatory reporting
  • Optimize data ingestion, transformation, and processing pipelines using streaming and batch processing methodologies
  • Develop and enforce data security and privacy controls to meet internal and external regulatory expectations
  • Work closely with cross-functional teams to automate data reconciliation and anomaly detection
  • Provide technical leadership to junior and mid-level engineers, fostering a culture of engineering excellence and regulatory adherence.

Requirements:

  • 8+ years of experience in data engineering, Big Data platforms, and software development
  • Strong expertise in Big Data technologies (Spark, Hadoop, Hive, Impala, Kafka, Scala, Cloudera)
  • Experience with data governance, data standardization, and metadata management frameworks
  • Strong SQL and NoSQL experience (Oracle, MongoDB, PostgreSQL) for data extraction, reconciliation, and transformation
  • Proficiency in Python, Java, and Shell scripting for data processing and automation
  • Experience implementing data lineage and data quality monitoring solutions
  • Understanding of data privacy regulations (GDPR, CCPA) and financial regulatory frameworks (BCBS 239, CCAR, Basel, OCC Consent Orders)
  • Familiarity with cloud-based data solutions (AWS, GCP, or Azure)
  • Ability to translate complex regulatory requirements into actionable data strategies
  • Experience in Capital Markets, Risk, Finance, and Regulatory Reporting is a plus
  • Strong analytical and problem-solving skills with a compliance-driven mindset.

Nice to have:

  • Experience working with Consent Order Remediation Programs related to data management and governance
  • Expertise in Canonical Data Models and Data Mesh Architecture
  • Ability to liaise with regulators and internal audit teams to demonstrate data controls and compliance adherence
  • Strong technical documentation and communication skills for presenting data standardization strategies.

Additional Information:

Job Posted:
June 18, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.