Lead Big Data Engineer

• Design, develop, and maintain big data pipelines using PySpark and Apache Iceberg
• Optimize data workflows for performance and scalability
• Implement data transformation, cleansing, and enrichment processes
• Collaborate with data scientists and analysts to deliver actionable insights
• Ensure data quality, consistency, and security across all pipelines
• Monitor and troubleshoot data pipeline issues in production

• Strong experience with PySpark and Apache Iceberg
• Proficiency in distributed data processing and big data technologies
• Knowledge of data modeling and schema design
• Familiarity with cloud platforms like AWS, Azure, or GCP
• Experience with version control tools like Git
• 12-15 years of relevant experience in Apps Development or systems analysis role
• Extensive experience in system analysis and programming of software applications
• Experience in managing and implementing successful projects
• Subject Matter Expert (SME) in at least one area of Applications Development
• Ability to adjust priorities quickly as circumstances dictate
• Demonstrated leadership and project management skills
• Consistently demonstrates clear and concise written and verbal communication
• Bachelor's degree/University degree or equivalent experience

Master's degree preferred