Data Engineering Python and Pyspark - Assistant Vice President

• Build and maintain batch or real-time data pipelines in data platform
• Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources
• Develop ETL (extract, transform, load) processes to help extract and manipulate data from multiple sources
• Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
• Automate data workflows such as data ingestion, aggregation, and ETL processing
• Analyze large datasets to identify trends, anomalies, and behavioral patterns
• Apply machine learning and AI concepts (supervised / unsupervised learning) to support predictive and exploratory analysis
• Perform feature engineering and data transformations to enable ML models
• Support trend analysis, segmentation, clustering, and forecasting use cases
• Interpret analytical results and translate them into business-friendly insights
• Prepare raw data in Data Warehouses into a consumable dataset for both technical and non-technical stakeholders
• Build, maintain, and deploy data products for analytics and data science teams on data platform
• Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures
• Monitor data systems performance and implement optimization solution
• Has the ability to operate with a limited level of direct supervision
• Can exercise independence of judgement and autonomy
• Acts as SME to senior stakeholders and /or other team members
• Serve as advisor or coach to new or lower level analysts
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

• 8 to 14 years of relevant experience in Data engineering role
• Advanced SQL/ RDBMS skills and experience with relational databases and database design
• Strong proficiency in object-oriented languages: Python, PySpark is must
• Experience working with Bigdata - Hive/Impala/S3/HDFS
• Experience working with data ingestion tools such as Talend or Ab Initio
• Strong experience in data analysis, data exploration, and trend identification
• Solid understanding of machine learning fundamentals like Regression, classification, clustering, Feature engineering
• Strong proficiency in scripting languages like Bash, UNIX Shell scripting
• Strong proficiency in data pipeline and workflow management tools
• Strong project management and organizational skills
• Excellent problem-solving, communication, and organizational skills
• Proven ability to work independently and with a team
• Experience in managing and implementing successful projects
• Ability to adjust priorities quickly as circumstances dictate
• Consistently demonstrates clear and concise written and verbal communication
• Bachelor's degree/University degree or equivalent experience

Working with data lakehouse architecture such as AWS Cloud/Airflow/Starburst/Iceberg