Senior Big Data Developer

• Design and implement scalable data pipelines using Apache Spark, Scala, Hive, and Impala to process large volumes of structured and unstructured data
• Optimize data workflows for performance and scalability in distributed computing environments
• Perform advanced data analysis to support business decision-making and reporting
• Develop and maintain data models (e.g., star schema, snowflake schema) to ensure efficient data storage and retrieval
• Collaborate with BI teams to integrate data into tools like Tableau and Power BI for visualization and reporting
• Ensure data accuracy and consistency in dashboards and reports
• Work with financial datasets to support risk management, compliance, and reporting requirements
• Ensure adherence to regulatory standards and data governance policies
• Manage and monitor Autosys job scheduling for data workflows
• Automate repetitive tasks and optimize job execution to improve operational efficiency
• Use GIT for version control and collaborate with team members on code reviews and branching strategies
• Track and manage tasks using JIRA to ensure timely delivery of project milestones
• Implement and maintain CI/CD pipelines for automated testing, deployment, and monitoring of big data applications
• Collaborate with DevOps teams to ensure seamless integration and deployment processes
• Ensure data quality, security, and compliance with organizational and regulatory standards
• Implement data governance practices, including metadata management and lineage tracking
• Provide technical guidance and mentorship to junior developers
• Collaborate with cross-functional teams, including data engineers, analysts, and business stakeholders, to deliver high-quality solutions

• 5+ years of experience in big data development and data engineering
• Expertise in Apache Spark, Scala, Hive, Impala, and distributed computing frameworks
• Proficiency in SQL and experience with data modeling techniques
• Hands-on experience with Autosys, GIT, JIRA, and CI/CD pipelines
• Familiarity with BI tools like Tableau or Power BI
• Knowledge of cloud platforms (e.g., AWS, Azure, GCP) is a plus
• Strong understanding of financial datasets, risk management, and compliance workflows
• Excellent problem-solving and analytical skills
• Strong verbal and written communication skills
• Ability to work in a fast-paced environment and manage multiple priorities effectively
• Leadership and mentorship skills
• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field

Knowledge of cloud platforms (e.g., AWS, Azure, GCP)