This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are seeking a highly experienced and motivated Lead Data Engineer to join our Data Analytics developers team. The ideal candidate will possess 10-15 years of extensive experience in the finance domain, with a strong background in designing, developing, and maintaining robust data pipelines and systems. This role requires deep technical expertise in database technologies, programming, and automation, coupled with the ability to lead projects independently and effectively communicate with business stakeholders. The successful candidate will play a critical role in transforming raw data into actionable insights, driving strategic decision-making within the organization, building AI-based solutions, and leveraging cutting-edge Agentic AI solutions and AI-powered productivity tools to enhance data engineering processes.
Job Responsibility
Design, develop, and optimize scalable and high-performance data pipelines using various technologies to support business intelligence and analytical needs
Work closely with business users, analysts, and other engineering teams to understand data requirements and translate them into technical solutions
Develop and maintain complex SQL and PL/SQL scripts for data extraction, transformation, and loading (ETL) processes, primarily on Oracle databases, focusing on performance tuning and optimization
Implement and manage automation workflows using Autosys to schedule and monitor batch jobs, ensuring data availability and integrity
Develop and maintain data processing scripts and applications using Python, focusing on efficiency, reliability, writing performant code, and best practices
Manage and operate data processes within a Unix/Linux environment, including scripting for process automation, monitoring, and troubleshooting
Contribute to the continuous integration and continuous deployment (CI/CD) pipeline for data solutions, promoting automation and efficiency in software delivery
Ensure data quality, accuracy, and consistency across all data platforms
Explore, evaluate, and integrate Agentic AI frameworks and AI-driven tools to enhance productivity, automate routine tasks, and optimize data engineering workflows
Design, build, and deploy AI-driven solutions to solve complex business problems and enhance data analytics capabilities
Independently drive projects from inception to completion, taking ownership of technical design, implementation, and deployment
Provide technical guidance and mentorship to junior team members
Act as a subject matter expert for data engineering practices and technologies within the team
Troubleshoot data-related issues and perform root cause analysis to implement effective solutions
Requirements
Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field
10-15 years of progressive experience in Data Engineering roles within the finance industry
Proven expertise in Oracle SQL and PL/SQL for complex data manipulation, stored procedures, functions, and database performance optimization
Strong proficiency in Python for data processing, scripting, and application development, with a focus on writing high-performance, efficient code
Extensive experience with job scheduling tools, specifically Autosys, including job definition, dependency management, and monitoring
Solid understanding and hands-on experience with Unix/Linux operating systems, including shell scripting and command-line tools
Demonstrated experience in implementing and maintaining CI/CD pipelines for data engineering projects
Deep understanding of data warehousing concepts, ETL/ELT principles, and data modeling techniques
Methodology of AI includes Chunking, Embedding, AI Engineering, Prompt Engineering
Extensive Design Experience handling Large Data Volume
Realtime data Processing over Kafka/ Solace etc.
Nice to have
Experience with other database technologies (e.g., Oracle, PostgreSQL, SQL Server)
Familiarity with cloud platforms (AWS, Azure, GCP) and their data services
Knowledge of big data technologies (e.g., Spark, Hadoop)
Demonstrated exposure to Agentic AI concepts, frameworks, and applications
Practical experience utilizing AI tools to improve productivity in data-related tasks (e.g., code generation, anomaly detection, automated data cleansing)
Experience in developing and deploying machine learning models or AI solutions in a production environment
Methodology of AI includes Chunking, Embedding, AI Engineering, Prompt Engineering
Excellent verbal and written communication skills with the ability to interact effectively with business users, technical teams, and senior management
Strong problem-solving and analytical skills, with a keen eye for detail
Ability to work independently, prioritize tasks, and manage multiple projects concurrently
Demonstrated ability to drive initiatives and deliver high-quality solutions with minimal supervision
Proactive and self-motivated with a continuous learning mindset