This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
For this role, we are seeking a Senior Data Engineer for our Client's ETL Support Team to act as a technical pillar during our Client's transition to an AWS-native data environment. You will be a key escalation point, responsible for handling the most complex data pipeline issues. This role may move beyond simple support; you might be requested to harden and improve our Client's systems by driving performance tuning, cost optimization, and automation initiatives.
Job Responsibility:
Monitor approximately 2,300 scheduled jobs (daily, weekly, monthly) to ensure timely and successful execution
Execute on-demand jobs as required by the business
Troubleshoot job failures, perform detailed root cause analysis (RCA), and provide clear documentation for all findings
Address and resolve bugs and data-related issues reported by the business team
Verify source file placement in designated directories to maintain data integrity
Reload Change Data Capture (CDC) tables when structural changes occur in source systems
Help manage synchronization between external databases (including Teradata write-backs) and AWS Glue tables
Assist in developing new solutions, enhancements, and bug fixes using AWS Glue, Lambda, and Step Functions
Answer questions from the business and support User Acceptance Testing (UAT) inquiries
Make timely decisions to resolve issues, execute tasks efficiently, and escalate complex problems to senior or lead engineers as needed, all while maintaining agreed-upon SLAs
Participate in knowledge transfer to internal resources and assist in creating necessary documentation and runbooks
Requirements:
In-depth knowledge of AWS Glue, AWS Lambda, and AWS Step Functions
A deep understanding of ETL processes and data warehouse design
Proven ability to troubleshoot data pipelines and perform root cause analysis (RCA)
3-5 years of relevant experience
Hands-on experience with Glue, Lambda, and Step Function development
Must be able to work a day shift that includes coverage for weekends and holidays on a rotational basis
Nice to have:
Familiarity with Change Data Capture (CDC) processes, Teradata, and integration with SAS & RMJ events
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.