Data Engineer

• Leads Level 4 operational coverage: Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects
• Design, build, test and deploy fixes to non-production environment for Customer testing
• Work with Customer to deploy fixes on production upon receiving Customer acceptance of fix
• Cost / Performance optimization and Audit / Security including any associated infrastructure changes
• Troubleshooting incident/problem, includes collecting logs, cross-checking against known issues, investigate common root causes
• Knowledge Management: Create/update runbooks as needed
• Governance: Watch all the configuration changes to batches and infrastructure (cloud platform) along with mapping it with proper documentation and aligning resources
• Communication: Lead and act as a POC for customer from off-site, handling communication, escalation, isolating issues and coordinating with off-site resources while level setting expectation across stakeholders
• Change Management: Align resources for on-demand changes and coordinate with stakeholders as required
• Request Management: Handle user requests – if the request is not runbook-based create a new KB or update runbook accordingly
• Incident Management and Problem Management, Root cause Analysis, coming up with preventive measures and recommendations such as enhancing monitoring or systematic changes as needed

• Bachelor’s degree in computer science or other related field
• 10+ years of hands-on experience in configuring and managing AWS/tableau and databricks solutions
• Good hands-on Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau
• Ability to read and write sql and stored procedures
• Good hands-on experience in configuring, managing and troubleshooting along with general analytical and problem-solving skills
• Excellent written and verbal communication skills
• Ability to communicate technical info and ideas so others will understand
• Ability to successfully work and promote inclusiveness in small groups
• Experience with Databricks and tableau environment is desired
• Extensive problem-solving skills and the ability to research an issue, determine the root cause, and implement the resolution
• Must have the ability to prioritize issues and multi-task

Experience with Databricks and tableau environment is desired