Senior Data Engineer

• Lead moderately complex initiatives and deliverables within technical domain environments
• contribute to large scale planning of strategies
• design, code, test, debug, and document for projects and programs associated with technology domain, including upgrades and deployments
• review moderately complex technical challenges that require an in-depth evaluation of technologies and procedures
• resolve moderately complex issues and lead a team to meet existing client needs or potential new clients needs while leveraging solid understanding of the function, policies, procedures, or compliance requirements
• collaborate and consult with peers, colleagues, and mid-level managers to resolve technical challenges and achieve goals
• lead projects and act as an escalation point, provide guidance and direction to less experienced staff

4+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education

• Good understanding on workings of Rest APIs, Dremio and Object store
• experience in building pipelines with Apache Kafka
• at least 4+ years of experience in building big data pipelines
• at least 4+ years of experience working with Apache Spark, Hive and Hadoop
• good experience with programming in Python, Spark-SQL and good understanding of bash scripting
• good experience in working with CI/CD pipelines, improving code coverage and vulnerability remediation
• 2+ years of experience in Agile mode of working

• Equal employment opportunity
• collaborative work environment
• opportunities for technical knowledge growth and hands-on development
• access to seasoned colleagues
• robust curriculum to enhance engineering skills