Job Description
Amazon Security (AmSec) is looking for a Data Engineer II to join a team of highly skilled individuals working on our initiatives in resource and application discovery within Amazon security. Our product, Veritas, is a foundational service within Amazon security that provides data for security initiatives like security reviews, threat modeling and detection, access control and incident response. You will be part of a AmSec organization that spans over ten countries worldwide, catering to a wide variety of customer use cases, including security intelligence, application security, incident response, security operations, risk and compliance, acquisitions and subsidiaries, and external partner security. You will work closely with a diverse range of roles, such as Software Development Engineers, Data Scientist, Data Engineers, Technical Program Managers, Product managers and our Security Engineer customers, to build high quality datasets for security investigations, application modeling, and more. You’ll primarily work with AWS services such as EMR, Glue, Athena, Redshift, S3, SNS, SQS, Apache Airflow, along with some internal tools. You’ll also be part of our transformation journey to build data objects by leveraging AI. Our data lake contains over 500 datasets from various sources, with some handling daily volumes exceeding PBs. As Data Engineer, you will be gathering and understanding data requirements, partnering with software engineers, and collaborating across roles and teams to create the necessary data infrastructure and high quality pipelines to drive our team's initiatives. We have high-visibility data ingestion goals in a fast-paced, operational environment. The ideal candidate should enjoy the challenge of operating complex and mission-critical systems under ambiguity.
