This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Our analysts transform data into meaningful insights that drive strategic decision making. They analyze trends, interpret data, and discover opportunities. Working cross-functionally, they craft narratives from the numbers - directly contributing to our success. Their work influences key business decisions and shape the direction of Comcast. The Data Engineer3 for the Data Products Engineering Team will be building data pipelines to land, profile and store multiple internal & external datasets and build applications that surface this data to support our business partners’ strategic decision making. We are an AWS shop that uses opensource technologies like Scala, Python, Pandas, Spark, Iceberg, Postgres, and BI tools like Tableau and MicroStrategy. We work in a very agile environment, where product specifications are flexible and often change rapidly over time. We are seeking people who are comfortable with ambiguity, can drive towards clarity and define execution plans.
Job Responsibility:
Responsible for designing, building and overseeing the deployment and operation of technology architecture, solutions and software to capture, manage, store and utilize structured and unstructured data from internal and external sources
Establishes and builds processes and structures based on business and technical requirements to channel data from multiple inputs, route appropriately and store using any combination of distributed (cloud) structures, local databases, and other applicable storage forms as required
Develops technical tools and programming that leverage artificial intelligence, machine learning and big-data techniques to cleanse, organize and transform data and to maintain, defend and update data structures and integrity on an automated basis
Creates and establishes design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements
Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs
Work with data modelers/analysts to understand the business problems they are trying to solve then create or augment data assets to feed their analysis
Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions
Must understand the basics of relational data modeling and be able to clearly articulate the reasons to use non-relational systems in our architecture
Interface with other technology teams to leverage cloud-native data engineering principles to deliver high quality data faster
Foster a DevOps culture and participate in development sprints, retrospectives, releases, and deployments
Build and manage relationships to optimize value creation from ideation to delivery
Requirements:
Bachelor's degree in engineering, Computer Science, Information Systems, or related field with 5-8 years of relevant experience
2+ years of hands-on experience in design, build, test, orchestrate, deploy large scale Scala Spark ETL Jobs
2+ years of experience with AWS technologies such as S3, Athena, Lambdas, EMR or EMR Serverless or similar
1+ years of Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL or Data Warehouse methodologies and technologies
Experience in Open Table Format such as Iceberg or similar, Datawarehouse such as Snowflake or similar, MySQL or Postgres or similar is a plus
Strong problem-solving skills
General understanding of SDLC and Agile Methodologies
General understanding of Test-Driven Development and CI/CD
General understanding of cloud data engineering design patterns, data storage principles, and related use cases