This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Join us as a Data Engineer at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. This role is responsible for delivering the technology stack, using strong analytical and problem-solving skills to understand the business requirements and deliver quality solutions coming up with the ETL process design / data pipeline of the Foundational / Consolidated and Business data Products for the Tesco Tenancy on EDP. The resource will be working on complex technical problems that will involve detailed analytical skills and analysis. This will be done in conjunction with fellow engineers, business analysts and business stakeholders.
Job Responsibility
Spearhead the evolution of our digital landscape, driving innovation and excellence
Deliver the technology stack, using strong analytical and problem-solving skills to understand the business requirements and deliver quality solutions coming up with the ETL process design / data pipeline of the Foundational / Consolidated and Business data Products for the Tesco Tenancy on EDP
Work on complex technical problems that will involve detailed analytical skills and analysis
Develop and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools
Ensure that code is scalable, maintainable, and optimized for performance
Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
Collaborate with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
Stay informed of industry technology trends and innovations and actively contribute to the organization's technology communities to foster a culture of technical excellence and growth
Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
Requirements
Experience in ETL / data processing / data warehousing / data engineering / RDBMS / PySpark
Experience in Data Processing and ETL in On-prem and Cloud based systems
Preferred AWS cloud development, with a strong understanding of AWS services (e.g., EC2, S3, Lambda, RDS, DynamoDB, etc.)
Proficient in at least one Python programming language
Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform etc.
Experience with CI/CD tools and pipelines (Jenkins, GitLab CI, etc.) for automation and deployment
Good understanding of cloud security best practices and experience with IAM, VPC, security groups, and encryption mechanisms
Good knowledge of monitoring, logging, and troubleshooting tools (e.g. CloudWatch, CloudTrail)
Experience with version control systems (Git, GitHub, Bitbucket)
Strong communication skills and ability to work in a collaborative team environment
The role works with business stakeholders to translate needs into technical solutions and align to solution architecture
The role should be able to scale up and align to the BUK CDAO tech tooling strategy e.g. EDP capabilities, Databricks etc.
It incorporates security principles into designs, deliverables
Ensures compliance with standards (CSO, CDO, CDA etc.), executes and tests end-to-end Data Pipeline
Meets non-functional requirements like scalability, security, and resilience
Data solutions must follow 'data product principles' and the CDA team's best practices for data modelling, compliance, and security
Nice to have
Experience with Cloud based services and integrations