This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Embark on a transformative journey as a Senior Data Engineer – AVP. At Barclays, our vision is clear – to redefine the future of banking and help craft innovative solutions. In this role, you’ll work on a greenfield data and intelligence platform for Equities, helping to shape the architecture, tooling, and strategic direction of a modern data ecosystem. You’ll collaborate with global engineering and business teams to enable scalable analytics, real-time insights, and data-driven decision-making across the trading business.
Job Responsibility:
Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
Development of processing and analysis algorithms fit for the intended data complexity and volumes
Collaboration with data scientist to build and deploy machine learning models
Requirements:
Experience with Python for data engineering and services, including FastAPI, PySpark, Pydantic, and asyncio
Experience with Cloud platforms and data services across AWS such as EC2, ECS/Fargate, EMR, Glue, and S3
Experience with Data orchestration and workflow tools such as Airflow or Dagster
Experience with Modern data lake and storage ecosystems including Iceberg, Parquet, and data catalogs
Experience with Caching and performance optimization for production systems such as Redis
Nice to have:
Experience with Databricks or Snowflake
Experience with Observability and monitoring platforms such as Grafana or Splunk
Experience with Streaming and messaging technologies such as Kafka