CrawlJobs Logo
Barclays Logo Barclays · IT - Software Development

Data Engineer

India, Pune · Job Posted December 28, 2025
Apply Position
Job Link Share

Job Description

A career in Data & Analytics at Barclays is a hub for top talent, from beginners to experts, fostering innovation and excellence. You'll drive business strategy, leverage data potential, and enhance the experience of millions of customers in today’s data-driven world. Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. Purpose of the role: To enable data-driven strategic and operational decision making through extracting actionable insights from large datasets, performing statistical and advanced analytics to uncover trends and patterns, and presenting findings through clear visualisations and reports.

Job Responsibility

  • Support the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards
  • Spearhead the evolution of our digital landscape, driving innovation and excellence
  • Harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences
  • Investigation and analysis of data issues related to quality, lineage, controls, and authoritative source identification, documenting data sources, methodologies, and quality findings with recommendations for improvement
  • Designing and building data pipelines to automate data movement and processing
  • Apply advanced analytical techniques to large datasets to uncover trends and correlations, develop validated logical data models, and translate insights into actionable business recommendations that drive operational and process improvements, leveraging machine learning/AI
  • Through data-driven analysis, translate analytical findings into actionable business recommendations, identifying opportunities for operational and process improvements
  • Design and create interactive dashboards and visual reports using applicable tools and automate reporting processes for regular and ad-hoc stakeholder needs

Requirements

  • Hands on experience in pyspark and strong knowledge on Dataframes, RDD and SparkSQL
  • Hands on Experience in developing, testing and maintaining applications on AWS Cloud
  • Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena)
  • Design and implement scalable and efficient data transformation/storage solutions using Snowflake
  • Experience in Data ingestion to Snowflake for different storage format such Parquet, Iceberg, JSON, CSV etc
  • Experience in using DBT (Data Build Tool) with snowflake for ELT pipeline development
  • Experience in Writing advanced SQL and PL SQL programs
  • Hands On Experience for building reusable components using Snowflake and AWS Tools/Technology
  • Should have worked at least on two major project implementations

Nice to have

  • Exposure to data governance or lineage tools such as Immuta and Alation is added advantage
  • Experience in using Orchestration tools such as Apache Airflow or Snowflake Tasks is added advantage
  • Knowledge on Abinitio ETL tool is a plus
  • Ability to engage with Stakeholders, elicit requirements/ user stories and translate requirements into ETL components
  • Ability to understand the infrastructure setup and be able to provide solutions either individually or working with teams
  • Good knowledge of Data Marts and Data Warehousing concepts
  • Resource should possess good analytical and Interpersonal skills
  • Implement Cloud based Enterprise data warehouse with multiple data platform along with Snowflake and NoSQL environment to build data movement strategy

What we offer

  • Hybrid working
  • Structured approach to hybrid working with fixed, ‘anchor’, days onsite
  • Supportive and inclusive culture and environment
  • Commitment to flexible working arrangements
  • International scale offering incredible variety, depth and breadth of experience
  • Chance to learn from a globally diverse mix of colleagues
  • Encouragement to embrace mobility and explore every part of operations
Barclays - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

We are looking for a Data Engineer to join a financial services organization in ...
Location
Location
United States , Greer
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building and maintaining data pipelines using Snowflake
  • Practical knowledge of Apache Kafka for streaming or event-based data ingestion
  • Experience working in cloud-based data environments with a focus on scalable architecture
  • Familiarity with Azure Databricks and its role within broader data engineering ecosystems
  • Understanding of data quality, monitoring, and observability practices in production environments
  • Ability to troubleshoot pipeline failures and resolve performance or reliability issues efficiently
  • Experience following engineering best practices for version control, testing, and deployment
  • Exposure to AI-assisted development tools such as Claude or similar coding support platforms
Job Responsibility
Job Responsibility
  • Design, build, and deliver end-to-end data pipelines in Snowflake that support business reporting and data consumption needs
  • Create new ingestion and transformation workflows while troubleshooting pipeline issues to improve stability and performance
  • Contribute to a delivery model that balances new development with targeted optimization of existing data assets and workflows
  • Implement streaming and event-driven ingestion patterns using Kafka to support timely and scalable data movement
  • Improve observability across the data ecosystem by strengthening monitoring, alerting, and data quality controls
  • Help simplify legacy data processes by reducing technical debt and modernizing outdated pipeline components
  • Apply sound software engineering standards, including maintainable code, documentation, and repeatable development practices
  • Support the advancement of testing and CI/CD processes by helping establish more consistent engineering workflows
  • Leverage AI-assisted development tools to accelerate coding, validation, and technical documentation where appropriate
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a financial services organization in ...
Location
Location
United States , Greer
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building and supporting data pipelines in Snowflake
  • Working knowledge of Apache Kafka for event-driven or streaming data ingestion
  • Experience in data engineering within a cloud-first environment
  • Familiarity with Azure Databricks and its role in broader data platforms
  • Ability to follow engineering best practices across development, testing, and deployment workflows
  • Understanding of data quality, monitoring, and observability concepts in production data systems
  • Comfortable working in an environment with a mix of modern and legacy data processes
  • Exposure to AI-assisted development tools such as Claude or similar coding and documentation assistants
Job Responsibility
Job Responsibility
  • Design, build, and deliver end-to-end data pipelines in Snowflake to support business and analytics needs
  • Create new data integration workflows while troubleshooting and resolving issues in existing pipelines
  • Apply sound engineering practices for coding, documentation, testing, and deployment to improve consistency and maintainability
  • Balance hands-on development of new solutions with optimization work that improves performance, stability, and efficiency
  • Develop streaming and ingestion processes using Kafka to enable timely and dependable data movement
  • Strengthen observability and data quality controls so pipeline health and accuracy are easier to monitor and maintain
  • Help reduce technical debt by simplifying legacy data processes and modernizing pipeline design where appropriate
  • Contribute to AI-assisted engineering efforts by using approved tools to accelerate development, testing, and documentation activities
What we offer
What we offer
  • Medical
  • Vision
  • Dental
  • Life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Engineer

As a Data Engineer you'll scale the way data powers Veygo. Our engineering teams...
Location
Location
United Kingdom , Cardiff
Salary
Salary:
Not provided
admiralgroup.co.uk Logo
Admiral Group Plc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in a Data Engineering role
  • Strong SQL skills with experience designing efficient and scalable data models
  • Hands-on experience with Snowflake and Matillion
  • Experience working within cloud-based environments, ideally AWS
  • Good understanding of ETL/ELT methodologies and data warehousing best practices
  • Experience using Python or other scripting languages
  • Experience supporting real-time or near real-time data solutions
  • Experience improving data observability and monitoring capabilities
  • Exposure to CI/CD practices within data engineering environments
  • Understanding of data governance, security, and best practices within modern data platforms
Job Responsibility
Job Responsibility
  • Provide technical guidance on data architecture, pipeline design, and optimisation to support scalable and reliable data solutions
  • Build and maintain ETL/ELT pipelines to ensure efficient ingestion and transformation of data
  • Design and optimise data models to support analytics, reporting, and real-time decision-making
  • Collaborate with cross-functional teams to ensure data is embedded into product and business initiatives from the outset
  • Improve data quality and observability through monitoring, logging, and lineage tracking best practices
  • Champion engineering standards including automated testing, CI/CD, and effective data governance
  • Support and troubleshoot production data pipelines, identifying opportunities to improve performance and resilience
  • Deploy and maintain secure, scalable cloud-based data infrastructure within AWS
  • Share knowledge through mentoring, paired working, and collaborative learning sessions
What we offer
What we offer
  • All colleagues eligible for up to £3,600 of free shares each year after one year of service
  • 33 days holiday (including bank holidays) when they join us, increasing the longer you stay with us, up to a maximum of 38 days (including bank holidays)
  • option to buy or sell up to an additional five days of annual leave
  • Financial & Mortgage Advice
  • 24-Hour Ecare
  • Cycle to Work Scheme
  • Flexible Working
  • Simply Health
  • Private Health Cover
  • Critical Illness Cover
  • Fulltime
Read More
Arrow Right

Data Engineer

AI is changing how software gets built. The data underneath it matters more than...
Location
Location
Denmark , København
Salary
Salary:
Not provided
life-science-talent-solutions.dk Logo
Life Science Talent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • dbt, SnowFlake, Databricks, Fabric, BigQuery or similar ecosystems
  • SQL, Python and APIs
  • Data modelling and warehousing
  • GenAI, ML or MLOps workflows
  • Complex systems and problem solving
Job Responsibility
Job Responsibility
  • Building modern data platforms and pipelines
  • Creating semantic foundations for AI systems
  • Developing AI-powered workflows and agentic systems
  • Helping clients move AI into real operational environments
  • Working closely with both technical teams and decision makers
  • Shaping how modern AI infrastructure is built in practice
  • Fulltime
Read More
Arrow Right

Data Engineer

FinXL by Randstad Digital focuses on developing client's Networking, Digital and...
Location
Location
Australia , Brisbane
Salary
Salary:
Not provided
finxl.com.au Logo
FinXL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineer background
  • Azure and Databricks experience
  • Experience in Cloud Infrastructure including Azure Data Lake, Databricks & Synapse
  • Experience in Data Visualisation Integration: presenting data to Power BI via Serverless SQL
  • Experience in reading and translating R, Python, and MATLAB scripts
  • Experience in Version Control - managing technical documentation and code in GitHub
Job Responsibility
Job Responsibility
  • complete an integrated data pipeline that maintains, manages, and updates the databases underpinning a process decision tool
  • Fulltime
Read More
Arrow Right
New

Data Engineer

The Senior Data Engineer is an advanced subject matter expert, accountable for t...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced knowledge of the definition and management of scoping requirements, definition and prioritization activities
  • Advanced understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models
  • Advanced expertise in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP
  • Advanced understanding of data architecture landscape between physical and logical data models
  • Analytical mindset with excellent business acumen skills
  • Problem-solving aptitude with the ability to communicate effectively, both written and verbal
  • Ability to think strategically and build effective relationships at all levels within the organization
  • Advanced expert in programing languages (Perl, bash, Shell Scripting, Python, etc.)
  • Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field
  • Relevant certifications preferred such as SAP, Microsoft Azure etc
Job Responsibility
Job Responsibility
  • Designs data models in a structured data format to enable analysis thereof
  • Designs and develops scalable extract, transformation and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources
  • Participates in the transformation of object and data models into appropriate database schemas within design constraints
  • Interprets installation standards to meet project needs and produces database components as required
  • Directs test scenarios and is responsible for participating in thorough testing and validation to support the accuracy of data transformations
  • Accountable for running data migrations across different databases and applications, for example MS Dynamics, Oracle, SAP and other ERP systems
  • Works across multiple IT and business teams to define and implement data table structures and data models based on requirements
  • Accountable for analysis, and development of ETL and migration documentation
  • Works with various stakeholders to evaluate potential data requirements
  • Accountable for the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives
  • Fulltime
Read More
Arrow Right
New

Data Engineer

At Codvo, we are committed to building scalable, future-ready data platforms tha...
Location
Location
India , Pune
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience with Python, SQL, and GCP services (BigQuery, Dataflow, Vertex AI, Pub/Sub, Cloud Storage)
  • Experience with Airflow, CI/CD, and data pipeline orchestration
  • Familiarity with ML frameworks (scikit-learn, TensorFlow) and feature engineering
  • Expertise in API integration, data ingestion, and automation of ML pipelines
  • Strong understanding of data quality, governance, and lineage best practices
Job Responsibility
Job Responsibility
  • Design, implement, and maintain scalable data pipelines on Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage)
  • Ingest and process real-time data from connected vehicles and IoT devices
  • Develop and maintain ETL/ELT workflows using Python, SQL, and Apache Beam/Spark
  • Ensure data quality, lineage, and governance in the data lake
  • Act as a bridge between data engineering and analytics teams, performing data wrangling, feature engineering, and ML model prototyping
  • Support pipeline automation and ML model deployment on GCP
  • Collaborate with AI/ML leads to operationalize machine learning pipelines and integrate data solutions with applications
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a highly capable Data Engineer to design and support scalable dat...
Location
Location
United States , Washington
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or related field
  • 3+ years of experience in data engineering / cloud development
  • Hands-on expertise with Databricks and Apache Spark
  • Strong experience with Python and distributed data processing
  • Experience building data ingestion pipelines and ETL workflows
  • Experience working with cloud platforms (Azure preferred, AWS acceptable)
  • Strong understanding of data governance, quality, and security practices
  • Ability to communicate technical solutions to both technical and business stakeholders
Job Responsibility
Job Responsibility
  • Design, build, and optimize data pipelines using Databricks and Spark
  • Implement Medallion architecture and scalable data processing workflows
  • Develop ingestion pipelines for structured, streaming, and unstructured datasets
  • Work with Azure services (Data Factory, Storage, Functions, Log Analytics)
  • Integrate data across multiple sources to enable high-quality analytics
  • Support hybrid cloud initiatives and evolving data platforms
  • Ensure data quality, integrity, and accessibility across systems
  • Monitor pipeline performance and optimize cost, scalability, and efficiency
  • Support data governance, cataloging, and compliance standards
  • Troubleshoot performance issues, cluster stability, and configuration management
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right