CrawlJobs Logo

Data Engineer

India, Pune · Job Posted June 29, 2026
Apply Position
Job Link Share

Job Description

Join us as a Data Engineer. At Barclays, we don't just adapt to the future, we create it. As an Data Engineer, you will support the organisation, achieve its strategic objectives by the identification of business requirements and solutions that address business problems and opportunities.

Job Responsibility

  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models

Requirements

  • Hands on experience in Abinitio ETL tool
  • Hands on experience in python and pyspark and strong knowledge on Dataframes, RDD and SparkSQL
  • Hands on Experience in developing, testing and maintaining applications on AWS Cloud
  • Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena)
  • Experience in Writing advanced SQL and PL SQL programs
  • Experience in AWS data pipeline development
  • Hands On Experience for building reusable components using AWS Tools/Technology
  • Should have worked at least on two major project implementations

Nice to have

  • Ability to engage with Stakeholders, elicit requirements/ user stories and translate requirements into ETL components
  • Ability to understand the infrastructure setup and be able to provide solutions either individually or working with teams
  • Good knowledge of Data Marts and Data Warehousing concepts
  • Resource should possess good analytical and Interpersonal skills
  • Implement Cloud based Enterprise data warehouse with multiple data platform along with Snowflake and NoSQL environment to build data movement strategy

What we offer

  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

Join us as a Data Engineer. At Barclays, we don’t just adapt to the future, we c...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience in ETL technologies, Ab Initio GDE and EME
  • Strong hands-on experience on SQL, Hive, Impala
  • Strong hands-on experience on Unix, Hadoop, Spark
  • Hands-on experience in Python
  • Experience working with cloud platforms, especially AWS
  • Strong knowledge of Data warehousing
  • Proficiency in Gitlab, CI/CD
  • Practical knowledge and hands‑on experience with AI-powered development tools such as Copilot, Claude Code, and GitLab Duo
  • Familiarity with data visualization tools such as Tableau, Grafana
  • Knowledge of data messaging platforms like Apache Kafka
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays, where you will spearhead the evolution o...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong in Abinitio (GDE), Unix and Data warehousing concepts
  • Working experience in Linux/UNIX
  • Ability to understand source to target ETL mappings
  • Ability to design, develop and maintain Abinitio graphs
  • Ability to explain functional and technical details
  • Well versed in data integration, batch processing, and delta processing
  • Hands-on experience on UNIX shell scripts to automate routine task
  • Strong understanding on job schedulers
  • Hands-on experience on database
  • Analyse and trouble shoot issues
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a Data Engineer with strong experience in Microsoft Azure and Dat...
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of Data Engineering experience
  • Hands-on experience with Azure Databricks
  • Experience with Azure services such as: Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure SQL Database
  • Strong SQL development skills
  • Experience with Python, PySpark, or Spark
  • Experience building and maintaining ETL/ELT pipelines
  • Understanding of data warehousing concepts and dimensional modeling
  • Experience working with large datasets in cloud environments
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data pipelines in Azure and Databricks
  • Build and optimize ETL/ELT processes for structured and unstructured data
  • Develop and support data lake, data warehouse, and analytics solutions
  • Integrate data from multiple internal and external sources
  • Collaborate with business analysts, data scientists, and stakeholders to understand data requirements
  • Ensure data quality, integrity, security, and governance standards are met
  • Monitor and troubleshoot data workflows and performance issues
  • Create and maintain technical documentation and data models
  • Support reporting and analytics initiatives by delivering reliable datasets
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

Design, build, and maintain scalable data pipelines and ETL/ELT processes. Devel...
Location
Location
United States , Austin
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in data engineering, data integration, or a related role
  • Strong proficiency in SQL and experience working with large, complex datasets
  • Experience building and maintaining ETL/ELT data pipelines
  • Proficiency in at least one programming language (Python, Java, Scala, or similar)
  • Hands‑on experience with data warehouses and data platforms (Snowflake, Redshift, BigQuery, Databricks, etc.)
  • Experience working in cloud environments (AWS, Azure, or GCP)
  • Familiarity with data modeling, schema design, and performance optimization
  • Experience integrating data from APIs, databases, and streaming sources
  • Strong problem‑solving and troubleshooting skills related to data pipelines and performance
  • Ability to collaborate with data analysts, data scientists, and business stakeholders
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines and ETL/ELT processes
  • Develop and manage data architectures such as data warehouses, data lakes, and lakehouses
  • Ingest and integrate data from multiple sources (databases, APIs, streaming platforms)
  • Ensure data quality, integrity, and reliability across systems
  • Optimize data processing, storage, and query performance
  • Collaborate with data analysts, data scientists, and business teams to support analytics and reporting needs
  • Implement automation for data workflows, monitoring, and error handling
  • Troubleshoot and resolve data pipeline issues and performance bottlenecks
  • Support batch and real‑time data processing frameworks
  • Document data models, pipelines, and data engineering processes
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • enrollment in company 401(k) plan
Read More
Arrow Right
New

Data Engineer

This position will play a key role in strengthening an established Microsoft Fab...
Location
Location
United States , Westchester
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building and maintaining solutions within Microsoft Fabric
  • Strong knowledge of data modeling concepts and layered architecture patterns, including Bronze, Silver, and Gold frameworks
  • Experience working in Azure-based data environments and delivering cloud-oriented data engineering solutions
  • Demonstrated ability to apply independent judgment to data design decisions rather than simply executing predefined requests
  • Background in ingesting, transforming, and modeling Salesforce data for analytics or reporting purposes
  • Familiarity with legacy reporting or warehousing environments, including spreadsheet-heavy processes and older platform patterns
  • Experience with tools and technologies such as Python, Apache Spark, ETL processes, and related big data or streaming concepts
  • Strong communication skills and confidence working directly with business partners to clarify needs and explain technical recommendations
Job Responsibility
Job Responsibility
  • Expand and enhance an existing Microsoft Fabric data platform to improve performance, consistency, and downstream usability
  • Develop layered data solutions using Bronze, Silver, and Gold design principles, with particular attention to delivering trusted and analytics-ready Gold datasets
  • Create and refine data models that support accurate reporting by evaluating data relationships, structure, quality, and business context
  • Build ingestion and transformation pipelines for Salesforce data along with additional source systems used across the organization
  • Contribute to the evolution of reporting and warehousing practices by reducing dependence on legacy approaches and spreadsheet-driven processes
  • Work autonomously on technical deliverables while providing clear updates on milestones, design decisions, dependencies, and potential issues
  • Partner with business stakeholders to understand reporting needs and translate them into effective data structures that support analytics and visualization tools
  • Use data engineering technologies such as Python, Spark, ETL frameworks, and related platform capabilities to deliver scalable solutions
  • Support report-oriented data design by preparing curated datasets that align with Power BI and other business intelligence use cases
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a talented Data Engineer to join our team in Miami, Florida. ...
Location
Location
United States , Miami
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in data engineering with expertise in Snowflake, Python, and ETL processes
  • Strong knowledge of data warehouse design and optimization
  • Proficiency in working with Apache Spark, Hadoop, and Kafka
  • Solid understanding of data modeling, transformation, and integration techniques
  • Familiarity with data security, privacy, and compliance standards
  • Ability to troubleshoot and solve complex data-related issues
  • Excellent communication and collaboration skills to work effectively with cross-functional teams
  • Bachelor's degree in Computer Science, Information Technology, or a related field
Job Responsibility
Job Responsibility
  • Design and implement scalable data pipelines using Snowflake, Python, and other relevant tools
  • Collaborate with stakeholders to gather and refine data requirements, ensuring alignment with business needs
  • Develop and maintain data models to support analytics, reporting, and operational processes
  • Optimize data warehouse performance by tuning queries and managing resources effectively
  • Ensure data quality through rigorous testing and governance protocols
  • Implement security and compliance measures to protect sensitive data
  • Research and integrate emerging technologies to enhance system capabilities
  • Support ETL processes for data extraction, transformation, and loading
  • Work with technologies such as Apache Spark, Hadoop, and Kafka to manage and process large datasets
  • Provide technical guidance and support to team members and stakeholders
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

Robert Half is seeking a Contract Data Engineer to support our client’s data and...
Location
Location
United States , Nashville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Data Engineer or in a similar role
  • Strong proficiency in SQL and Python (or similar languages)
  • Experience with cloud platforms (AWS, Azure, GCP)
  • Hands-on experience with ETL / ELT tools (Airflow, dbt, Fivetran, Matillion, Glue, ADF, etc.)
  • Experience with data warehousing platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Familiarity with streaming and big data tools (Kafka, Spark, Databricks, Hadoop) is a plus
  • Strong understanding of data modeling, performance tuning, and pipeline optimization
  • Experience with version control systems (Git) and agile development practices
  • Excellent problem-solving, analytical, and communication skills
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources
  • Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs
  • Work within cloud environments such as AWS, Azure, or GCP to deploy and manage data solutions
  • Design and support enterprise data warehouses using platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Develop solutions using big data technologies such as Spark, Databricks, Kafka, and Hadoop when required
  • Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency
  • Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability
  • Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions
  • Maintain detailed documentation for pipelines, data flows, and system architecture
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to play a key role in shaping and scaling our...
Location
Location
Salary
Salary:
Not provided
mdotm.ai Logo
MDOTM Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in Computer Science, Engineering, or a related field
  • Strong programming skills in Java or Python (or other JVM-based languages)
  • Strong understanding of data modeling, SQL, and NoSQL databases
  • Strong focus on data quality, validation, and monitoring practices
  • Experience working with large-scale and time-series datasets in financial contexts, with an understanding of their structure and common data quality challenges
  • Experience building and maintaining production data pipelines or data-intensive systems, with focus on reliability and performance
  • Ability to troubleshoot and optimize production data systems
  • Experience with workflow orchestration and data pipeline scheduling tools
  • Solid understanding of financial data structures and concepts, with the ability to model and validate financial data accurately
  • Strong problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, build, and maintain production-grade data pipelines and data-intensive systems
  • Configure, schedule, and monitor data pipeline execution to ensure reliability, maintainability, and timely delivery across all data processes
  • Deploy and manage data infrastructure on AWS or on-premises, ensuring scalability, security, and cost-efficiency
  • Monitor and optimize relational and NoSQL database performance (e.g., MySQL, PostgreSQL, MongoDB) to ensure efficient querying, indexing, and data access at scale
  • Ensure reliable ingestion, transformation, and availability of large-scale and time-series financial data, considering financial-specific data quality characteristics
  • Implement and maintain data quality, validation, and monitoring mechanisms across data workflows
  • Define and evolve data models and storage structures across relational and NoSQL systems
  • Collaborate with Data Scientists and Analysts to ensure accurate and efficient data access for analytics and modeling use cases
  • Optimize data processing workflows for performance, reliability, and operational stability
  • Troubleshoot complex data issues and drive root cause analysis
  • Fulltime
Read More
Arrow Right