CrawlJobs Logo
Barclays Logo Barclays · IT - Software Development

Data Engineer

India, Pune · Job Posted June 14, 2026
Apply Position
Job Link Share

Job Description

Join us as a Data Engineer at Barclays, where you will spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence. You will harness cutting-edge technology to build and manage robust, scalable and secure infrastructure, ensuring seamless delivery of our digital solutions.

Job Responsibility

  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models

Requirements

  • AWS hands on with S3, EC2, Lambda, RDS, Glue, Athena, data pipelines, step function and knowledge of Analytical services
  • Experience of distributed computing architecture, Core Hadoop components (HDFS, Spark, Yarn, HIVE, Impala)
  • Expertise in SQL, advanced SQL skills
  • Expertise in shell scripting and programming (Scala/Python)
  • Experience of Ab Initio implementation on Hadoop (Optional)
  • Experience of Technical Design for ETL/Hadoop/AWS components

Nice to have

  • Experience of Ab Initio implementation on Hadoop
  • Experience of Technical Design for ETL/Hadoop/AWS components

What we offer

  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
Barclays - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

This position will play a key role in strengthening an established Microsoft Fab...
Location
Location
United States , Westchester
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building and maintaining solutions within Microsoft Fabric
  • Strong knowledge of data modeling concepts and layered architecture patterns, including Bronze, Silver, and Gold frameworks
  • Experience working in Azure-based data environments and delivering cloud-oriented data engineering solutions
  • Demonstrated ability to apply independent judgment to data design decisions rather than simply executing predefined requests
  • Background in ingesting, transforming, and modeling Salesforce data for analytics or reporting purposes
  • Familiarity with legacy reporting or warehousing environments, including spreadsheet-heavy processes and older platform patterns
  • Experience with tools and technologies such as Python, Apache Spark, ETL processes, and related big data or streaming concepts
  • Strong communication skills and confidence working directly with business partners to clarify needs and explain technical recommendations
Job Responsibility
Job Responsibility
  • Expand and enhance an existing Microsoft Fabric data platform to improve performance, consistency, and downstream usability
  • Develop layered data solutions using Bronze, Silver, and Gold design principles, with particular attention to delivering trusted and analytics-ready Gold datasets
  • Create and refine data models that support accurate reporting by evaluating data relationships, structure, quality, and business context
  • Build ingestion and transformation pipelines for Salesforce data along with additional source systems used across the organization
  • Contribute to the evolution of reporting and warehousing practices by reducing dependence on legacy approaches and spreadsheet-driven processes
  • Work autonomously on technical deliverables while providing clear updates on milestones, design decisions, dependencies, and potential issues
  • Partner with business stakeholders to understand reporting needs and translate them into effective data structures that support analytics and visualization tools
  • Use data engineering technologies such as Python, Spark, ETL frameworks, and related platform capabilities to deliver scalable solutions
  • Support report-oriented data design by preparing curated datasets that align with Power BI and other business intelligence use cases
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a talented Data Engineer to join our team in Miami, Florida. ...
Location
Location
United States , Miami
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in data engineering with expertise in Snowflake, Python, and ETL processes
  • Strong knowledge of data warehouse design and optimization
  • Proficiency in working with Apache Spark, Hadoop, and Kafka
  • Solid understanding of data modeling, transformation, and integration techniques
  • Familiarity with data security, privacy, and compliance standards
  • Ability to troubleshoot and solve complex data-related issues
  • Excellent communication and collaboration skills to work effectively with cross-functional teams
  • Bachelor's degree in Computer Science, Information Technology, or a related field
Job Responsibility
Job Responsibility
  • Design and implement scalable data pipelines using Snowflake, Python, and other relevant tools
  • Collaborate with stakeholders to gather and refine data requirements, ensuring alignment with business needs
  • Develop and maintain data models to support analytics, reporting, and operational processes
  • Optimize data warehouse performance by tuning queries and managing resources effectively
  • Ensure data quality through rigorous testing and governance protocols
  • Implement security and compliance measures to protect sensitive data
  • Research and integrate emerging technologies to enhance system capabilities
  • Support ETL processes for data extraction, transformation, and loading
  • Work with technologies such as Apache Spark, Hadoop, and Kafka to manage and process large datasets
  • Provide technical guidance and support to team members and stakeholders
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

Robert Half is seeking a Contract Data Engineer to support our client’s data and...
Location
Location
United States , Nashville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Data Engineer or in a similar role
  • Strong proficiency in SQL and Python (or similar languages)
  • Experience with cloud platforms (AWS, Azure, GCP)
  • Hands-on experience with ETL / ELT tools (Airflow, dbt, Fivetran, Matillion, Glue, ADF, etc.)
  • Experience with data warehousing platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Familiarity with streaming and big data tools (Kafka, Spark, Databricks, Hadoop) is a plus
  • Strong understanding of data modeling, performance tuning, and pipeline optimization
  • Experience with version control systems (Git) and agile development practices
  • Excellent problem-solving, analytical, and communication skills
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources
  • Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs
  • Work within cloud environments such as AWS, Azure, or GCP to deploy and manage data solutions
  • Design and support enterprise data warehouses using platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Develop solutions using big data technologies such as Spark, Databricks, Kafka, and Hadoop when required
  • Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency
  • Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability
  • Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions
  • Maintain detailed documentation for pipelines, data flows, and system architecture
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to play a key role in shaping and scaling our...
Location
Location
Salary
Salary:
Not provided
mdotm.ai Logo
MDOTM Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in Computer Science, Engineering, or a related field
  • Strong programming skills in Java or Python (or other JVM-based languages)
  • Strong understanding of data modeling, SQL, and NoSQL databases
  • Strong focus on data quality, validation, and monitoring practices
  • Experience working with large-scale and time-series datasets in financial contexts, with an understanding of their structure and common data quality challenges
  • Experience building and maintaining production data pipelines or data-intensive systems, with focus on reliability and performance
  • Ability to troubleshoot and optimize production data systems
  • Experience with workflow orchestration and data pipeline scheduling tools
  • Solid understanding of financial data structures and concepts, with the ability to model and validate financial data accurately
  • Strong problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, build, and maintain production-grade data pipelines and data-intensive systems
  • Configure, schedule, and monitor data pipeline execution to ensure reliability, maintainability, and timely delivery across all data processes
  • Deploy and manage data infrastructure on AWS or on-premises, ensuring scalability, security, and cost-efficiency
  • Monitor and optimize relational and NoSQL database performance (e.g., MySQL, PostgreSQL, MongoDB) to ensure efficient querying, indexing, and data access at scale
  • Ensure reliable ingestion, transformation, and availability of large-scale and time-series financial data, considering financial-specific data quality characteristics
  • Implement and maintain data quality, validation, and monitoring mechanisms across data workflows
  • Define and evolve data models and storage structures across relational and NoSQL systems
  • Collaborate with Data Scientists and Analysts to ensure accurate and efficient data access for analytics and modeling use cases
  • Optimize data processing workflows for performance, reliability, and operational stability
  • Troubleshoot complex data issues and drive root cause analysis
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer who is passionate about building scalable dat...
Location
Location
United States , Irving
Salary
Salary:
75168.00 - 130500.00 USD / Year
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of overall experience in data engineering or related fields
  • 3+ years of experience building data pipelines using PySpark, Django, or similar frameworks, with strong proficiency in Python or Java/Scala
  • 2+ years of advanced SQL experience, including database modeling and query optimization
  • Hands‑on experience with Apache Spark, Kafka, and distributed data processing technologies
  • Experience deploying data platforms in cloud environments such as AWS, Google Cloud, or Azure
  • Strong Python experience, including libraries such as NumPy and pandas for data loading and transformation
  • Experience scheduling and orchestrating workflows using tools like Apache Airflow or dbt
  • Practical experience with MLOps concepts and supporting ML model lifecycle workflows
  • Working knowledge of relational and non‑relational databases, including data modeling principles
  • Experience collaborating within Agile/Scrum teams and participating in sprint ceremonies
Job Responsibility
Job Responsibility
  • Design and build robust, scalable data pipelines to ingest structured and unstructured data from diverse sources
  • Develop and optimize data storage solutions, including relational databases, NoSQL systems, and data lakes
  • Implement data validation, automated testing, and monitoring to ensure accuracy, reliability, and compliance
  • Partner with Data Scientists, Product Managers, and Software Engineers to build infrastructure that supports ML models, analytics, and BI dashboards
  • Participate in feature discussions, help prioritize work, and guide teams toward consensus
  • Develop prototypes to validate concepts and accelerate solution design
  • Identify root causes of data issues, assess business impact, and propose effective solutions
  • Solve complex problems related to data quality, object identity, and error handling
  • Support MLOps workflows and contribute to model deployment and data integration processes
  • Work as part of an Agile/Scrum team and participate in related ceremonies
What we offer
What we offer
  • Medical, dental, and vision insurance with an employer contribution
  • Flexible spending or health savings account
  • Life and AD&D insurance
  • Short- and long-term disability coverage
  • Paid time off
  • Employee assistance
  • Participation in a 401k program with company match
  • Additional voluntary or legally-required benefits
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to help strengthen enterprise data capabiliti...
Location
Location
United States , San Diego
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of hands-on experience in data engineering, data integration, or a closely related technical discipline
  • Strong background working with cloud data ecosystems and modern integration frameworks in production environments
  • Advanced SQL expertise, including query optimization, troubleshooting, and performance improvement
  • Proven experience creating and supporting production ETL or ELT pipelines across multiple data sources
  • Solid understanding of dimensional modeling and the design of analytics-focused datasets
  • Hands-on experience with Python, Apache Spark, or similar technologies used for large-scale data processing
  • Ability to communicate clearly, solve complex technical problems, and work effectively with both business and engineering teams
  • A bachelor’s degree in computer science, information systems, or a related field is preferred
  • relevant cloud or data certifications are a plus
Job Responsibility
Job Responsibility
  • Build and maintain robust data pipelines that move and transform information from diverse platforms into usable analytical datasets
  • Develop and support end-to-end integration workflows across multiple systems to ensure consistent and timely data delivery
  • Design data models and reporting structures that improve usability, performance, and accessibility for downstream analytics needs
  • Track data quality and platform performance, investigating issues and resolving reliability concerns before they affect business operations
  • Collaborate with cross-functional partners to translate reporting and analytics needs into scalable technical solutions
  • Maintain clear documentation and contribute to governance practices that promote accuracy, consistency, and operational discipline
  • Assist with validation, release activities, and continuous enhancements to improve the overall effectiveness of the data platform
  • Contribute to cloud-based data engineering efforts using tools such as Azure Data Factory, Azure Data Lake, Microsoft Fabric, Spark, Kafka, and Hadoop where appropriate
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • enrollment in our company 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Engineer

The Data Engineer is a seasoned subject matter expert, responsible for the trans...
Location
Location
Thailand , Bangkok
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Seasoned knowledge of the definition and management of scoping requirements, definition and prioritization activities
  • Seasoned understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models
  • Seasoned expertise in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP
  • Seasoned understanding of data architecture landscape between physical and logical data models
  • Analytical mindset with excellent business acumen skills
  • Problem-solving aptitude with the ability to communicate effectively, both written and verbal
  • Ability to build effective relationships at all levels within the organization
  • Seasoned expert in programing languages (Perl, bash, Shell Scripting, Python, etc.)
  • Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field
  • Relevant certifications preferred such as SAP, Microsoft Azure etc.
Job Responsibility
Job Responsibility
  • Creates data models in a structured data format to enable analysis thereof
  • Designs and develops scalable extract, transformation and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources
  • Participates in the transformation of object and data models into appropriate database schemas within design constraints
  • Interprets installation standards to meet project needs and produce database components as required
  • Creates test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations
  • Accountable for running data migrations across different databases and applications, for example MS Dynamics, Oracle, SAP and other ERP systems
  • Works across multiple IT and business teams to define and implement data table structures and data models based on requirements
  • Accountable for analysis, and development of ETL and migration documentation
  • Collaborates with various stakeholders to evaluate potential data requirements
  • Accountable for the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a highly motivated expert Data Engineer to design and develop...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration and performance tuning on big data processing
  • Strong understanding of AWS services
  • Ability to quickly learn, adapt, and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • Experience with streaming technologies such as Apache Kafka, Debezium, or similar platforms for real-time data processing and integration
  • Master’s /Bachelor’s degree and 5-8 years of Computer Science, IT, or related field experience
Job Responsibility
Job Responsibility
  • Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets
  • Build highly efficient data pipelines to migrate and deploy complex data across systems, with an understanding of biotech/pharma/manufacturing or related domains
  • Design and implement solutions to enable unified data access, governance, and interoperability across hybrid cloud environments
  • Ingest and transform structured and unstructured data from databases (PostgreSQL, MySQL, SQL Server, MongoDB, etc.), APIs, logs, event streams, images, PDFs, and third-party platforms
  • Ensure data integrity, accuracy, and consistency through rigorous quality checks and monitoring
  • Innovate, explore, and implement new tools and technologies to enhance efficient data processing
  • Proactively identify and implement opportunities to automate tasks and develop reusable frameworks
  • Work in an Agile and Scaled Agile (SAFe) environment, collaborating with cross-functional teams, product owners, and Scrum Masters to deliver incremental value
  • Use JIRA, Confluence, and Agile DevOps tools to manage sprints, backlogs, and user stories
  • Support continuous improvement, test automation, and DevOps practices in the data engineering lifecycle
Read More
Arrow Right