CrawlJobs Logo

Data Engineer

India, BENGALURU · Job Posted June 04, 2026
Apply Position
Job Link Share

Job Description

Wells Fargo is seeking a Data Engineer to design, build and optimize scalable data platforms on Google Cloud Platform (GCP). The ideal candidate will have strong hands-on expertise in modern data engineering tools, distributed processing (spark/Pyspark), orchestration & growing exposure to GenAI-driven data solutions. This role requires excellent problem-solving capabilities and strong communication skills to work with cross functional teams.

Job Responsibility

  • Participate in data warehouses across multiple databases and identify opportunity for developing table schemas within the Technology and Date area
  • Review and analyze basic data management business, operational, or technical assignments or challenges that require research, evaluation, and selection of alternatives and exercise independent judgment to guide medium risk deliverables
  • Present recommendations for resolving more complex data management situations and exercise independent judgment while developing expertise in the business data policies, procedures and compliance requirements
  • Collaborate and consult with technology colleagues, internal partners and stakeholders, including internal and external customers if applicable
  • Design and build scalable, production-grade data pipelines on GCP supporting analytics and AI workloads
  • Develop and manage secure, compliant cloud data platforms aligned with enterprise policies and controls
  • Optimize data processing for performance, cost efficiency, and reliability (Spark + BigQuery workloads)
  • Collaborate with AI/analytics teams to enable feature engineering, model consumption, and AI-driven insights

Requirements

  • 2+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • Strong experience in EDL pipelines using Spark & BigQuery on GCP
  • Hands-on expertise in GCP services (BigQuery, Dataflow, GCS, IAM) and cloud-native architecture
  • Solid understanding of enterprise data governance, data quality
  • Exposure to AI/ML or GenAI use cases, including integration with data platforms and awareness of AI governance standards

Nice to have

  • Strong experience in EDL pipelines using Spark & BigQuery on GCP
  • Hands-on expertise in GCP services (BigQuery, Dataflow, GCS, IAM) and cloud-native architecture
  • Solid understanding of enterprise data governance, data quality
  • Exposure to AI/ML or GenAI use cases, including integration with data platforms and awareness of AI governance standards

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

Robert Half is seeking a Contract Data Engineer to support our client's data and...
Location
Location
United States , Nashville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Data Engineer or in a similar role
  • Strong proficiency in SQL and Python (or similar languages)
  • Experience with cloud platforms (AWS, Azure, GCP)
  • Hands-on experience with ETL / ELT tools (Airflow, dbt, Fivetran, Matillion, Glue, ADF, etc.)
  • Experience with data warehousing platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Familiarity with streaming and big data tools (Kafka, Spark, Databricks, Hadoop) is a plus
  • Strong understanding of data modeling, performance tuning, and pipeline optimization
  • Experience with version control systems (Git) and agile development practices
  • Excellent problem-solving, analytical, and communication skills
Job Responsibility
Job Responsibility
  • Data Pipeline Development: Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources
  • Data Architecture: Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs
  • Cloud Data Platforms: Work within cloud environments such as AWS, Azure, or GCP to deploy and manage data solutions
  • Data Warehousing: Design and support enterprise data warehouses using platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Big Data Processing: Develop solutions using big data technologies such as Spark, Databricks, Kafka, and Hadoop when required
  • Performance Optimization: Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency
  • Data Quality & Reliability: Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability
  • Collaboration: Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions
  • Documentation: Maintain detailed documentation for pipelines, data flows, and system architecture
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Data Engineer

Our client is seeking a skilled Data Engineer to support the design, development...
Location
Location
United States , Miami
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Systems, Engineering or related field
  • 3+ years of experience in a Data Engineer or similar role
  • Strong hands-on experience with SQL, Python and Snowflake
  • Experience developing and maintaining ETL workflows
  • Knowledge of data modeling concepts and best practices
  • Experience with Selenium for web automation or web scraping support
  • Strong analytical, problem-solving and troubleshooting skills
  • Ability to work independently and collaboratively in a team environment
Job Responsibility
Job Responsibility
  • Design, build and maintain scalable ETL pipelines to support data integration and reporting needs
  • Develop and optimize complex queries using SQL
  • Use Python to support data processing, transformation and automation tasks
  • Work within Snowflake to manage, transform and optimize cloud-based data solutions
  • Assist with automation efforts, including Selenium web scripting for web-based data extraction and process automation
  • Create and maintain logical and physical data models
  • Ensure data quality, integrity and consistency across multiple data sources
  • Collaborate with business stakeholders, analysts and technical teams to gather requirements and deliver data solutions
  • Monitor and troubleshoot data workflows and automation scripts
  • Document processes, workflows and technical specifications
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Data Engineer

Join us as a Data Engineer at Bettys and Taylors Group - Our family business is ...
Location
Location
United Kingdom , Harrogate
Salary
Salary:
49500.00 - 60500.00 GBP / Year
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
June 17, 2026
Flip Icon
Requirements
Requirements
  • Proven experience designing and building data pipelines and ETL/ELT processes using Microsoft Fabric or comparable cloud data platforms
  • Strong technical skills in SQL, DAX, M (Power Query), KQL and Python / PySpark for data engineering and analysis
  • Experience with data modelling techniques (e.g. star schema, dimensional modelling) and data warehousing concepts
  • Hands-on experience with Power BI, including dataset creation, semantic modelling, performance optimisation and building well-designed reports
  • Familiarity with CI/CD practices, version control (e.g. Git) and DevOps approaches for data engineering
  • Understanding of data governance, quality management, security and privacy, including GDPR and ISO27001 considerations
  • Excellent communication skills, with the ability to work confidently across technical and non-technical teams
  • A willingness to coach, mentor and upskill others, and a strong commitment to continuous learning
Job Responsibility
Job Responsibility
  • Design, develop and maintain scalable data pipelines using Microsoft Fabric and related technologies
  • Transform and curate data from multiple sources into structured, governed datasets
  • Optimise data pipeline performance and adhere to engineering standards such as CI/CD and version control
  • Collaborate on enterprise data models, Power BI solutions, and provision data for analytics and machine learning
  • Ensure data quality, compliance with governance standards, and support ITIL processes
What we offer
What we offer
  • A discretionary profit-share bonus scheme paid quarterly (11.9% average over the last three years)
  • Freshly cooked hot meals while at work, along with free drinks and snacks
  • Discounts on Bettys & Taylors products
  • A range of health benefits, including a health cash plan, health assessments, flu jabs and more
  • Wellbeing support, including an Employee Assistance Programme (free and independent service offering free counselling and health and wellbeing resources)
  • The option to buy and (in some cases) sell additional holidays
  • On-the-job learning
  • External training programmes
  • Apprenticeship opportunities
  • Internal 1:1 coaching schemes
  • Fulltime
!
Read More
Arrow Right

Data Engineer

A healthcare company based in the Midwest is looking to hire a remote Data Engin...
Location
Location
United States , Detroit
Salary
Salary:
85000.00 - 95000.00 USD / Year
strategicemployment.com Logo
Strategic Employment Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 1+ years in stakeholder-facing Data Engineering/Data Analytics position
  • Consulting experience
  • Databricks, Foundry, or Snowflake
  • Python, PySpark, TypeScript
Job Responsibility
Job Responsibility
  • work closely with stakeholders on low code data engineering solutions
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays where you will spearhead the evolution of...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience in developing complex/medium/easy datasets using SQL tools (SQL/Snowflake)
  • Solid working knowledge of writing SQL queries
  • Working Knowledge on scripts (.bteq ) in Unix/ linux environments.
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models.
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness
  • Wellness rooms
  • gyms and mental health support
  • Collaborative areas
  • Access to on-site cafeterias, fitness centers, and tech-equipped workstations
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays, responsible for supporting the successfu...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in ETL / data processing / data warehousing / data engineering / RDBMS / PySpark
  • Experience in Data Processing and ETL in On-prem and Cloud based systems
  • Preferred AWS cloud development, with a strong understanding of AWS services (e.g., EC2, S3, Lambda, RDS, DynamoDB, etc.)
  • Proficient in at least one Python programming language
  • Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform etc.
  • Experience with CI/CD tools and pipelines (Jenkins, GitLab CI, etc.) for automation and deployment
  • Good understanding of cloud security best practices and experience with IAM, VPC, security groups, and encryption mechanisms
  • Good knowledge of monitoring, logging, and troubleshooting tools (e.g., CloudWatch, CloudTrail)
  • Experience with version control systems (Git, GitHub, Bitbucket)
  • Strong communication skills and ability to work in a collaborative team environment
Job Responsibility
Job Responsibility
  • supporting the successful delivery of location strategy projects to plan, budget, agreed quality and governance standards
  • spearhead the evolution of our digital landscape, driving innovation and excellence
  • harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

At Schwab, you’re empowered to make an impact on your career. Here, innovative t...
Location
Location
United States , Austin
Salary
Salary:
90000.00 - 145000.00 USD / Year
schwab.com Logo
Charles Schwab
Expiration Date
June 15, 2026
Flip Icon
Requirements
Requirements
  • Bachelors’ degree in Engineering/Technology
  • 8+ years of professional experience in development, support, and maintenance of ETL and database applications
  • Deep understanding of Data Warehousing and Data Modeling concepts
  • 3+ years of hands-on experience with Informatica’s Intelligent Data Management Cloud(IDMC)/Informatica Intelligent Cloud Services (IICS)
  • 2+years of hands-on experience with GCP technologies (GCS, BigQuery, Dataproc)
  • 1+years of experience with Control M
  • Strong SQL Knowledge
  • Experience with Shell, Python, PERL and other scripting languages
  • Familiar and comfortable with agile development techniques
  • Familiarity with SCM and DevOps tool suites and CI/CD best practices
Job Responsibility
Job Responsibility
  • Creation and maintenance of enterprise data assets, reporting, and data analytics that support business leaders in decision making, regulatory reporting, and continuous process improvement
  • Working closely with business and other stakeholders to understand the needs and implementation
  • Planning, estimation, scheduling, prioritization, and coordination of technical activities related to system development
  • Performing ETL design, development, data management and data analysis
  • Creating data model, performance tuning, load plan etc. Making sure that deliverables fulfill both functional and non-functional requirements
  • Provide guidance and technical oversight to junior engineers and vendor contractors, ensuring high-quality execution and fostering professional growth within the team
  • Engaging with both onshore and offshore teams to ensure the timely delivery of high-quality data engineering solutions
  • Ensuring system alignment to Architecture policies and best practices
  • ensure that process methodologies are followed in system development
  • Identifying opportunities for system reuse and system simplification
What we offer
What we offer
  • 401(k) with company match and Employee stock purchase plan
  • Paid time for vacation, volunteering, and 28-day sabbatical after every 5 years of service for eligible positions
  • Paid parental leave and family building benefits
  • Tuition reimbursement
  • Health, dental, and vision insurance
  • Bonus or incentive opportunities
  • Fulltime
!
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer responsible for supporting the successful delivery of...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands on experience in pyspark and strong knowledge on Dataframes, RDD and SparkSQL
  • Hands on Experience in developing, testing and maintaining applications on AWS Cloud
  • Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena)
  • Design and implement scalable and efficient data transformation/storage solutions using Snowflake
  • Experience in Data ingestion to Snowflake for different storage format such Parquet, Iceberg, JSON, CSV etc
  • Experience in using DBT (Data Build Tool) with snowflake for ELT pipeline development
  • Experience in Writing advanced SQL and PL SQL programs
  • Hands On Experience for building reusable components using Snowflake and AWS Tools/Technology
  • Should have worked at least on two major project implementations
  • Ability to engage with Stakeholders, elicit requirements/ user stories and translate requirements into ETL components
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right