CrawlJobs Logo
Wissen Logo Wissen · IT - Software Development

Cloud Data Engineer

India, Bangalore South · Job Posted April 20, 2026
Apply Position
Job Link Share

Job Description

We are looking for an experienced Cloud Data Engineer with strong expertise in building scalable data pipelines on AWS. The ideal candidate should have hands-on experience in ETL development, big data processing, workflow orchestration, and handling both structured and unstructured data. Strong communication and collaboration skills are essential.

Job Responsibility

  • Design and develop scalable ETL pipelines using AWS cloud services
  • Build data ingestion frameworks for structured and unstructured (OCR-based) data
  • Develop and optimize SQL queries and data transformation logic
  • Orchestrate workflows using Airflow
  • Develop big data solutions using Python and PySpark
  • Build and maintain streaming data pipelines
  • Ensure data quality, performance, and reliability
  • Collaborate with cross-functional teams to gather requirements
  • Document architecture, workflows, and processes

Requirements

  • Strong experience with AWS (ETL, data services)
  • Expertise with structured and unstructured (OCR) data
  • Knowledge of streaming data tools
  • Proficiency in SQL
  • Strong Python programming skills
  • Hands-on experience with PySpark
  • Experience with Airflow for workflow orchestration
  • Excellent communication skills

Nice to have

  • Experience with AWS Glue, Lambda, S3, Redshift, EMR, Kinesis
  • Understanding of CI/CD for data pipelines
  • Knowledge of data governance and security
Wissen - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Cloud Data Engineer

8 matching positions

Cloud Data Engineer

We are seeking a technically skilled Cloud Data Engineer with strong expertise i...
Location
Location
India , Pune
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficient in SQL and PL/SQL, with hands-on experience in GCP BigQuery
  • Experienced in building cloud infrastructure using GCP services
  • Skilled in debugging and resolving issues in cloud-based applications
  • Familiar with data warehousing concepts and large-scale data processing
  • Strong analytical and problem-solving abilities
  • Comfortable working in collaborative, cross-functional teams
Job Responsibility
Job Responsibility
  • Write and debug complex SQL and PL/SQL queries within GCP BigQuery
  • Build and maintain infrastructure using GCP tools such as Google Cloud Functions, App Engine, and Cloud Run
  • Collaborate with data engineers to process and manage large datasets using GCP services including BigQuery and Cloud Storage
  • Apply best practices for performance optimisation, security, and scalability of cloud applications
  • Develop unit tests and maintain documentation to ensure code quality and maintainability
  • Troubleshoot and debug cloud-based applications in production environments
  • Work on cloud-native development projects
  • Apply understanding of both SQL and NoSQL database systems and data processing frameworks
What we offer
What we offer
  • Opportunity to work on cutting-edge cloud technologies and large-scale data projects
  • Exposure to collaborative, cross-functional teams and agile development practices
  • A chance to contribute to high-impact, scalable solutions within a global organisation
Read More
Arrow Right

Cloud Data Engineer

Hunkemöller is looking for a Cloud Data Engineer to take a core role in our digi...
Location
Location
Netherlands , Hilversum
Salary
Salary:
Not provided
hunkemoller.de Logo
Hunkemöller
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3 to 5 years of hands-on experience in data engineering, with a strong focus on data integration, APIs, and pipeline architecture
  • A strong desire to learn quickly and adapt to new technologies
  • Strong Python programming skills with a proven track record of building custom API extractors, handling pagination, rate limiting, and working with REST/GraphQL endpoints
  • Hands-on experience with Google Cloud Platform's ecosystem, specifically Cloud Composer, Dataflow, Cloud Run, and Firestore
  • Proficient in writing clean, well-documented, and tested code (e.g., pytest), with strong experience using Git, Docker, and CI/CD pipelines
  • Excellent written and verbal English communication skills
Job Responsibility
Job Responsibility
  • Build Ingestion Pipelines: Design, develop, and deploy robust data ingestion pipelines from various third-party APIs, webhooks, and source systems into Google Cloud
  • AI-Augmented Engineering: Actively leverage advanced AI coding assistants to accelerate pipeline development, generate boilerplate API connection code, debug complex scripts, and automate repetitive tasks
  • GCP Infrastructure & Orchestration: Build and manage data workflows using Cloud Composer (Airflow), and leverage Cloud Run and Dataflow for scalable, containerized data processing
  • Drive Reverse ETL: Architect and maintain the data pipelines that push refined data from BigQuery back into our operational platforms (marketing tools, CRM, etc.) to drive business action
  • Manage Operational Databases: Utilize Firestore and other NoSQL/relational databases to support operational data needs and microservices
  • Collaborate and Learn: Partner with our data modeling specialists to ensure smooth handoffs between ingestion and transformation
  • Participate in code reviews and continuously share new engineering best practices
  • Fulltime
Read More
Arrow Right

Cloud Data Engineer

Join us as an IFC - Cloud Data Engineer-AVP, at Barclays where you will spearhea...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • AWS hands on with S3, EC2, Lambda, RDS, Glue, Athena, data pipelines, step function and knowledge of Analytical services
  • Experience of distributed computing architecture, Core Hadoop components (HDFS, Spark, Yarn, HIVE, Impala)
  • Experience of Technical Design for ETL/Hadoop/AWS components
  • Knowledge of Data Warehousing
  • Expertise in SQL, advanced SQL skills
  • Expertise in shell scripting and programming (Scala/Python)
  • Knowledge of ETL technologies preferably Ab Initio
  • You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right

Cloud Data Engineer

Join BIP – xTech, BIP's Centre of Excellence specializing in innovative consulti...
Location
Location
Albania , Tirana
Salary
Salary:
Not provided
businessintegrationpartners.com Logo
Business Integration Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in the implementation and management of cloud‑based data platforms
  • Knowledge of one or more cloud platforms (e.g., Google GCP, Amazon AWS, Microsoft Azure) and their services supporting data management, processing, and analysis
  • Knowledge of key concepts of modern data platforms (e.g., Big Data, Data Lake, Data Warehouse, Data Virtualization, Data Mesh, Data Governance, etc.)
  • Experience in designing data models and creating/maintaining data pipelines for data extraction, transformation, and loading
  • Knowledge of one or more programming and data query languages (e.g., SQL, Java, Ruby, Python, R…)
  • In‑depth knowledge of one or more technologies for managing structured and unstructured databases (e.g., BigQuery, MongoDB, Hadoop, Redis, etc.)
Job Responsibility
Job Responsibility
  • Working on Big Data or hybrid Data Platforms, on‑premises or cloud, implementing batch or real‑time processing pipelines, and performing transformation and handling of structured and unstructured data
  • Autonomous in the phases of data acquisition, historization, cleansing, anonymization/crypting/masking, null-value and outlier handling, aggregation, structuring of unstructured data, creation of quality KPIs, and preparation of data for different users
  • Receiving Machine Learning models from Data Scientists, optimizing them for scalable execution—for example by applying computational parallelism—and integrating/scheduling them for efficient automated execution
  • Working with various technologies, chosen based on the specific project and client, favoring cloud‑native and globally scalable architectures
  • Provide Advisory support to select Engineering technologies within emerging Big Data architectures or to improve existing ecosystems
  • Build relationships with clients, vendors, and partners
  • Actively contribute to the Community through research activities, scouting, new solution concepts, and business development
  • Fulltime
Read More
Arrow Right

Cloud Data Engineer

We are seeking a Cloud Data Engineer with 7–10 years of experience in SQL, PL/SQ...
Location
Location
India , Pune
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7–10 years of experience in SQL, PL/SQL, and Google Cloud Platform (GCP) technologies
  • Hands-on expertise in GCP BigQuery, Datafusion
  • Experience with infrastructure tools such as Cloud Functions, App Engine, and Cloud Run
  • Proficient in building and maintaining GCP infrastructure
  • Strong analytical, debugging, and problem-solving capabilities
  • Familiar with data warehousing concepts and large-scale data processing
  • Comfortable working in collaborative, cross-functional teams
  • Experience with both SQL and NoSQL database systems and data processing frameworks
Job Responsibility
Job Responsibility
  • Write and debug complex SQL and PL/SQL queries in GCP BigQuery
  • Build and maintain GCP-based infrastructure using Google Cloud Functions, App Engine, and Cloud Run
  • Collaborate with data engineers to process and manage large datasets using GCP services including BigQuery and Cloud Storage
  • Ensure best practices for performance, security, and scalability of cloud applications
  • Develop unit tests and maintain documentation to ensure code quality and maintainability
  • Troubleshoot and debug cloud-based applications and services in production environments
  • Apply cloud-native development principles across projects
  • Work with both SQL and NoSQL database systems and data processing frameworks
What we offer
What we offer
  • Opportunity to work on cutting-edge cloud technologies and large-scale data projects
  • Exposure to collaborative, cross-functional teams and agile development practices
  • A chance to contribute to high-impact, scalable solutions within a global organisation
Read More
Arrow Right

Aws Data Engineer (Cloud Data Platform & Pipeline Specialist)

Design, develop, and maintain scalable cloud-based data pipelines using AWS serv...
Location
Location
United States , Atlanta
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering, with strong hands-on expertise in AWS data services (Glue, EMR, S3, RDS, DataSync, DMS)
  • 5+ years of Proven experience building and managing data pipelines (batch and streaming) in cloud environments
  • 5+ years of Strong experience in data migration, transformation frameworks, and large-scale data replication
  • 5+ years of Deep understanding of data modeling, data transformation, and reconciliation techniques
  • 5+ years of Experience designing and implementing secure data access and governance (least privilege principles)
  • 5+ years of Hands-on experience with data validation, auditing, and reconciliation processes
  • Familiarity with regulatory or finance data environments and reporting workloads
  • 5+ years of Strong problem-solving skills and ability to work in a collaborative, fast-paced environment
  • AWS data services
  • data pipelines
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable cloud-based data pipelines using AWS services such as Glue, EMR, S3, RDS, DataSync, and DMS
  • Build and optimize batch and streaming data orchestration workflows to support enterprise data platforms
  • Lead large-scale data migration efforts, including legacy-to-cloud transformations and replication strategies
  • Perform data modeling, transformation, and reconciliation to ensure high-quality, consistent datasets across systems
  • Implement secure data access patterns following least-privilege principles for pipelines and datasets
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver solutions
  • Establish robust data validation, reconciliation, and audit mechanisms to meet regulatory and reporting requirements
  • Troubleshoot and optimize performance of ETL/ELT pipelines and data workflows in AWS environments
  • Support governance, compliance, and audit readiness for data platforms in regulated environments (finance/reporting)
  • Fulltime
Read More
Arrow Right

Data Engineer (Big Data, Cloud - AWS, Databricks) - Assistant Vice President

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Scala, Spark/Pyspark is must, Hadoop ( BIG Data ), + AWS,Databricks
  • 8 to 11 years’ experience implementing data-intensive solutions using agile methodologies
  • Experience of relational databases and using SQL for data querying, transformation and manipulation
  • Experience of modelling data for analytical consumers
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • Experience in cloud native technologies and patterns
  • A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • An inclination to mentor
  • an ability to lead and deliver medium sized components independently
Job Responsibility
Job Responsibility
  • Developing and supporting scalable, extensible, and highly available data solutions
  • Deliver on critical business priorities while ensuring alignment with the wider architectural vision
  • Identify and help address potential risks in the data supply chain
  • Follow and contribute to technical standards
  • Design and develop analytical data models
  • Fulltime
Read More
Arrow Right

Google Cloud Data Engineer

NMI is looking for a passionate Intermediate Software Engineer to join our Gatew...
Location
Location
United States
Salary
Salary:
Not provided
parking.net Logo
Parking Network B.V.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or equivalent experience
  • 3+ years of experience developing complex applications
  • Professional experience developing applications in PHP
  • Strong understanding of object-oriented programming and design patterns
  • Experience with relational databases such as MySQL (schema design, query optimization)
  • Familiarity with secure coding principles and building software with security in mind
  • Experience with Git and CI/CD workflows
  • Experience contributing across the full software development lifecycle
  • Experience with modern frontend development (JavaScript, React, NPM, basic CSS)
  • Ability to work both independently and collaboratively
Job Responsibility
Job Responsibility
  • Design, build, and enhance features across multiple Gateway Portal applications used by NMI staff, partners, and merchants
  • Develop and maintain front-end and back-end functionality using technologies such as PHP, C#, JavaScript, React, and Angular
  • Develop and maintain MySQL queries aligned with best practices for performance and scalability
  • Write unit, integration, and end-to-end tests to ensure code quality and reliability
  • Document business logic, application workflows, and technical design decisions
  • Collaborate with Product Managers to refine requirements and contribute to technical solution design
  • Participate in code reviews to maintain high engineering standards and share best practices
  • Work with Site Reliability Engineering and QA teams to ensure software is observable, resilient, secure, and production-ready
  • Diagnose and resolve incidents, defects, and performance bottlenecks in collaboration with cross-functional teams
  • Contribute to continuous improvement of development processes, tooling, and engineering practices
What we offer
What we offer
  • Annual salary + bonus
  • A remote first culture
  • Flex PTO
  • Health, Dental and Vision Insurance
  • 13 Paid Holidays
  • Company volunteer days
Read More
Arrow Right