CrawlJobs Logo
Vodafone Logo Vodafone · IT - Software Development

Manager Data Engineer (GCP + Python)

India, Pune · Job Posted March 05, 2026
Apply Position
Job Link Share

Job Description

The Data Engineer will design, develop, and maintain data solutions leveraging Google Cloud Platform (GCP) and Python. This role is critical for building scalable data pipelines, optimising performance, and ensuring data integrity across multiple systems. The individual will collaborate with cross-functional teams to deliver high-quality data products that support business decisions.

Job Responsibility

  • Design, develop, and maintain ETL/ELT pipelines to ingest, transform, and load large datasets into GCP-based platforms (e.g., BigQuery, Cloud Storage)
  • Optimise data pipelines for performance, reliability, and scalability
  • Develop and manage data models, schemas, and storage solutions aligned with best practices
  • Leverage GCP services such as Cloud Composer, Dataflow, Pub/Sub, and Cloud Functions to build automated workflows
  • Implement data validation, cleansing, and quality checks to maintain accuracy and integrity
  • Collaborate with data scientists, analysts, and business stakeholders to define and execute data requirements
  • Set up monitoring systems to track pipeline performance and ensure timely delivery

Requirements

  • Proficiency in Python for building and deploying data processing scripts
  • Strong expertise in GCP services, especially BigQuery, Cloud Storage, Cloud Functions, Cloud Composer, and Pub/Sub
  • Experience with SQL for querying and processing data
  • Familiarity with workflow orchestration tools like Apache Airflow
  • Knowledge of version control systems (e.g., Git)
  • Excellent communication and stakeholder management skills

Nice to have

  • Advanced GCP features and emerging cloud technologies
  • Best practices for cost optimisation and performance tuning in cloud environments
  • Integration of streaming solutions like Kafka with Python SDK
  • Collaborative approaches to data-driven decision-making
Vodafone - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Manager Data Engineer (GCP + Python)

8 matching positions

Data Engineer - GCP, Python & BigQuery - VOIS

We are seeking a Data Engineer with strong expertise in GCP BigQuery, Data Fusio...
Location
Location
India , Pune
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7–10 years of relevant experience in data engineering or data warehousing roles
  • Strong proficiency in SQL and PL/SQL, particularly within GCP BigQuery environments
  • Hands-on experience with GCP services such as BigQuery and Data Fusion, with working knowledge of other GCP components
  • Understanding of data warehousing concepts, database systems (SQL and NoSQL) and data processing frameworks
  • Exposure to Python for data processing or cloud-based development
  • Strong problem-solving, debugging and analytical skills
  • Clear communication and effective collaboration within cross-functional teams
  • Graduate or postgraduate degree in a technical discipline, preferably Engineering
Job Responsibility
Job Responsibility
  • Design, develop and maintain data solutions using GCP services such as BigQuery, Data Fusion, Cloud Storage, Cloud Functions, App Engine and Cloud Run
  • Write, debug and optimise complex SQL and PL/SQL queries to process and analyse large-scale datasets
  • Collaborate with data engineers and stakeholders to process and manage large volumes of structured data
  • Ensure best practices are followed for performance, security, scalability and reliability of cloud-based data applications
  • Develop and maintain unit tests and technical documentation to ensure code quality and long-term maintainability
  • Troubleshoot and resolve issues in cloud-based data applications and services in production environments
  • Apply cloud-native development principles and modern data engineering practices
  • Contribute to continuous improvement initiatives within data warehousing and analytics platforms
What we offer
What we offer
  • Opportunity to work on enterprise-scale data platforms using modern GCP technologies
  • Exposure to global analytics programmes and shared services delivery models
  • A collaborative environment that values process improvement, quality and innovation
  • The chance to influence data reliability, performance and analytics outcomes
Read More
Arrow Right

Gcp Data Engineer

We are seeking a skilled Data Engineer with strong expertise in Google Cloud Pla...
Location
Location
India , Pune
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experienced in building and managing data pipelines on Google Cloud Platform
  • Proficient in BigQuery, Google Cloud Storage, Dataproc, and Cloud Composer
  • Strong hands-on skills in SQL, Python, Unix, and Spark
  • Comfortable analysing data quality issues and designing practical, sustainable solutions
  • Able to work collaboratively with cross-functional teams in a fast-paced, delivery-focused environment
  • Detail-oriented, with a strong focus on data reliability, performance, and operational stability
Job Responsibility
Job Responsibility
  • Engage with end users and business stakeholders to understand data requirements and contribute to ETL framework strategies
  • Design, build, and implement modern, scalable data solutions using Google Cloud Platform services
  • Automate manual processes to optimise data delivery, including orchestration workflows, logging, and alerting mechanisms
  • Analyse datasets to assess data quality, reusability, and integrity, and provide effective solutions to resolve data quality issues
  • Review reports and performance indicators to filter data and identify, troubleshoot, and correct code-related issues
  • Monitor daily data pipelines to ensure solution readiness, zero downtime, and rapid alerting in case of failures
  • Maintain and track audit tables to ensure consistency and reliability of data workflows
  • Perform reverse engineering of existing workflows to understand current functionality and support enhancements
  • Enhance and optimise existing GCP data pipelines to deliver stable, efficient, and scalable solutions
  • Collaborate with data science and machine learning teams, along with key stakeholders, to support business objectives
What we offer
What we offer
  • Opportunity to work on large-scale, enterprise-grade data platforms within a global organisation
  • Exposure to modern cloud-native data engineering practices and emerging GCP technologies
  • Collaboration with diverse, international teams across data engineering, data science, and business domains
  • A culture that values continuous learning, improvement, and inclusive teamwork
  • Fulltime
Read More
Arrow Right

GCP Data Engineer

We are looking for a Data Engineer to join BIP, working on Google Cloud Platform...
Location
Location
Spain , Madrid
Salary
Salary:
Not provided
businessintegrationpartners.com Logo
Business Integration Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience implementing and managing cloud-based data platforms
  • Knowledge of Google Cloud Platform and data processing services (e.g., Dataflow, Composer, Data Fusion, Vertex AI)
  • Strong understanding of modern data platform concepts (Big Data, Data Lake, Data Warehouse, Data Virtualization, Data Mesh, Data Governance, etc.)
  • Experience designing data models and building/maintaining ETL/ELT data pipelines
  • Knowledge of one or more programming and query languages (e.g., SQL, Java, Ruby, Python, R)
  • Strong knowledge of structured and unstructured database technologies (e.g., BigQuery, Cloud SQL, Firestore)
Job Responsibility
Job Responsibility
  • Operate GCP data platforms
  • Implementing batch and real-time processing pipelines
  • Managing both structured and unstructured data
  • Preparing datasets for Data Scientists, BI tools, relational and non-relational databases, and external applications via APIs
  • Optimize and integrate Machine Learning models for scalable execution
  • Provide guidance on the most suitable GCP services
  • Collaborate with clients, vendors, and partners to ensure solutions aligned with business objectives
  • Actively contribute to the internal community through research, technology scouting, and the development of new solutions
What we offer
What we offer
  • More than 300 courses on emerging technologies and business topics, personalized development programs, and training and people care initiatives
  • Flexible working arrangements
  • Solidarity Time Bank
  • Health insurance
  • Discounted medical check-ups
  • Platforms for physical and mental well-being
  • Supplementary welfare plan
  • Meal vouchers
  • 100% salary integration for the first 3 months of parental leave or a one-time bonus
  • Extra days for fathers
  • Fulltime
Read More
Arrow Right

Gcp Data Engineer- Senior Consultant

Location
Location
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 9+ years’ experience as DE - Python, GCP, BigQuery
  • Object oriented programming, Python and SQL
  • Strong knowledge in cloud computing platforms - Google Cloud - Candidate should be able to design, build, and deploy data pipelines in the cloud, to ingest data from various sources like databases, APIs or streaming platforms
  • Experience in composer or Apache Airflow and knowledge of Dataplex is a plus
  • Experience in dq checks implementation, any frameworks like Clouddq, Pydeequ
  • Good Knowledge of Dq dimensions
  • Experience working with GCP cloud-based infrastructure & systems
  • Programming skills (SQL, Python, other scripting)
  • Proficient in data modelling techniques and database optimization
  • Knowledge of query optimization, indexing, and performance tuning is necessary for efficient data retrieval and processing
Job Responsibility
Job Responsibility
  • Modelling the data from various sources and technologies
  • Troubleshooting and supporting the most complex and high impact problems, to deliver new features and functionalities
  • Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems
  • Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval
  • Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency
  • Identifying and resolving issues related to data processing, storage, or infrastructure
  • Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations
  • Train and mentor junior data engineers, providing guidance and knowledge transfer
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Internal Gallup Certified Strengths Coach to support your growth
  • Fulltime
Read More
Arrow Right

Gcp Data Engineer- Lead Consultant

Location
Location
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 7+ years of experience as a Data Engineer working with GCP cloud-based infrastructure & systems
  • Deep knowledge of Google Cloud Platform and cloud computing services
  • Extensive experience in design, build, and deploy data pipelines in the cloud, to ingest data from various sources like databases, APIs or streaming platforms
  • Proficient in database management systems such as SQL (Big Query is a must), NoSQL
  • Programming skills (SQL, Python, other scripting)
  • Proficient in data modeling techniques and database optimization
  • Knowledge of at least one orchestration and scheduling tool (Airflow is a must)
  • Experience with data integration tools and techniques, such as ETL and ELT
  • Knowledge of modern data transformation tools (such as DBT, Dataform)
  • Excellent communication skills
Job Responsibility
Job Responsibility
  • Part of the team accountable for design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery)
  • Involvement throughout the whole process starting with the gathering, analyzing, modelling, and documenting business/technical requirements
  • The role will include direct contact with clients
  • Modelling the data from various sources and technologies
  • Troubleshooting and supporting the most complex and high impact problems, to deliver new features and functionalities
  • Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems
  • Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval
  • Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency
  • Identifying and resolving issues related to data processing, storage, or infrastructure
  • Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Internal Gallup Certified Strengths Coach to support your growth
  • Grow as we grow as a company
  • Fulltime
Read More
Arrow Right

Senior Data Engineer (GCP)

Get ready to take your place on n11, an open market platform has made valuable c...
Location
Location
Turkey , Sarıyer/İstanbul
Salary
Salary:
Not provided
ariteknokent.com.tr Logo
İTÜ ARI Teknokent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Academic degree in Data Engineering, Computer Engineering, Computer Science, Software Engineering, Applied Mathematics or similar background
  • Minimum of 5 years work experience
  • 2+ years professional development experience with the GCP data stack
  • Expertise in architecting, developing, and managing real-time data pipelines
  • Expertise in deploying machine learning models in production
  • Experience with stream data pipeline frameworks or solutions
  • Experience working in message queuing, stream processing, and highly scalable ‘big data’ data stores
  • Experience with Kafka, PubSub, or other event-based systems
  • Experience working in cloud environments and with containerization frameworks, tools and platforms (e.g Docker, Kubernetes, GKE, etc)
  • Expertise in building data products incrementally and integrating/managing datasets on GCP from multiple sources
Job Responsibility
Job Responsibility
  • Analyze, Design, Implement, Test, and Document all new or modified AA/ML/DL systems, models and applications
  • Integrating data management technologies and software engineering tools into existing structures
  • Building and managing data jobs with various data platforms (on-prem rdbms to cloud and vice versa)
  • Implementation of data orchestration pipelines, data sourcing, cleansing, augmentation and quality control processes
  • Deployment of data pipelines in GCP
  • DevOps and DataOps skills including “infrastructure as code” systems
  • Leverage latest technologies to deliver better insights more quickly and cost effectively
  • Fulltime
Read More
Arrow Right

Python Data Engineer

We are currently looking for an Data Engineer to join our fast-paced, data-drive...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
dataidols.com Logo
Data Idols
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong Python and or Pyspark
  • Experience with cloud technologies such as GCP (BigQuery, Compute Engine, Kubernetes) and AWS (Redshift, EC2)
  • Experience building ETL/ELT pipelines and working with APIs or SFTP integrations
  • Understanding of data modelling, warehousing, and Big Data environments
  • Strong analytical and creative problem-solving skills
  • Ability to manage projects and collaborate effectively in a team
  • Experience creating util packages in Python
Job Responsibility
Job Responsibility
  • Building, operating, and optimising end-to-end ETL/ELT data pipelines using APIs, SFTP, and containerised orchestration tools
  • Developing scalable and well-structured data models that support commercial, programmatic, and affiliate revenue functions
  • Managing and improving complex data infrastructure that processes high-volume, multi-source Big Data
  • Creating, maintaining, and enhancing interactive dashboards that drive KPI-focused decision-making
  • Owning data quality, ensuring accuracy, consistency, and reliability across all core datasets
  • Analysing campaign, monetisation, and platform performance and providing actionable insights
  • Collaborating with Operations, Sales, Marketing, Finance, and Senior Analytics teams
  • Supporting strategic projects with advanced data modelling and insight generation
Read More
Arrow Right

Senior Data Software Engineer (Python & PySpark) - Vice President

The Senior Data Software Engineer is a senior level position responsible for est...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
  • 7+ years of experience in data engineering, with a strong focus on Python and big data technologies
  • Proven expertise in designing and implementing large-scale data processing solutions using PySpark
  • Extensive experience with distributed computing frameworks like Apache Spark
  • Strong understanding of data warehousing concepts, dimensional modeling, and ETL/ELT principles
  • Proficiency in SQL and experience with various relational and NoSQL databases
  • Experience with cloud platforms (AWS, Azure, GCP) and their data services (e.g., S3, ADLS, Google Cloud Storage, Redshift, Snowflake, BigQuery, Databricks)
  • Familiarity with workflow orchestration tools (e.g., Apache Airflow, Azure Data Factory, AWS Step Functions)
  • Experience with version control systems (e.g., Git)
  • Excellent problem-solving, analytical, and communication skills.
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
  • Fulltime
Read More
Arrow Right