Lead GCP Data Engineer Job at Vodafone (Pune)

Gcp Data Engineer- Lead Consultant

Location

Salary:

Not provided

Lingaro

Expiration Date

Until further notice

Requirements

At least 7+ years of experience as a Data Engineer working with GCP cloud-based infrastructure & systems
Deep knowledge of Google Cloud Platform and cloud computing services
Extensive experience in design, build, and deploy data pipelines in the cloud, to ingest data from various sources like databases, APIs or streaming platforms
Proficient in database management systems such as SQL (Big Query is a must), NoSQL
Programming skills (SQL, Python, other scripting)
Proficient in data modeling techniques and database optimization
Knowledge of at least one orchestration and scheduling tool (Airflow is a must)
Experience with data integration tools and techniques, such as ETL and ELT
Knowledge of modern data transformation tools (such as DBT, Dataform)
Excellent communication skills

Job Responsibility

Part of the team accountable for design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery)
Involvement throughout the whole process starting with the gathering, analyzing, modelling, and documenting business/technical requirements
The role will include direct contact with clients
Modelling the data from various sources and technologies
Troubleshooting and supporting the most complex and high impact problems, to deliver new features and functionalities
Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems
Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval
Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency
Identifying and resolving issues related to data processing, storage, or infrastructure
Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations

What we offer

Stable employment
“Office as an option” model
Flexibility regarding working hours and your preferred form of contract
Comprehensive online onboarding program with a “Buddy” from day 1
Cooperation with top-tier engineers and experts
Unlimited access to the Udemy learning platform from day 1
Certificate training programs
Upskilling support
Internal Gallup Certified Strengths Coach to support your growth
Grow as we grow as a company

Fulltime

Lead Data Engineer (GCP)

Our Client is an international organization operating in the digital media and s...

Location

Poland

Salary:

165.00 - 185.00 PLN / Hour

Devire

Expiration Date

Until further notice

Requirements

Proven experience in a Senior or Lead Data Engineer role
Hands-on experience with Google Cloud Platform (GCP)
Strong proficiency in PySpark
Solid experience in delivering data engineering projects in a cloud environment
Experience with data platform migrations, including migrations between different technologies or environments
Knowledge of: CloudOps / DevOps practices, Automation and CI/CD pipelines, System reliability and observability (nice to have)
Excellent communication and collaboration skills
English proficiency (min. B2)

Job Responsibility

Act as a technical lead and key contributor within the Data Engineering domain
Organize and structure the team’s work to ensure efficient delivery
Identify and remove day-to-day technical and process-related blockers
Support the team in technical and architectural decision-making
Communicate effectively with stakeholders and provide regular progress updates
Contribute to the migration of the data platform to Google Cloud Platform

What we offer

Benefits package (medical healthcare, sports membership, etc.)
Possibility to cooperate with an international company with a stable market position
Remote work
Long-term cooperation
An active role in an international structure and the opportunity for growth

Senior Data & AI/ML Engineer - GCP Specialization Lead

We are on a bold mission to create the best software services offering in the wo...

Location

United States , Menlo Park

Salary:

Not provided

techjays

Expiration Date

Until further notice

Requirements

GCP Services: BigQuery, Dataflow, Pub/Sub, Vertex AI
ML Engineering: End-to-end ML pipelines using Vertex AI / Kubeflow
Programming: Python & SQL
MLOps: CI/CD for ML, Model deployment & monitoring
Infrastructure-as-Code: Terraform
Data Engineering: ETL/ELT, real-time & batch pipelines
AI/ML Tools: TensorFlow, scikit-learn, XGBoost
Min Experience: 10+ Years

Job Responsibility

Design and implement data architectures for real-time and batch pipelines, leveraging GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Vertex AI, and Cloud Storage
Lead the development of ML pipelines, from feature engineering to model training and deployment using Vertex AI, AI Platform, and Kubeflow Pipelines
Collaborate with data scientists to operationalize ML models and support MLOps practices using Cloud Functions, CI/CD, and Model Registry
Define and implement data governance, lineage, monitoring, and quality frameworks
Build and document GCP-native solutions and architectures that can be used for case studies and specialization submissions
Lead client-facing PoCs or MVPs to showcase AI/ML capabilities using GCP
Contribute to building repeatable solution accelerators in Data & AI/ML
Work with the leadership team to align with Google Cloud Partner Program metrics
Mentor engineers and data scientists toward achieving GCP certifications, especially in Data Engineering and Machine Learning
Organize and lead internal GCP AI/ML enablement sessions

What we offer

Best in class packages
Paid holidays and flexible paid time away
Casual dress code & flexible working environment
Medical Insurance covering self & family up to 4 lakhs per person

New

GCP Lead Engineer

We are seeking a Lead GCP Engineer to provide technical leadership for enterpris...

Location

United States , Phoenix

Salary:

Not provided

Technologent

Expiration Date

Until further notice

Requirements

10+ years of experience in data engineering, platform engineering, or big data environments
8+ years of experience leading teams supporting enterprise-scale batch and real-time data platforms
Strong hands-on experience with: Hadoop, HBase, Kafka, Redis, Elasticsearch, MapRDB or similar distributed data platforms
3+ years of experience with Google Cloud Platform (GCP), including: Bigtable, Dataproc, Pub/Sub, Composer
Strong Python development experience
Experience designing and supporting large-scale distributed systems and real-time data architectures
Proven ability to lead technical initiatives and mentor engineering teams
Strong analytical, troubleshooting, and communication skills

Job Responsibility

Lead the design, implementation, and optimization of enterprise real-time and batch data platforms
Provide technical leadership and mentorship to data engineering teams supporting large-scale data ecosystems
Drive modernization efforts leveraging Google Cloud Platform (GCP) technologies
Design and support scalable data pipelines for ingestion, processing, storage, and analytics
Collaborate with architecture, infrastructure, security, and analytics teams to deliver enterprise data solutions
Support and optimize distributed data platforms including streaming, search, caching, and data processing technologies
Develop automation, monitoring, and operational processes to improve platform reliability and performance
Partner with stakeholders to define platform roadmaps and future-state architecture strategies
Evaluate emerging technologies and support AI, machine learning, and GenAI-related initiatives
Establish engineering best practices for scalability, performance, security, and operational excellence

Fulltime

Lead Data Engineer - AI Search

We are looking for a Lead Data Engineer — AI Search (all genders) to join Valtec...

Location

France , Paris

Salary:

Not provided

Valtech

Expiration Date

Until further notice

Requirements

7+ years of professional software engineering experience in enterprise environments
Strong expertise in Google Cloud Platform (GCP) and AI ecosystems
Experience with AI Search, conversational AI, and generative AI integrations
Strong application architecture, API design, and enterprise integration experience
Solid understanding of cloud-native, microservices, and event-driven architectures
Experience with CI/CD pipelines, software quality, observability, and cloud security best practices
Experience working with Kubernetes and Infrastructure as Code
Technical leadership experience, including mentoring engineers and guiding technical decisions
Ability to collaborate across architecture, engineering, cloud, and data teams
Strong communication and stakeholder management skills

Job Responsibility

Define detailed technical design, components, interfaces, and integration patterns
Lead development teams and enforce engineering standards and best practices
Coordinate architecture, cloud/platform, data, QA, and business stakeholders
Ensure delivery quality through testing, observability, and application security practices
Guide teams on GCP and AI Search implementation patterns
Lead technical discovery, estimation, and solution design workshops
Identify technical risks and propose mitigation strategies early
Ensure scalable, reliable, and production-ready AI solutions
Contribute hands-on in complex and high-impact technical areas
Support industrialization and operationalization of AI and search use cases

What we offer

Flexibility, with remote and hybrid work options (country-dependent)
Career advancement, with international mobility and professional development programs
Learning and development, with access to cutting-edge tools, training and industry experts

Fulltime

Senior Data Engineer Lead / Architect - Senior Vice President

At Citi Services - Global Trade Technology Organization, we are on a mission to ...

Location

India , Pune, Maharashtra, India, Chennai, Tamil Nadu, India

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

10+ years of professional experience in data engineering, with a proven track record of designing and building large-scale data systems
3+ years in a technical leadership or architect role, with experience mentoring junior and senior engineers
Expert-level proficiency in at least one programming language (Python or Scala preferred) and exceptional SQL skills
Proven hands-on experience with Python or Scala for data manipulation, scripting, machine learning, and backend development
Deep, hands-on experience with a major cloud platform (AWS, GCP, or Azure) and its data ecosystem (e.g., S3/GCS, Redshift/BigQuery, EMR/Dataproc, Kinesis/Dataflow)
Extensive hands-on experience with modern big data technologies and Data streaming (like Hadoop, Hive, Impala, Apache Spark, Kafka, or Flink)
Proficiency with workflow orchestration tools such as Airflow, Dagster, or Prefect
Proficiency in designing and implementing microservices architectures, RESTful APIs, and event-driven systems with 'Data as a Product' Principle
Solid understanding of data modeling concepts and database design for both analytical (OLAP) and transactional (OLTP) workloads
Deep understanding and hands-on experience with relational databases (e.g., PostgreSQL, Oracle), NoSQL databases (e.g., MongoDB, Cassandra), data warehousing, and big data technologies (e.g., Spark, Kafka)

Job Responsibility

Architect & Design: Design, architect, and oversee the development of robust, scalable, and reliable data infrastructure, including data lakes, data warehouses, and real-time streaming platforms on the cloud
Build & Code: Act as a senior individual contributor and hands-on technical leader. Write clean, maintainable, and high-performance code for data ingestion, transformation, and serving layers (e.g., using Python, Scala, SQL, and Spark)
Lead & Mentor: Lead a team of data engineers, providing technical guidance, mentorship, and career development support. Foster a collaborative and inclusive team environment
Champion Culture: Define, document, and champion data engineering best practices across the organization, including CI/CD, data quality, testing frameworks, observability, and code review standards
Drive Strategy: Partner with leadership, product managers, data scientists, and analysts to understand data needs and develop a long-term data strategy and roadmap
Innovate & Evaluate: Stay at the forefront of data engineering technologies. Evaluate, prototype, and recommend new tools and frameworks to continuously improve our data platform
Ensure Governance: Implement and enforce robust data governance, security, and privacy policies in partnership with our security and compliance teams

Fulltime

Gcp Data Engineer

We are seeking a skilled GCP Data Engineer to join our Technology function withi...

Location

India , Pune

Salary:

Not provided

Vodafone

Expiration Date

Until further notice

Requirements

Strong SQL expertise
Proficient in GCP ecosystem (BigQuery, Dataflow, Dataproc, Looker)
Experienced with DBT (model development, Jinja templating, lineage generation)
Knowledgeable in Data Vault 2.0
6+ years overall experience, at least 2-4 years focused on GCP, DBT, and Data Vault 2.0
B.E./B.Tech/BCA/MCA/BSc/MSc in Computer Science or related field
Google Cloud Certified Professional Data Engineer certification is advantageous
Collaborative, adaptable, committed to quality, timely delivery, policy adherence

Job Responsibility

Prepare Low Level Designs aligned with High Level Designs
Build, deploy, and operationalise robust data processing systems
Develop and optimise data pipelines using GCP services
Apply modern data pipeline patterns
Act as subject matter expert in GCP Data Engineering, supporting and mentoring junior team members
Apply learnings from new technologies to day-to-day delivery
Lead small teams or projects end-to-end
Contribute to organisational efficiency through process adoption, resource optimisation, tooling improvements
Actively contribute technical expertise to internal guilds and communities of practice

What we offer

Exposure to large-scale enterprise-grade data platforms
Opportunities to work on modern cloud data engineering solutions
Collaborative environment valuing learning and continuous improvement
Chance to influence data engineering practices and contribute to technical communities

Lead Data Engineer

We’re looking for a Senior/Lead Data Engineer to join our team. We are seeking a...

Location

India , Noida

Salary:

Not provided

Taazaa Inc

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field
7–9 years of experience as a Data Engineer or in a similar role
Strong experience in building and maintaining ETL/ELT pipelines
Experience supporting analytics and AI/ML data workflows
Hands-on experience with ETL tools such as Apache Airflow, Airbyte, and dbt
Strong expertise in SQL and NoSQL databases (MySQL, PostgreSQL, MongoDB, Redis)
Proficiency in Python and Shell scripting for data processing and automation
Experience with cloud platforms (AWS, Azure, GCP) and their data services
Familiarity with data warehousing solutions such as Amazon Redshift or Snowflake
Experience with containerization tools like Docker and orchestration using Kubernetes

Job Responsibility

Design, develop, and maintain scalable ETL/ELT pipelines for processing large datasets
Build data pipelines to ingest, transform, and load data into data lakes, warehouses, and feature stores
Optimise data workflows for performance, reliability, and scalability
Integrate data from multiple sources, including APIs, databases, and file systems (JSON, CSV, Parquet)
Manage relational and non-relational databases, including columnar databases like ClickHouse
Ensure efficient data storage and retrieval for both analytics and ML workloads
Implement data quality checks, validation frameworks, and monitoring systems
Maintain data lineage, metadata management, and governance standards
Ensure data accuracy, consistency, and compliance for analytics and AI/ML use cases
Deploy and manage data solutions on cloud platforms (AWS, Azure, GCP) or on-prem environments

What we offer

Competitive salaries
Health benefits
Various perks
Competitive compensation and performance-based incentives
Opportunities for professional growth through workshops and certifications
Flexible work-life balance with remote options
Collaborative culture
Exposure to diverse projects across various industries
Clear career advancement pathways
Comprehensive health benefits

Fulltime

Select Country

Lead GCP Data Engineer

Job Description

Requirements

Looking for more opportunities?