CrawlJobs Logo

GCP Lead Engineer

United States, Phoenix Contract work · Job Posted June 15, 2026
Apply Position
Job Link Share

Job Description

We are seeking a Lead GCP Engineer to provide technical leadership for enterprise real-time data platforms and cloud modernization initiatives. This role will be responsible for leading the design, optimization, and evolution of large-scale data processing environments while driving adoption of modern cloud-native technologies within Google Cloud Platform (GCP). The ideal candidate has deep expertise in real-time and batch data processing architectures, strong leadership experience, and a proven track record supporting enterprise-scale data platforms. This individual will serve as a technical leader for both platform engineering efforts and the broader data engineering team, helping advance cloud capabilities and support future AI and analytics initiatives.

Job Responsibility

  • Lead the design, implementation, and optimization of enterprise real-time and batch data platforms
  • Provide technical leadership and mentorship to data engineering teams supporting large-scale data ecosystems
  • Drive modernization efforts leveraging Google Cloud Platform (GCP) technologies
  • Design and support scalable data pipelines for ingestion, processing, storage, and analytics
  • Collaborate with architecture, infrastructure, security, and analytics teams to deliver enterprise data solutions
  • Support and optimize distributed data platforms including streaming, search, caching, and data processing technologies
  • Develop automation, monitoring, and operational processes to improve platform reliability and performance
  • Partner with stakeholders to define platform roadmaps and future-state architecture strategies
  • Evaluate emerging technologies and support AI, machine learning, and GenAI-related initiatives
  • Establish engineering best practices for scalability, performance, security, and operational excellence

Requirements

  • 10+ years of experience in data engineering, platform engineering, or big data environments
  • 8+ years of experience leading teams supporting enterprise-scale batch and real-time data platforms
  • Strong hands-on experience with: Hadoop, HBase, Kafka, Redis, Elasticsearch, MapRDB or similar distributed data platforms
  • 3+ years of experience with Google Cloud Platform (GCP), including: Bigtable, Dataproc, Pub/Sub, Composer
  • Strong Python development experience
  • Experience designing and supporting large-scale distributed systems and real-time data architectures
  • Proven ability to lead technical initiatives and mentor engineering teams
  • Strong analytical, troubleshooting, and communication skills

Nice to have

  • Experience supporting AI, machine learning, or Generative AI initiatives
  • GenAI certifications or related technical training
  • Experience with enterprise observability and monitoring platforms, including ELK Stack
  • Familiarity with cloud-native architecture and platform engineering best practices
  • Experience supporting highly available, mission-critical production environments
  • Knowledge of infrastructure automation and DevOps methodologies

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

GCP Lead Engineer

8 matching positions

GCP Lead Engineer

The GCP Lead Engineer role at NTT DATA involves managing cloud administration an...
Location
Location
India , Noida
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in Linux/UNIX/AIX troubleshooting with a strong foundation in system administration and performance tuning
  • Hands-on experience in installing, configuring, and maintaining Linux servers (RHEL, CentOS, Ubuntu, SUSE)
  • Proficiency in High Availability (HA) configuration and management using Pacemaker (PCS & CRM) Clusters
  • Expertise in OS patching using cloud-native tools such as Azure AUM, AWS Patch Manager, and GCP VM Manager
  • Solid understanding of networking and performance troubleshooting
  • Working knowledge of VMware in GCVE (Google Cloud VMware Engine)
  • Experience with Red Hat Satellite, SUSE Manager, Oracle Linux Manager, and Oracle Spacewalk
  • Exposure to containerization and orchestration tools like Docker, Kubernetes, and OpenShift (preferred)
  • Familiarity with automation and scripting tools such as Shell scripting, Ansible, Python, or any cloud-native shell
  • Strong grasp of ITSM/ITIL processes
Job Responsibility
Job Responsibility
  • Manage and support cloud administration, GCVE infrastructure, OS/server patching, maintenance, and troubleshooting
  • Work across multiple cloud platforms with a proactive and solution-oriented approach
  • Participate in on-call rotations and handle P1/P2 incidents and escalations effectively
  • Develop and maintain knowledge base (KB) articles, problem management documentation, SOPs, and runbooks
  • Provide mentorship and support to L1 support teams
  • Deliver timely, high-quality customer service with strong ownership and accountability
  • Work independently in project environments while collaborating effectively with cross-functional teams
  • Fulltime
Read More
Arrow Right

Lead GCP Data Engineer

At Vodafone, we’re not just shaping the future of connectivity for our customers...
Location
Location
India , Pune
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Apache Airflow
  • Apache
  • Data Integration
  • Cloud Storage Software
  • Data Modeling
  • Analytics
  • Data Warehousing
  • Data Warehouse Software
Read More
Arrow Right

Gcp Data Engineer- Lead Consultant

Location
Location
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 7+ years of experience as a Data Engineer working with GCP cloud-based infrastructure & systems
  • Deep knowledge of Google Cloud Platform and cloud computing services
  • Extensive experience in design, build, and deploy data pipelines in the cloud, to ingest data from various sources like databases, APIs or streaming platforms
  • Proficient in database management systems such as SQL (Big Query is a must), NoSQL
  • Programming skills (SQL, Python, other scripting)
  • Proficient in data modeling techniques and database optimization
  • Knowledge of at least one orchestration and scheduling tool (Airflow is a must)
  • Experience with data integration tools and techniques, such as ETL and ELT
  • Knowledge of modern data transformation tools (such as DBT, Dataform)
  • Excellent communication skills
Job Responsibility
Job Responsibility
  • Part of the team accountable for design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery)
  • Involvement throughout the whole process starting with the gathering, analyzing, modelling, and documenting business/technical requirements
  • The role will include direct contact with clients
  • Modelling the data from various sources and technologies
  • Troubleshooting and supporting the most complex and high impact problems, to deliver new features and functionalities
  • Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems
  • Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval
  • Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency
  • Identifying and resolving issues related to data processing, storage, or infrastructure
  • Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Internal Gallup Certified Strengths Coach to support your growth
  • Grow as we grow as a company
  • Fulltime
Read More
Arrow Right

Lead Data Engineer (GCP)

Our Client is an international organization operating in the digital media and s...
Location
Location
Poland
Salary
Salary:
165.00 - 185.00 PLN / Hour
devire.pl Logo
Devire
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in a Senior or Lead Data Engineer role
  • Hands-on experience with Google Cloud Platform (GCP)
  • Strong proficiency in PySpark
  • Solid experience in delivering data engineering projects in a cloud environment
  • Experience with data platform migrations, including migrations between different technologies or environments
  • Knowledge of: CloudOps / DevOps practices, Automation and CI/CD pipelines, System reliability and observability (nice to have)
  • Excellent communication and collaboration skills
  • English proficiency (min. B2)
Job Responsibility
Job Responsibility
  • Act as a technical lead and key contributor within the Data Engineering domain
  • Organize and structure the team’s work to ensure efficient delivery
  • Identify and remove day-to-day technical and process-related blockers
  • Support the team in technical and architectural decision-making
  • Communicate effectively with stakeholders and provide regular progress updates
  • Contribute to the migration of the data platform to Google Cloud Platform
What we offer
What we offer
  • Benefits package (medical healthcare, sports membership, etc.)
  • Possibility to cooperate with an international company with a stable market position
  • Remote work
  • Long-term cooperation
  • An active role in an international structure and the opportunity for growth
Read More
Arrow Right

Senior Data & AI/ML Engineer - GCP Specialization Lead

We are on a bold mission to create the best software services offering in the wo...
Location
Location
United States , Menlo Park
Salary
Salary:
Not provided
techjays.com Logo
techjays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • GCP Services: BigQuery, Dataflow, Pub/Sub, Vertex AI
  • ML Engineering: End-to-end ML pipelines using Vertex AI / Kubeflow
  • Programming: Python & SQL
  • MLOps: CI/CD for ML, Model deployment & monitoring
  • Infrastructure-as-Code: Terraform
  • Data Engineering: ETL/ELT, real-time & batch pipelines
  • AI/ML Tools: TensorFlow, scikit-learn, XGBoost
  • Min Experience: 10+ Years
Job Responsibility
Job Responsibility
  • Design and implement data architectures for real-time and batch pipelines, leveraging GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Vertex AI, and Cloud Storage
  • Lead the development of ML pipelines, from feature engineering to model training and deployment using Vertex AI, AI Platform, and Kubeflow Pipelines
  • Collaborate with data scientists to operationalize ML models and support MLOps practices using Cloud Functions, CI/CD, and Model Registry
  • Define and implement data governance, lineage, monitoring, and quality frameworks
  • Build and document GCP-native solutions and architectures that can be used for case studies and specialization submissions
  • Lead client-facing PoCs or MVPs to showcase AI/ML capabilities using GCP
  • Contribute to building repeatable solution accelerators in Data & AI/ML
  • Work with the leadership team to align with Google Cloud Partner Program metrics
  • Mentor engineers and data scientists toward achieving GCP certifications, especially in Data Engineering and Machine Learning
  • Organize and lead internal GCP AI/ML enablement sessions
What we offer
What we offer
  • Best in class packages
  • Paid holidays and flexible paid time away
  • Casual dress code & flexible working environment
  • Medical Insurance covering self & family up to 4 lakhs per person
Read More
Arrow Right

GCP AI Platform Architect / Lead AI Platform Engineer

Our client is an innovative technology company specializing in the development o...
Location
Location
Poland , Kraków
Salary
Salary:
Not provided
teamquest.pl Logo
TeamQuest Sp. z o. o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • GCP Expertise (verifiable - ask for production examples): GCP is their primary cloud not secondary experience alongside AWS/Azure. Production deployments across most of: Vertex AI, Cloud Run or GKE, Pub/Sub, BigQuery, Secret Manager, VPC Service Controls, IAM + Workload Identity. Has designed for GCP from scratch, not migrated from another cloud, end-to-end ownership
  • AI / Backend Engineering: Python is the primary language - production-grade service/API development, not scripting or data science only. Strong track record building distributed systems and integrating LLMs.
  • Agentic Architecture (must be production, not PoC): Hands-on production experience with at least one: LangGraph, Google ADK, CrewAI, or custom multi-agent orchestration layer. RAG pipelines shipped to production. Google ADK: candidate must be able to explain what it is, when to use it, and how it compares to LangGraph and custom orchestration. AI agent workflows, ReAct prompting, and Function Calling in production environments
  • Multi-Tenant Architecture: Has designed a multi-tenant SaaS platform end-to-end - not just contributed. Can articulate tenant isolation strategies: IAM boundary design, data isolation per tenant, VPC controls.
  • API Design & Integrations: Proven ability to create secure, high-performance APIs capable of asynchronously managing traffic and communication between multiple decoupled services.
  • Enterprise Security: Practical knowledge of data isolation in multi-tenant SaaS architectures, IAM, and securing cloud-based environments.
  • Vector Databases: Hands-on experience with semantic search and at least one of: Pinecone, Weaviate, pgvector, or Vertex Matching Engine.
Job Responsibility
Job Responsibility
  • System Architecture: Design and develop a scalable, cloud-native architecture on Google Cloud Platform (GCP) that meets enterprise security and multi-tenant data isolation requirements for a SaaS environment
  • AI Agent Orchestration: Architect and implement autonomous, multi-step AI workflows with a clear separation of agent responsibilities (retrieval, analysis, reasoning, response generation)
  • Hands-on Core Development: Actively contribute to core system development-coding orchestration logic, designing services, optimizing performance, and building secure API integrations for routing queries across internal and external agents
  • Frontend Enablement: Design the backend layer, streaming protocols, and APIs to seamlessly support and integrate with advanced conversational UIs
  • Data Management & Extensibility: Build a robust backend capable of processing qualitative and social data, ensuring the platform is easily extensible to incorporate new data sources
What we offer
What we offer
  • Attractive salary
  • Full remote work
  • Social benefits:sporto card,healthcare insurance
  • Fulltime
Read More
Arrow Right

GCP AI Platform Architect / Lead AI Platform Engineer

Our client is an innovative technology company specializing in the development o...
Location
Location
Poland , Katowice
Salary
Salary:
Not provided
teamquest.pl Logo
TeamQuest Sp. z o. o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • GCP Expertise (verifiable - ask for production examples): production deployments across most of: Vertex AI, Cloud Run or GKE, Pub/Sub, BigQuery, Secret Manager, VPC Service Controls, IAM + Workload Identity
  • Has designed for GCP from scratch, not migrated from another cloud, end-to-end ownership
  • AI / Backend Engineering: Python is the primary language - production-grade service/API development, not scripting or data science only
  • Strong track record building distributed systems and integrating LLMs
  • Agentic Architecture (must be production, not PoC): Hands-on production experience with at least one: LangGraph, Google ADK, CrewAI, or custom multi-agent orchestration layer
  • RAG pipelines shipped to production
  • Google ADK: candidate must be able to explain what it is, when to use it, and how it compares to LangGraph and custom orchestration
  • AI agent workflows, ReAct prompting, and Function Calling in production environments
  • Multi-Tenant Architecture: Has designed a multi-tenant SaaS platform end-to-end - not just contributed
  • Can articulate tenant isolation strategies: IAM boundary design, data isolation per tenant, VPC controls
Job Responsibility
Job Responsibility
  • System Architecture: Design and develop a scalable, cloud-native architecture on Google Cloud Platform (GCP) that meets enterprise security and multi-tenant data isolation requirements for a SaaS environment
  • AI Agent Orchestration: Architect and implement autonomous, multi-step AI workflows with a clear separation of agent responsibilities (retrieval, analysis, reasoning, response generation)
  • Hands-on Core Development: Actively contribute to core system development-coding orchestration logic, designing services, optimizing performance, and building secure API integrations for routing queries across internal and external agents
  • Frontend Enablement: Design the backend layer, streaming protocols, and APIs to seamlessly support and integrate with advanced conversational UIs
  • Data Management & Extensibility: Build a robust backend capable of processing qualitative and social data, ensuring the platform is easily extensible to incorporate new data sources
What we offer
What we offer
  • Attractive salary
  • Full remote work
  • Social benefits: sport card, healthcare insurance
  • Fulltime
Read More
Arrow Right

Lead Software Engineer - Full Stack Engineer

Wells Fargo is seeking a Lead Software Engineer. In this role, you will: Lead co...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
June 28, 2026
Flip Icon
Requirements
Requirements
  • 5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • Single page applications using Java, Python, JavaScript, TypeScript, and modern frameworks/libraries such as React.js, Next.js, Tailwind, Bootstrap etc.
  • Develop and maintain large scale applications using Java, Python, Go, GCP public cloud, and other relevant technologies
  • Deploy containerized applications using Docker and Kubernetes
  • 5+ years experience in JavaScript and related frameworks (Node.js, React, TypeScript)
  • 3+ experience with Google cloud
  • Developing and deploying cloud native solution
  • Experience with terraform development
  • 2+ experience designing and developing Generative AI framework and solutions
  • Building generative AI applications using ADK, OpenAI Agent Frameworks, LangChain, LangGraph, and similar tools.
Job Responsibility
Job Responsibility
  • Lead complex technology initiatives including those that are companywide with broad impact
  • Act as a key participant in developing standards and companywide best practices for engineering complex and large scale technology solutions for technology engineering disciplines
  • Design, code, test, debug, and document for projects and programs
  • Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented technical factors
  • Make decisions in developing standard and companywide best practices for engineering and technology solutions requiring understanding of industry best practices and new technologies, influencing and leading technology team to meet deliverables and drive new initiatives
  • Collaborate and consult with key technical experts, senior technology team, and external industry groups to resolve complex technical issues and achieve goals
  • Lead projects, teams, or serve as a peer mentor
  • Fulltime
Read More
Arrow Right