CrawlJobs Logo

Data Engineer – Senior Consultant, GCP

lingarogroup.com Logo

Lingaro

Location Icon

Location:
India

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Responsibility:

  • You will be a part of the team accountable for design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery)
  • Involvement throughout the whole process starting with the gathering, analyzing, modelling, and documenting business/technical requirements will be needed
  • The role will include direct contact with clients
  • Modelling the data from various sources and technologies
  • Troubleshooting and supporting the most complex and high impact problems, to deliver new features and functionalities
  • Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems
  • Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval
  • Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency
  • Identifying and resolving issues related to data processing, storage, or infrastructure
  • Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations
  • Train and mentor junior data engineers, providing guidance and knowledge transfer

Requirements:

  • At least 8+ years’ experience as DE - Python, GCP, BigQuery
  • Object oriented programming, Python and SQL
  • Strong knowledge in cloud computing platforms - Google Cloud - Candidate should be able to design, build, and deploy data pipelines in the cloud, to ingest data from various sources like databases, APIs or streaming platforms
  • Experience in composer or Apache Airflow and knowledge of Dataplex is a plus
  • Experience in dq checks implementation, any frameworks like Clouddq, Pydeequ
  • Good Knowledge of Dq dimensions
  • Experience working with GCP cloud-based infrastructure & systems
  • Programming skills (SQL, Python, other scripting)
  • Proficient in data modelling techniques and database optimization
  • Knowledge of query optimization, indexing, and performance tuning is necessary for efficient data retrieval and processing
  • Proficient in database management systems such as SQL (Big Query is a must), NoSQL
  • Candidate should be able to design, configure, and manage databases to ensure optimal performance and reliability
  • Experience with data integration tools and techniques, such as ETL and ELT Candidate should be able to integrate data from multiple sources and transform it into a format that is suitable for analysis

Nice to have:

Experience in composer or Apache Airflow and knowledge of Dataplex is a plus

What we offer:
  • Stable employment
  • “Office as an option” model
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Internal Gallup Certified Strengths Coach to support your growth

Additional Information:

Job Posted:
January 05, 2026

Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Engineer – Senior Consultant, GCP

Senior Director - Data Engineering & Machine Learning

Lead the Data Revolution at Modus Create. At Modus Create, we empower the world’...
Location
Location
Canada
Salary
Salary:
Not provided
moduscreate.com Logo
Modus Create
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years in data or software engineering roles
  • 7+ years leading Data Engineering/ML teams—ideally at scale or in global consulting contexts
  • Hands-on experience with cloud data platforms, big data toolchains (Spark, Kafka), data transformation tools (Airflow, dbt), and ML platforms
  • Success in pre-sales, solutioning, and growing data/ML engagements within enterprise or mid-market accounts
  • Demonstrated ability to create enablement programs, uplift team capabilities, and grow inclusive, high-performing engineering cultures
  • Deep empathy for client pain points and the ability to craft and deliver impactful, measurable solutions
  • Excellent across technical, executive, and cross-functional settings, with an ability to successfully navigate diverse cultural differences
Job Responsibility
Job Responsibility
  • Build Modern Data Platforms
  • Design and oversee architecture for cloud-native data platforms, pipelines, and streaming systems on AWS, Azure, or GCP
  • Ensure robust solutions using platforms such as Databricks, Snowflake, Redshift, BigQuery, Spark, Kafka, Airflow, dbt, and Kubernetes
  • Deliver Products that are Intelligent
  • Define and drive responsible ML strategy, from model development to integration, using platforms like SageMaker, Azure ML, or TensorFlow
  • Enable smarter client experiences by embedding ML into applications, automation, and analytics
  • Lead & Grow Teams
  • Foster a culture of trust, continuous learning, and experimentation by hiring, mentoring, and empowering distributed teams of data and ML engineers
  • Define career paths, feedback frameworks, and learning programs grounded in a culture of experimentation,continuous growth, and a sense of belonging at every level
  • Shape Technical Strategy & Best Practices
What we offer
What we offer
  • Remote work with flexible working hours
  • Modus Global Office Programme:for when you want to get out of your home, we offer on-demand access to private offices, meeting rooms, coworking spaces and business lounges in locations in over 120 countries
  • Employee Referral Program
  • Client Referral Program
  • Travel according to client or team needs
  • The chance to work side-by-side with thought leaders in emerging tech
  • Access to more than 12,000 courses with a licensed Coursera account
  • Possibility to obtain paid certification/courses if they align with company goals and are relevant to the employee's role
  • Fulltime
Read More
Arrow Right

Principal Consulting AI / Data Engineer

As a Principal Consulting AI / Data Engineer, you will design, build, and optimi...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
dyflex.com.au Logo
DyFlex Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven expertise in delivering enterprise-grade data engineering and AI solutions in production environments
  • Strong proficiency in Python and SQL, plus experience with Spark, Airflow, dbt, Kafka, or Flink
  • Experience with cloud platforms (AWS, Azure, or GCP) and Databricks
  • Ability to confidently communicate and present at C-suite level, simplifying technical concepts into business impact
  • Track record of engaging senior executives and influencing strategic decisions
  • Strong consulting and stakeholder management skills with client-facing experience
  • Background in MLOps, ML pipelines, or AI solution delivery highly regarded
  • Degree in Computer Science, Engineering, Data Science, Mathematics, or a related field
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data and AI solutions using Databricks, cloud platforms, and modern frameworks
  • Lead solution architecture discussions with clients, ensuring alignment of technical delivery with business strategy
  • Present to and influence executive-level stakeholders, including boards, C-suite, and senior directors
  • Translate highly technical solutions into clear business value propositions for non-technical audiences
  • Mentor and guide teams of engineers and consultants to deliver high-quality solutions
  • Champion best practices across data engineering, MLOps, and cloud delivery
  • Build DyFlex’s reputation as a trusted partner in Data & AI through thought leadership and client advocacy
What we offer
What we offer
  • Work with SAP’s latest technologies on cloud as S/4HANA, BTP and Joule, plus Databricks, ML/AI tools and cloud platforms
  • A flexible and supportive work environment including work from home
  • Competitive remuneration and benefits including novated lease, birthday leave, salary packaging, wellbeing programme, additional purchased leave, and company-provided laptop
  • Comprehensive training budget and paid certifications (Databricks, SAP, cloud platforms)
  • Structured career advancement pathways with opportunities to lead large-scale client programs
  • Exposure to diverse industries and client environments, including executive-level engagement
  • Fulltime
Read More
Arrow Right

Senior Consultant - Software Engineering

Software Engineering Senior Consultants who will be primarily responsible for wo...
Location
Location
Philippines
Salary
Salary:
Not provided
3cloudsolutions.com Logo
3Cloud
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, engineering, data science or a related field
  • 5-7 years of experience in application development specializing in C# .NET Framework, Angular, Microservices, React, Node
  • Some relevant working experience in Azure, Azure App Services, Microsoft, and Agile
  • A passion for building front-end applications and cloud-native applications using PaaS, containers, serverless and modern front-end JS/TS
  • Desire for continuous learning and new technology to be used in the cloud space
  • Desire to be hands-on code but able to develop complex architectures in the cloud
  • Experience working in a consulting environment
  • Experience working in a major cloud platform, Azure, AWS, or GCP. Azure Preferred
  • Very knowledgeable in OOA/OOD and Design Patterns
  • Understanding of the Agile process and DevOps
Job Responsibility
Job Responsibility
  • Own technical envisioning, design, project scope and working with the project team to deploy Azure-based solutions that meet our client’s needs
  • Translate requirements into a technical design leveraging existing tools, services and frameworks
  • Drive design and deployment of the client’s workloads into Azure by providing architectural guidance (including, design, implementation and deployment), supporting development of the client’s cloud adoption model, and providing appropriate recommendations to overcome blockers
  • Keep abreast of emerging technology trends and their impact on cloud solutions
  • Identify, validate, and grow opportunities to accelerate consumption in high potential customer accounts in partnership with the sales team, by driving solution architecture for both Microsoft and third-party solutions
  • As a senior role, you are required to train, shadow, and provide knowledge transfer to junior developers and other technology teams
What we offer
What we offer
  • Competitive compensation package, salary, allowance, standard benefits including quarterly and annual performance-based cash bonus and other remuneration
  • Great working environment and company culture with flexible work location
  • Fulltime
Read More
Arrow Right

Lead Consultant - Software Engineering

We are looking for a Lead Consultant in Software Engineering who will be primari...
Location
Location
Philippines
Salary
Salary:
Not provided
3cloudsolutions.com Logo
3Cloud
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, engineering, data science or a related field
  • 3-4 years of experience managing a team / or equivalent
  • 5-7 years of experience in application development specializing in C# .NET Framework, Angular, Microservices, React, Node
  • Some relevant working experience in Azure, Azure App Services, Microsoft, and Agile
  • A passion for building front-end applications and cloud-native applications using PaaS, containers, serverless and modern front-end JS/TS
  • Desire for continuous learning and new technology to be used in the cloud space
  • Desire to be hands-on code but able to develop complex architectures in the cloud
  • Experience working in a consulting environment
  • Experience working in a major cloud platform, Azure, AWS, or GCP. Azure Preferred
  • Very knowledgeable in OOA/OOD and Design Patterns
Job Responsibility
Job Responsibility
  • Own technical envisioning, design, project scope and working with the project team to deploy Azure-based solutions that meet our client’s needs
  • Translate requirements into a technical design leveraging existing tools, services and frameworks
  • Drive design and deployment of the client’s workloads into Azure by providing architectural guidance (including, design, implementation and deployment), supporting development of the client’s cloud adoption model, and providing appropriate recommendations to overcome blockers
  • Keep abreast of emerging technology trends and their impact on cloud solutions
  • Identify, validate, and grow opportunities to accelerate consumption in high potential customer accounts in partnership with the sales team, by driving solution architecture for both Microsoft and third-party solutions
  • As a senior role, you are required to train, shadow, and provide knowledge transfer to junior developers and other technology teams
What we offer
What we offer
  • Competitive compensation package, salary, allowance, standard benefits including quarterly and annual performance-based cash bonus and other remuneration
  • Great working environment and company culture with flexible work location
  • Fulltime
Read More
Arrow Right

Senior Detection Engineer

This is a detection engineering role that leverages knowledge of monitoring, ana...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Sciences or related field or equivalent experience/certification
  • 3+ years of collective experience in Splunk SIEM (Splunk Enterprise Security) threat detection use case development or UEBA (Exabeam) use case development for insider threat use case development
  • 5+ years of experience in security functions such as SOC, CIRT, security engineering, risk management, vulnerability management or technical infrastructure operations, administration, or systems engineering
  • scripting or programming language, including Python
  • Current information security certification such as Certified Information Security Manager (CISM), Certified Information Systems Security Professional (CISSP) preferred
  • offensive and defensive security certifications such as CEH, IGAC Cyber Defense, OSCP or other related certifications preferred
  • Splunk Certification, including Splunk Enterprise Security Certified Admin preferred
  • use case development experience on the Exabeam platform preferred
  • working knowledge of the NIST Cyber Security Framework and ISO/IEC 27001:2022 preferred
  • working knowledge of the MITRE ATT&CK Framework preferred
Job Responsibility
Job Responsibility
  • Lead collaboration sessions within the cyber security tower and other business units to devise security monitoring use cases
  • engage and collaborate with other security engineers and architects as needed to keep pace with the evolution of corporate infrastructure and applications and share that knowledge with peers as appropriate
  • document prospective security monitoring use cases with MITRE ATT&ACK mappings using standard templates and methodologies
  • inform and consult other cyber ops teams of required data onboarding and integrations for use case development
  • develop analytics, correlation searches, dashboards, reports and alerts within the SIEM and UEBA platforms
  • solicit feedback for pre-production security monitoring content through peer review process and user acceptance testing for tuning
  • document developed security monitoring content in a documentation registry using department standard templates and methodologies
  • manage field mapping and transmission of security monitoring alerts to the security incident response platform for SOC analyst consumption as outlined in process documentation
  • provide governance support for the content development function entailing content development standards compliance, change management approvals for SIEM or UEBA content, and lifecycle management of developed security monitoring content
  • service operational requests in queue such as analytics content performance tuning, filtering, search refinement, parsing issues
  • Fulltime
Read More
Arrow Right

Senior Bigdata Engineer

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8 - 10 years of relevant experience
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Programming Languages: Python, PySpark
  • Data Lake Table Format: Apache Iceberg
  • Data Orchestration: Apache Airflow
  • Data Visualization: Tableau
  • Big Data Processing: Apache Spark
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
What we offer
What we offer
  • Equal employment opportunity
  • Fulltime
Read More
Arrow Right

Senior Solutions Architect & Customer Advisor – Hybrid Cloud, Data and AI

We are seeking an exceptional Senior Solutions Architect & Customer Advisor to s...
Location
Location
United States
Salary
Salary:
161000.00 - 268300.00 USD / Year
rackspace.com Logo
Rackspace
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology, Engineering or related field
  • MBA or relevant graduate degree preferred
  • 15+ years of hands-on experience in cloud architecture, enterprise infrastructure or solutions architecture
  • Proven track record designing and implementing large-scale cloud solutions for enterprise clients
  • Deep expertise in Hybrid Cloud and Data Center architecture with focus on at least two major platforms (AWS, Azure, GCP) and experience with private cloud platforms (VMware, OpenStack)
  • Strong technical foundation in infrastructure, networking, security, and cloud-native development
  • Demonstrated ability to architect solutions from requirements through implementation
  • Experience working with Banking & Financial Services or Healthcare clients on cloud initiatives
  • Information security, risk management, and regulatory expertise
  • Understanding of industry-specific operational models and applications
Job Responsibility
Job Responsibility
  • Lead technical discovery engagements to assess current cloud maturity, identify hybrid cloud opportunities, and understand infrastructure and application modernization requirements
  • Conduct comprehensive assessments of customer technology environments to identify gaps, risks, and transformation opportunities
  • Translate customer business challenges into technical requirements and cloud architecture specifications
  • Design end-to-end cloud solutions across private cloud, hybrid cloud, and data center ecosystems, including network and cybersecurity
  • Develop technical roadmaps that align cloud strategy with business objectives
  • Create proofs-of-concept, reference architectures, and migration strategies
  • Architect and optimize hybrid cloud solutions across AWS, Azure, and/or GCP platforms, ensuring resilience, scalability, and operational excellence
  • Design cloud-native architectures leveraging infrastructure-as-code (Terraform, CloudFormation), automation, and DevOps practices
  • Provide technical leadership on data center modernization, VMware environments, and private cloud platforms
  • Advise on AI/ML integration, intelligent automation, and emerging cloud technologies
What we offer
What we offer
  • incentive compensation opportunities in the form of annual bonuses or incentives, equity awards, and an Employee Stock Purchase Plan (ESPP)
  • Fulltime
Read More
Arrow Right
New

Data Observability Consultant

We are looking for a data observability consultant who will help mature data qua...
Location
Location
India
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in any quantitative discipline
  • 7 to 10 years of experience in implementing off-the-shelf or be-spoke data observability solutions
  • Proven experience with data observability tools such as Acceldata, BigEye, Soda, Monte Carlo, Anomalo etc. Or experience implementing bespoke observability solutions using Grafana, Prometheus or cloud native services
  • Proven experience as a Data Quality Consultant, Data Quality Engineer or similar role
  • Proficiency in SQL and other programming languages such as Python or R
  • Ability to clearly articulate, influence, and thought partner with senior business leaders
  • Understanding of modern technology trends and data stacks in data management and governance
  • Experience in running customer workshops and other collaboration sessions to discover customer priorities, understand current state, and determine maturity/readiness to execute on enterprise Data Management & Governance vision
  • Familiarity with Azure, or GCP and associated DQ capabilities
  • Understanding of cloud-based data storage and data pipeline architecture
Job Responsibility
Job Responsibility
  • Data Observability Management: Define end-to-end data quality and observability solution including data quality operating model and framework using relevant Data Observability tools
  • Data Observability: Lead development and deployment of off-the-shelf or be-spoke solutions that monitor data pipelines and databases with help of automated checks and alerts
  • Data Quality Improvement: Develop and implement reactive, predictive, and preventive strategies to improve the quality of data in the data analytics products and platforms using various methods including data cleansing, data enrichment, data validation, data observability and AI/ML
  • Collaboration: Collaborate with data engineers, data scientists, and other stakeholders to ensure data quality across all stages of the data lifecycle
  • Innovation in Data Quality & Observability: Stay abreast of industry trends and emerging technologies. Propose innovative solutions to enhance data observability processes
  • Liaise with information security teams, and business data stewards, to define priorities and roadmaps for managing and mitigating risks related to data security and data privacy
  • Drive upskilling and adoption initiatives on data observability within customer organizations
  • Contribute to balanced score cards as well as data collection and reporting process for data governance councils for monitoring progress and tracking bottlenecks
  • Identify and define opportunities for automating data quality related processes
  • Collaborate with other Data Management consultants at Lingaro to identify and create repeatable methodologies and templates for effectively delivering data management and governance services
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Internal Gallup Certified Strengths Coach to support your growth
  • Grow as we grow as a company
Read More
Arrow Right