CrawlJobs Logo

Data Engineering Specialist

India, Pune · Job Posted March 19, 2026
Apply Position
Job Link Share

Job Description

We are seeking an experienced Data Engineering Specialist with strong hands-on expertise in Databricks on GCP, Python-based data engineering, and Spark processing. The individual will design, build, and optimise large-scale data pipelines across the GCP ecosystem, applying robust engineering practices, data quality frameworks, and cost-optimised solutions.

Job Responsibility

  • Design and build data pipelines on GCP using Databricks (Delta Lake and Unity Catalog) for orchestration, Dataproc for Spark execution, supporting both ETL/ELT and feature engineering workloads
  • Engineer declarative, modular, and reusable pipelines in Python, following configuration-as-code principles and CI/CD practices including Git-based promotion, testing, and deployment
  • Implement and maintain data quality and observability practices using validation frameworks, logging, metrics, and alerts
  • Optimise pipeline performance, reliability, and cost through techniques such as cluster sizing, auto-termination, Z-ordering, caching, and partitioning strategies
  • Apply robust error handling, parameterisation, and triggers within Cloud Data Fusion pipelines
  • Ensure operational excellence by maintaining monitoring, performance tuning, and continuous improvements across data products and workloads

Requirements

  • Strong expertise in Databricks on GCP including Delta Lake, notebooks/jobs, Unity Catalog, and cluster policies
  • Experienced in Cloud Data Fusion design, including pipeline management, error handling, and orchestration
  • Skilled in Dataproc Spark with experience building PySpark jobs, configuring ephemeral clusters, and handling initialisation actions
  • Proficient in Python for data engineering including packaging, unit testing, type hints, and linting
  • Strong SQL skills, specifically with BigQuery including performance tuning, partitioning, and clustering
  • Familiar with GCP services such as Cloud Storage, Pub/Sub, and Cloud Composer/Airflow
  • Holds a qualification such as B.E., B.Tech, BCA, MCA, BSc, or MSc in Computer Science or a related field

What we offer

  • The opportunity to build and scale data solutions using leading GCP and Databricks technologies
  • Exposure to enterprise-level CI/CD, observability, and configuration-as-code practices
  • A collaborative environment where innovation, continuous learning, and technical excellence are encouraged
  • The chance to contribute to high-impact global data platforms

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineering Specialist

8 matching positions

Backend & Data Engineering Specialist

We are seeking a Backend & Data Engineering Specialist to design, build and oper...
Location
Location
India , Pune
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Python
  • Flask
  • FastAPI
  • BigQuery
  • SQL
  • Docker
  • Git
  • machine learning
  • time-series forecasting
  • regression models
Job Responsibility
Job Responsibility
  • Design, develop and maintain backend services using Python frameworks such as Flask and FastAPI
  • Build, optimise and support data pipelines and analytics workflows using BigQuery and SQL
  • Develop containerised applications using Docker and manage source code through Git
  • Implement and maintain machine learning solutions, including time-series forecasting and regression models
  • Support ETL and data transformation workflows, with exposure to PySpark-based processing
  • Deploy, monitor and manage applications on Google Cloud Platform (GCP)
  • Ensure applications comply with security, governance and data protection standards
  • Actively participate in Agile ceremonies including sprint planning, daily stand-ups, sprint reviews and retrospectives
  • Collaborate closely with Product Owners, DevOps, Data and Security teams within an Agile/Scrum setup
  • Take ownership of deliverables and contribute to continuous improvement in Agile execution
What we offer
What we offer
  • Opportunity to work on cloud-native backend and data platforms using Google Cloud technologies
  • Exposure to analytics-driven and machine learning–enabled solutions
  • Collaboration with cross-functional teams in a modern Agile delivery environment
  • A role that balances engineering ownership with continuous improvement and learning
Read More
Arrow Right

Engineering Specialist (Data)

Working in a team of like-minded and highly skilled Network Engineers, the prima...
Location
Location
United Kingdom , Leiston
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive field experience including cabling and installation of networking equipment
  • Experience working with (configuring and implementing) predominantly Cisco LAN, WLAN and WAN solutions in an enterprise environment
  • Ability to develop strong customer relationships as well as functioning in a team environment
  • Knowledge of and exposure to multi-technology Solutions
  • A broad understanding of the other technologies these solutions are dependent on
  • Ability to achieve and maintain high level Security Clearance (SC)
Job Responsibility
Job Responsibility
  • Ability to act as on-site technical support for Vodafone LAN/WAN/Wifi technologies and as a point of contact for customer Hands-on build activity to stage, commission and install new network equipment
  • On-site installation and maintenance
  • Incident Management (Technology and Solution based)
  • Root Cause analysis for major incidents and escalated faults Ensure all work is risk-assessed with the production and maintenance of H&S Compliant documentation (RAMs and Point of Works Risk Assessment)
  • Production of customer site and solution network documentation
  • Monitor progress of activities within each project
  • providing regular updates to Leads, management and key stakeholders
  • Provides 1st/ 2nd line support to resolve user faults and carry out changes on the networks
What we offer
What we offer
  • Great pay
  • bonuses
  • up to 28 days off plus bank holidays
  • paid time for charity work
  • discounts
  • vouchers
  • a pension plan
  • Fulltime
Read More
Arrow Right

Data Modeling & Engineering Specialist

We are seeking a technically proficient and business-aware Data Modelling & Engi...
Location
Location
Egypt , Giza
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong proficiency in SQL, including analytical functions and performance tuning
  • Experienced with ETL tools such as SSIS, Informatica, Talend, or Airflow
  • Solid understanding of data modelling principles and database design
  • Familiar with cloud platforms (Azure, GCP, AWS) and data warehousing concepts
  • Knowledge of data governance, security, and GDPR compliance is advantageous
  • Comfortable working in agile environments and collaborating across teams
Job Responsibility
Job Responsibility
  • Design and maintain conceptual, logical, and physical data models aligned with business requirements
  • Apply dimensional modelling techniques such as star and snowflake schemas for analytics and reporting
  • Ensure consistency, integrity, and optimisation across data models
  • Develop and maintain ETL pipelines using SQL and modern tools
  • Write efficient SQL scripts for data extraction, transformation, and loading
  • Conduct data validation and quality checks to ensure reliability
  • Build and manage data warehouses and lakes on platforms including Azure, GCP, or AWS
  • Utilise services such as Azure Synapse, BigQuery, or Snowflake for scalable storage and querying
  • Optimise data storage and retrieval for performance and cost-efficiency
  • Partner with data analysts, scientists, and business stakeholders to gather and understand requirements
What we offer
What we offer
  • Opportunity to work on cutting-edge cloud data platforms and tools
  • Exposure to cross-functional collaboration and agile delivery environments
  • A chance to contribute to strategic data initiatives that impact business decisions
  • Be part of a global organisation driving digital transformation
Read More
Arrow Right

Engineering Data Management Specialist

Within the framework of Data Management activities for a global leader in the ae...
Location
Location
Poland , Lodz
Salary
Salary:
Not provided
airbus.com Logo
Airbus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Mechanical Engineering or a related field
  • Experience with product data management processes (Management of product master data)
  • Initial experience with Agile and SAFe principles
  • Languages: English fluent (mandatory)
Job Responsibility
Job Responsibility
  • Executing data quality audits and cleaning activities to support seamless project transitions
  • Leveraging technical knowledge of standard parts and materials to ensure data accuracy
  • Utilizing data analysis tools (Google Sheets, macros, and Skywise) to monitor and improve data consistency
What we offer
What we offer
  • Stable employment based on full-time job contract
  • International working environment in the dynamic company
  • Access to the latest knowledge and technologies enabling professional development
  • Trainings and development possibilities
  • Participating in international project
  • Competitive salary dependent on experience and qualifications
  • Flexible working hours, home office
  • Private medical coverage for you and your family
  • Sport card
  • Wellbeing platform
  • Fulltime
Read More
Arrow Right

Engineering Data Management Specialist

Within the framework of Data Management activities for a global leader in the ae...
Location
Location
Poland , Lodz
Salary
Salary:
Not provided
airbus.com Logo
Airbus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Mechanical Engineering or a related field
  • Experience with product data management processes (Management of product master data)
  • Initial experience with Agile and SAFe principles
  • Languages: English fluent (mandatory)
Job Responsibility
Job Responsibility
  • Executing data quality audits and cleaning activities to support seamless project transitions
  • Leveraging technical knowledge of standard parts and materials to ensure data accuracy
  • Utilizing data analysis tools (Google Sheets, macros, and Skywise) to monitor and improve data consistency
What we offer
What we offer
  • Stable employment based on full-time job contract
  • International working environment in the dynamic company
  • Access to the latest knowledge and technologies enabling professional development
  • Trainings and development possibilities
  • Participating in international project
  • Competitive salary dependent on experience and qualifications
  • Flexible working hours, home office
  • Private medical coverage for you and your family
  • Sport card
  • Wellbeing platform
  • Fulltime
Read More
Arrow Right

Aws Data Engineer (Cloud Data Platform & Pipeline Specialist)

Design, develop, and maintain scalable cloud-based data pipelines using AWS serv...
Location
Location
United States , Atlanta
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering, with strong hands-on expertise in AWS data services (Glue, EMR, S3, RDS, DataSync, DMS)
  • 5+ years of Proven experience building and managing data pipelines (batch and streaming) in cloud environments
  • 5+ years of Strong experience in data migration, transformation frameworks, and large-scale data replication
  • 5+ years of Deep understanding of data modeling, data transformation, and reconciliation techniques
  • 5+ years of Experience designing and implementing secure data access and governance (least privilege principles)
  • 5+ years of Hands-on experience with data validation, auditing, and reconciliation processes
  • Familiarity with regulatory or finance data environments and reporting workloads
  • 5+ years of Strong problem-solving skills and ability to work in a collaborative, fast-paced environment
  • AWS data services
  • data pipelines
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable cloud-based data pipelines using AWS services such as Glue, EMR, S3, RDS, DataSync, and DMS
  • Build and optimize batch and streaming data orchestration workflows to support enterprise data platforms
  • Lead large-scale data migration efforts, including legacy-to-cloud transformations and replication strategies
  • Perform data modeling, transformation, and reconciliation to ensure high-quality, consistent datasets across systems
  • Implement secure data access patterns following least-privilege principles for pipelines and datasets
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver solutions
  • Establish robust data validation, reconciliation, and audit mechanisms to meet regulatory and reporting requirements
  • Troubleshoot and optimize performance of ETL/ELT pipelines and data workflows in AWS environments
  • Support governance, compliance, and audit readiness for data platforms in regulated environments (finance/reporting)
  • Fulltime
Read More
Arrow Right
New

Principal Specialist, Data Science

Similar profile to a data engineer but needs to have much more experience, self ...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 14, 2026
Flip Icon
Requirements
Requirements
  • GCP Infrastructure: Deep hands-on experience with Google Cloud, specifically BigQuery, Cloud Logging/Monitoring, Pub/Sub, and IAM
  • BigQuery Specialist: You should understand the 'under the hood' mechanics of BigQuery (slots, shuffle, and storage) to provide actionable optimization advice to the engineering team
  • Automation & IaC: Proficiency with Terraform for managing cloud resources and Python or Bash for operational scripting
  • Problem Solving: A methodical approach to troubleshooting
  • Communication: Ability to communicate technical 'post-mortems' to stakeholders and provide clear documentation for operational procedures
Job Responsibility
Job Responsibility
  • BigQuery Performance & Cost Management: Actively monitor BigQuery usage to identify 'heavy' queries and inefficient patterns. Work with developers to implement optimization strategies such as partitioning, clustering, and slot management to balance performance with budget
  • Platform Observability: Design and maintain comprehensive alerting and monitoring that notifies the team before a failure impacts the business
  • Incident Response & Troubleshooting: Lead the root-cause analysis (RCA) for data platform outages or performance degradation. You will define and lead how we respond to issues involving the data platform
  • Operational Excellence: Automate routine maintenance tasks using Terraform and Python. You will ensure that our IAM roles, service accounts, and data encryption policies adhere to the principle of least privilege
  • Workflow Orchestration: Support the stable execution of data ingestion/publishing and scheduled jobs (pub/sub, cloud functions, DBT, Workflows), ensuring that dependencies are respected and data freshness expectations are met
Read More
Arrow Right

Senior Specialist Data Science and Predictive Care

The Senior Specialist Data Science & Predictive Care leads data-driven transform...
Location
Location
Congo, the Democratic Republic of the , Kinshasa
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's degree in data science, Statistics, Computer Science, Mathematics, Engineering, Information Systems, or related field
  • 4-6 years of experience in Data Analytics, Data Science, Predictive Analytics, Business Intelligence, or Customer Operations Analytics
  • Experience in telecom industry is highly desirable
  • Experience working with large datasets and operational analytics
  • Exposure to AI, Machine Learning, Predictive Care, or Generative AI initiatives is an advantage
  • Experience working with cross-functional business and technology teams essential
Job Responsibility
Job Responsibility
  • Create predictive models to forecast customer actions, churn, repeat calls, fraud, and service issues
  • Build machine learning frameworks for proactive customer care
  • Design segmentation models for personalized engagement
  • Develop anomaly detection for monitoring and fraud management
  • Use statistical and AI methods to pinpoint root causes of customer pain and inefficiency
  • Support Generative AI and LLM applications in customer operations
  • Develop scoring and recommendation engines to boost engagement and decisions
  • Drive proactive customer care initiatives through real-time analytics and predictive intelligence
  • Identify customer issues before escalation and recommend preventive actions
  • Enable intelligent customer treatment strategies based on behavioral and operational insights
Read More
Arrow Right