CrawlJobs Logo

Data Engineer

India, Hyderabad · Job Posted June 09, 2026
Apply Position
Job Link Share

Job Responsibility

  • Design, develop, and maintain scalable data pipelines and cloud-native data solutions for data ingestion, transformation, processing, and distribution using Databricks, Apache Spark, Airflow, and AWS technologies
  • Design, build, and maintain MuleSoft APIs and integration solutions leveraging API-led connectivity and enterprise integration best practices to enable robust integrations between CRM and cross-functional enterprise systems
  • Develop and optimize ETL/ELT processes to support large-scale structured and unstructured data processing across multiple enterprise platforms
  • Participate in the end-to-end delivery of data engineering solutions including design, development, testing, deployment, monitoring, and operational support
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
  • Build scalable and reusable data processing frameworks, components, and integration services following enterprise engineering standards and best practices
  • Develop and maintain data models, metadata definitions, data dictionaries, and technical documentation to ensure data consistency, accuracy, and governance compliance
  • Implement data validation, reconciliation, and quality control processes to ensure reliability and integrity of enterprise data assets
  • Optimize Spark jobs, SQL queries, APIs, and ETL pipelines for scalability, reliability, and performance
  • Leverage AWS cloud services to develop scalable, resilient, and secure data solutions and integration services
  • Implement monitoring, logging, alerting, and operational support processes for data pipelines, APIs, and cloud-based integrations
  • Support CI/CD automation and DevOps best practices for data engineering and integration deployments
  • Identify, troubleshoot, and resolve complex data processing, integration, and performance-related issues in a timely manner
  • Research and evaluate emerging technologies, tools, and AI-assisted engineering capabilities that improve platform performance, developer productivity, and operational excellence
  • Adhere to software engineering best practices including coding standards, unit testing, reusable component design, peer reviews, and documentation standards
  • Participate in sprint planning, backlog refinement, estimation, and other agile software delivery activities

Requirements

  • Master’s / Bachelor’s degree and 5 to 8 years of Computer Science, IT or related field experience
  • Hands-on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing
  • Proficiency in data analysis tools (eg. SQL) and experience with data visualization tools
  • Skilled in MuleSoft API and Mulesoft integration job design and development
  • Excellent problem-solving skills and the ability to work with large, complex datasets
  • Strong understanding of data governance frameworks, tools, and best practices
  • Knowledge of data protection regulations and compliance requirements (e.g., GDPR, CCPA)

Nice to have

  • Experience with ETL tools such as Apache Spark, and various Python packages related to data processing, machine learning model development
  • Strong understanding of data modeling, data warehousing, and data integration concepts
  • Knowledge of AnyPoint Platform, Python/R, Databricks, SageMaker, Airflow, AWS cloud data platforms
  • Proficiency in using Databricks Assistant, and other AI tools

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
August 02, 2026
Flip Icon
Requirements
Requirements
  • Data Engineers with 5-7 years of experience, with strong expertise in Databricks or Microsoft Fabric, for a 6-month contract engagement
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to support and enhance critical data operatio...
Location
Location
United States , Greenville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working in data engineering or data platform operations roles
  • Strong hands-on knowledge of Python for scripting, automation, and operational support
  • Experience managing or supporting Apache Kafka environments and related streaming data workflows
  • Familiarity with Snowflake administration, performance tuning, and resource management
  • Solid understanding of ETL processes, including data ingestion, transformation, and delivery concepts
  • Experience working with AWS services in support of modern data infrastructure
  • Knowledge of Terraform or similar infrastructure-as-code tools for environment management and automation
Job Responsibility
Job Responsibility
  • Oversee the health and performance of data pipelines that run across Snowflake, Kafka, and connected platforms
  • Investigate operational issues affecting data ingestion, transformation, or downstream delivery and drive timely resolution
  • Maintain stable batch and streaming processes by improving resiliency, uptime, and overall execution efficiency
  • Administer Snowflake resources, including warehouses, databases, permissions, and usage optimization
  • Manage Kafka infrastructure by tuning clusters, topics, partitions, and consumer group behavior for reliable throughput
  • Create and maintain automated solutions for deployment, monitoring, failure recovery, and routine workflow support
  • Develop operational scripts and utilities using Python, Bash, and related tools to reduce manual effort and improve consistency
  • Contribute to CI/CD practices that strengthen the release and maintenance process for data infrastructure
  • Partner with engineering and analytics teams to improve pipeline design, data performance, and delivery accuracy
  • Support data governance, security, compliance, and data quality standards through validation checks and alerting frameworks
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a skilled Data Engineer with strong experience in ETL development...
Location
Location
United States , Fort Lauderdale
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field, or equivalent experience
  • 3+ years of experience in data engineering or ETL development
  • Strong hands-on experience with Snowflake
  • Proficiency in Python for data processing and automation
  • Experience developing and supporting ETL/ELT workflows
  • Strong SQL skills and experience with relational databases
  • Familiarity with cloud data platforms and modern data warehouse architecture
  • Experience with data integration, transformation, and orchestration tools
  • Strong analytical, troubleshooting, and communication skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust ETL/ELT pipelines for ingesting, transforming, and loading data from multiple sources
  • Build and optimize data solutions within Snowflake
  • Develop reusable scripts and workflows using Python
  • Integrate data from APIs, databases, flat files, and third-party platforms
  • Monitor, troubleshoot, and enhance data pipeline performance, reliability, and scalability
  • Collaborate with analytics, engineering, and business teams to understand data requirements
  • Ensure data quality, integrity, governance, and security across platforms
  • Support data modeling, warehouse design, and performance tuning
  • Document technical designs, workflows, and operational processes
  • Participate in code reviews, testing, and deployment activities
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training
Read More
Arrow Right
New

Data Engineer

We are seeking a Data Engineer to design and build scalable data pipelines and p...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience in cloud environments (AWS and/or Azure)
  • Hands‑on experience with Databricks, Apache Spark, and Delta Lake
  • Strong skills in Python / PySpark and SQL
  • Experience with data pipelines, ETL/ELT, and data modeling
  • Familiarity with orchestration tools (Airflow or similar) and modern data architectures
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines using Databricks, Spark, and cloud-native services
  • Develop and optimize ETL/ELT workflows for batch and streaming data across AWS and Azure environments
  • Build and manage data models, data lakes, and warehousing solutions for analytics and AI use cases
  • Ensure data quality, reliability, and governance across the data lifecycle
  • Collaborate with data science, analytics, and platform teams to deliver data solutions
Read More
Arrow Right

Data Engineer

We’re hiring a Data Engineer to support AI and analytics initiatives by building...
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience
  • Strong proficiency in Python and SQL
  • Experience with Azure data stack (ADF, Databricks, Synapse)
  • Knowledge of data modeling and ETL best practices
Job Responsibility
Job Responsibility
  • Design and maintain data pipelines and ETL processes
  • Work with large datasets to support AI/ML model training
  • Build and optimize data architectures (data lakes, warehouses)
  • Collaborate with data scientists on feature engineering and model deployment
  • Ensure data quality, governance, and performance optimization
  • Integrate cloud-based data services (Azure Data Factory, Databricks)
Read More
Arrow Right

Data Engineer

Welcome to an exciting opportunity at Ericsson, where you'll step into the role ...
Location
Location
India , Kolkata
Salary
Salary:
Not provided
ericsson.com Logo
Ericsson
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong Python and Java expertise with experience building production-grade systems
  • Hands-on experience with Apache Spark (PySpark/Scala/Java) and distributed processing
  • Proven experience in high-volume, low-latency system design and optimization
  • Strong knowledge of Cassandra, OpenSearch/Elasticsearch, and NoSQL data modeling
  • Experience building scalable APIs and microservices (Spring Boot)
  • Hands-on experience with cloud platforms (AWS or GCP)
  • Strong working knowledge of Docker and Kubernetes
  • Experience with vulnerability management and non functional features ( alarm , logging , fault management etc.)
  • Good understanding of LLMs, embeddings, RAG, and GenAI data pipelines
  • Exposure to developer copilots / AI-assisted coding tools
Job Responsibility
Job Responsibility
  • Build and operate large-scale, high-throughput data systems handling massive datasets
  • Develop complex, scalable solutions using Python and Java
  • Design and optimize distributed data pipelines using Apache Spark
  • Engineer low-latency, high-performance data processing systems (batch + streaming)
  • Work with Cassandra and OpenSearch/Elasticsearch for high availability and scale
  • Develop scalable backend services and REST APIs (Spring Boot-based microservices)
  • Experience to work with AWS (Kiro) / Microsoft Copilot stack
  • Develop MCP-based applications and integrations with enterprise systems
  • Build RAG pipelines across network, service, customer, and operational data
  • Engineer data pipelines for embeddings, vector stores, and retrieval systems
  • Fulltime
Read More
Arrow Right

Data Engineer

Location
Location
Bulgaria; Georgia; Lithuania; Mexico; Moldova; Poland; Romania; Ukraine
Salary
Salary:
Not provided
coherentsolutions.com Logo
Coherent Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience as a Data Engineer
  • Solid proficiency in SQL
  • Experience working in Azure cloud environment
  • Experience with Azure SQL Pools
  • Strong understanding of performance tuning for data workloads
  • Experience working in Azure cloud environment
  • Excellent communication skills
  • English level: B2 (Upper-Intermediate) or higher
Job Responsibility
Job Responsibility
  • Develop and maintain data pipelines in the Azure environment
  • Work with Azure SQL Pools for data storage and processing
  • Write and optimize SQL queries
  • Perform performance tuning for queries and data workflows
  • Collaborate with a team of engineers on Databricks-based solutions
  • Build and orchestrate data workflows using Synapse Pipelines / Azure Data Factory
  • Ensure reliability and consistency of data pipelines
What we offer
What we offer
  • Technical and non-technical training for professional and personal growth
  • Internal conferences and meetups to learn from industry experts
  • Support and mentorship from an experienced employee to help you professional grow and development
  • Health insurance
  • English courses
  • Sports activities to promote a healthy lifestyle
  • Flexible work options, including remote and hybrid opportunities
  • Referral program for bringing in new talent
  • Work anniversary program and additional vacation days
  • Fulltime
Read More
Arrow Right

Data Engineer

The Associate Data Engineer is an entry level role within the Data Engineering j...
Location
Location
Malaysia , Selangor Darul Ehsan, Selangor
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Knowledge of the definition and management of scoping requirements, definition and prioritization activities
  • Understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models
  • Knowledge of Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP
  • Understanding of data architecture landscape between physical and logical data models
  • Analytical mindset with good business acumen skills
  • Problem-solving aptitude with the ability to communicate effectively, both written and verbal
  • Ability to build effective relationships at all levels within the organization
  • Programming languages (Perl, bash, Shell Scripting, Python, etc.)
  • Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field
  • Basic experience as a data engineering, data mining within a fast-paced environment
Job Responsibility
Job Responsibility
  • Supports the creation of data models in a structured data format to enable analysis thereof
  • Assists with the design and development of scalable extract, transform and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources
  • Participates in the transformation of object and data models into appropriate database schemas within design constraints. Interpret installation standards to meet project needs and produce database components as required
  • Takes direction from various stakeholders to create test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations
  • Assists with running data migrations across different databases and applications, for example, MS Dynamics, Oracle, SAP and other ERP systems
  • Supports the definition and implementation of data table structures and data models based on requirements
  • Takes part in analysis, and development of ETL and migration documentation
  • Receives detailed instructions from various stakeholders to evaluate potential data requirements
  • Assists with the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives
  • Takes direction from various stakeholders, contributing to the recommendation of improvements in automated and non-automated components of the data tables, data queries and data models
  • Fulltime
Read More
Arrow Right