CrawlJobs Logo

Data Engineer

India, Coimbatore · Job Posted January 15, 2026
Apply Position
Job Link Share

Job Description

We are seeking an experienced Senior Data Engineer with strong expertise in AWS Redshift and AWS Glue to design, develop, and maintain large-scale data solutions. The ideal candidate will have deep hands-on experience across the AWS data ecosystem and will play a critical role in building scalable, reliable, and high-performance data pipelines, with a strong ability to understand business requirements and translate them into effective data models and SQL solutions.

Job Responsibility

  • Design, develop, and maintain end-to-end ETL/ELT pipelines using AWS Glue, Redshift, and related AWS services
  • Develop and maintain robust data models by understanding business requirements and analytics needs
  • Write and optimize complex SQL queries to support reporting, analytics, and downstream data consumers
  • Optimize data warehouse schemas, data models, and queries for performance, scalability, and cost efficiency
  • Collaborate with data architects, analysts, and business stakeholders to translate business needs into technical data solutions
  • Implement data quality, governance, and security best practices across data pipelines
  • Automate workflows, monitoring, alerting, and performance tuning in AWS environments
  • Manage data ingestion from multiple structured and unstructured data sources
  • Troubleshoot and resolve production data issues, ensuring high availability and reliability

Requirements

  • Strong hands-on experience with AWS Redshift, including performance tuning, schema design, and data warehouse optimization
  • Expertise in AWS Glue (Glue Studio, Glue Catalog) and PySpark for ETL development
  • Solid expertise in data modeling, with the ability to understand business processes and translate them into efficient data models
  • Strong proficiency in SQL, with proven ability to write complex, high-performance queries
  • Solid understanding of data warehousing concepts, ETL design patterns, and data modeling techniques (Star / Snowflake schemas)
  • Experience with AWS services such as S3, Lambda, Athena, Step Functions, and CloudWatch
  • Proficiency in Python for data transformation and automation
  • Excellent problem-solving, analytical, and communication skills
  • 10+ Years of experience
  • Qualification: Any Degree

Nice to have

Experience with CI/CD pipelines, Git version control, and Infrastructure as Code (CloudFormation / Terraform) is a plus

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

Welcome to an exciting opportunity at Ericsson, where you'll step into the role ...
Location
Location
India , Kolkata
Salary
Salary:
Not provided
ericsson.com Logo
Ericsson
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong Python and Java expertise with experience building production-grade systems
  • Hands-on experience with Apache Spark (PySpark/Scala/Java) and distributed processing
  • Proven experience in high-volume, low-latency system design and optimization
  • Strong knowledge of Cassandra, OpenSearch/Elasticsearch, and NoSQL data modeling
  • Experience building scalable APIs and microservices (Spring Boot)
  • Hands-on experience with cloud platforms (AWS or GCP)
  • Strong working knowledge of Docker and Kubernetes
  • Experience with vulnerability management and non functional features ( alarm , logging , fault management etc.)
  • Good understanding of LLMs, embeddings, RAG, and GenAI data pipelines
  • Exposure to developer copilots / AI-assisted coding tools
Job Responsibility
Job Responsibility
  • Build and operate large-scale, high-throughput data systems handling massive datasets
  • Develop complex, scalable solutions using Python and Java
  • Design and optimize distributed data pipelines using Apache Spark
  • Engineer low-latency, high-performance data processing systems (batch + streaming)
  • Work with Cassandra and OpenSearch/Elasticsearch for high availability and scale
  • Develop scalable backend services and REST APIs (Spring Boot-based microservices)
  • Experience to work with AWS (Kiro) / Microsoft Copilot stack
  • Develop MCP-based applications and integrations with enterprise systems
  • Build RAG pipelines across network, service, customer, and operational data
  • Engineer data pipelines for embeddings, vector stores, and retrieval systems
  • Fulltime
Read More
Arrow Right

Data Engineer

Location
Location
Bulgaria; Georgia; Lithuania; Mexico; Moldova; Poland; Romania; Ukraine
Salary
Salary:
Not provided
coherentsolutions.com Logo
Coherent Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience as a Data Engineer
  • Solid proficiency in SQL
  • Experience working in Azure cloud environment
  • Experience with Azure SQL Pools
  • Strong understanding of performance tuning for data workloads
  • Experience working in Azure cloud environment
  • Excellent communication skills
  • English level: B2 (Upper-Intermediate) or higher
Job Responsibility
Job Responsibility
  • Develop and maintain data pipelines in the Azure environment
  • Work with Azure SQL Pools for data storage and processing
  • Write and optimize SQL queries
  • Perform performance tuning for queries and data workflows
  • Collaborate with a team of engineers on Databricks-based solutions
  • Build and orchestrate data workflows using Synapse Pipelines / Azure Data Factory
  • Ensure reliability and consistency of data pipelines
What we offer
What we offer
  • Technical and non-technical training for professional and personal growth
  • Internal conferences and meetups to learn from industry experts
  • Support and mentorship from an experienced employee to help you professional grow and development
  • Health insurance
  • English courses
  • Sports activities to promote a healthy lifestyle
  • Flexible work options, including remote and hybrid opportunities
  • Referral program for bringing in new talent
  • Work anniversary program and additional vacation days
  • Fulltime
Read More
Arrow Right

Data Engineer

The Associate Data Engineer is an entry level role within the Data Engineering j...
Location
Location
Malaysia , Selangor Darul Ehsan, Selangor
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Knowledge of the definition and management of scoping requirements, definition and prioritization activities
  • Understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models
  • Knowledge of Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP
  • Understanding of data architecture landscape between physical and logical data models
  • Analytical mindset with good business acumen skills
  • Problem-solving aptitude with the ability to communicate effectively, both written and verbal
  • Ability to build effective relationships at all levels within the organization
  • Programming languages (Perl, bash, Shell Scripting, Python, etc.)
  • Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field
  • Basic experience as a data engineering, data mining within a fast-paced environment
Job Responsibility
Job Responsibility
  • Supports the creation of data models in a structured data format to enable analysis thereof
  • Assists with the design and development of scalable extract, transform and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources
  • Participates in the transformation of object and data models into appropriate database schemas within design constraints. Interpret installation standards to meet project needs and produce database components as required
  • Takes direction from various stakeholders to create test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations
  • Assists with running data migrations across different databases and applications, for example, MS Dynamics, Oracle, SAP and other ERP systems
  • Supports the definition and implementation of data table structures and data models based on requirements
  • Takes part in analysis, and development of ETL and migration documentation
  • Receives detailed instructions from various stakeholders to evaluate potential data requirements
  • Assists with the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives
  • Takes direction from various stakeholders, contributing to the recommendation of improvements in automated and non-automated components of the data tables, data queries and data models
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a long-term contract opportunity base...
Location
Location
United States , Austin
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Senior-level experience in data engineering, data architecture, or a closely related discipline
  • Extensive hands-on background designing and building ETL and ELT solutions in modern cloud data environments
  • Demonstrated experience working with Snowflake and transformation tooling such as DBT
  • exposure to Matillion or similar platforms is highly valued
  • Ability to translate conceptual architecture into practical, maintainable implementation patterns with minimal supervision
  • Solid understanding of data integration tradeoffs across application-to-application flows, warehouse-centric design, and operational reporting needs
  • Proven ability to document technical standards, communicate design rationale, and support knowledge transfer to internal teams
  • Comfortable partnering with architects, BI leaders, integration specialists, and business stakeholders in a collaborative setting
Job Responsibility
Job Responsibility
  • Convert architectural guidance into scalable data pipeline designs and warehouse implementation patterns that support consistent delivery
  • Build and maintain workflows that ingest source data, prepare it for downstream use, and organize it across raw, staging, curated, and consumption layers
  • Assess integration approaches and recommend when data should move directly between applications versus through the warehouse for better governance and reuse
  • Create repeatable standards for orchestration, transformation, testing, monitoring, documentation, and support handoff
  • Develop and support cloud data warehouse solutions using Snowflake, Matillion, DBT, or comparable data engineering tools based on platform needs
  • Collaborate closely with integration and cross-functional team members to explain technical choices, guide implementation decisions, and strengthen team capability
  • Produce clear documentation covering data flows, lineage, dependencies, architecture decisions, and operational expectations
  • Deliver hands-on engineering leadership that enables durable solutions without creating long-term dependency on external support
What we offer
What we offer
  • medical insurance
  • vision insurance
  • dental insurance
  • life insurance
  • disability insurance
  • 401(k) plan
Read More
Arrow Right

Data Engineer

We are looking for an experienced Data Engineer to join a team delivering modern...
Location
Location
United States , Poughkeepsie
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building data engineering solutions with Databricks and Apache Spark
  • Strong programming ability in Python, including development of ETL and data transformation workflows
  • Knowledge of lakehouse and big data technologies such as Delta Lake, Apache Hadoop, and Apache Kafka
  • Experience working with Azure Data Lake Storage Gen2 or comparable cloud-based data storage platforms
  • Ability to optimize distributed data processing jobs and troubleshoot performance issues in Spark environments
  • Familiarity with data governance, data quality, and security practices for enterprise data platforms
  • Comfortable working independently and collaborating with cross-functional teams in an agile delivery model
  • Proven ability to analyze technical problems, break them into manageable components, and implement effective solutions.
Job Responsibility
Job Responsibility
  • Create and support scalable data pipelines in Databricks using Spark technologies such as PySpark or Scala to process and deliver high-quality data
  • Develop lakehouse architectures on Azure Data Lake Storage Gen2 and ensure strong integration with Databricks for efficient data management
  • Establish and monitor data quality controls and governance practices within the platform using validation methods and Delta Lake capabilities
  • Investigate pipeline and application inefficiencies, then implement tuning strategies to improve Spark and Databricks performance
  • Work closely with analysts and other stakeholders to translate business data needs into refined, analytics-ready datasets
  • Automate ingestion, transformation, testing, and release processes, including integration with CI/CD workflows where appropriate
  • Provide guidance to less experienced engineers by sharing best practices for Databricks development, optimization, and support
  • Maintain clear technical documentation for notebooks, workflows, data models, configurations, and operational procedures
  • Protect data assets by applying security controls and compliance standards across the Databricks environment
  • Contribute to design sessions, solve complex data issues, and uphold change management and data integrity standards while delivering large assignments on schedule
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • enrollment in company 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Engineer

Are you ready to architect the data foundation that drives our dynamic, consumpt...
Location
Location
United States , Exton
Salary
Salary:
Not provided
bentley.com Logo
Bentley Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A bachelor's degree in computer science, Engineering, Mathematics, or a related field, or equivalent practical experience as a Data Engineer
  • 3+ years of hands-on experience as a Data Engineer, proven, impactful track record in a Data Engineer or heavily related data architecture role
  • High proficiency in writing and optimizing SQL and Python
  • Deep, hands-on experience with modern cloud data platforms and tooling, specifically Snowflake, dbt, Fivetran, and SQL Server
  • Exceptional problem-solving capabilities, meticulous attention to detail, and the ability to thrive both autonomously and within a highly collaborative remote team
Job Responsibility
Job Responsibility
  • Pipeline Engineering: Design, build, and optimize scalable ELT/ETL pipelines to ingest, process, and transform massive volumes of structured and unstructured data
  • Data Integration: Architect and maintain seamless integrations across diverse internal and external data sources, including databases, APIs, and business application software
  • Governance & Security: Champion data integrity and accuracy
  • Implement rigorous security measures and ensure strict adherence to financial data regulations, including SOX compliance
  • Infrastructure Management: Proactively monitor system performance, troubleshoot bottlenecks, and continuously optimize the data infrastructure for maximum scalability, speed, and cost-efficiency
  • Cross-Functional Collaboration: Partner closely with data scientists, business analysts, and leadership to capture requirements and deliver high-quality, reliable, and curated datasets
  • Continuous Innovation: Maintain comprehensive documentation for data models and pipelines
  • Stay ahead of industry trends and introduce cutting-edge methodologies and tools to our stack
What we offer
What we offer
  • A great Team and culture
  • An exciting career as an integral part of a world-leading software company providing solutions for architecture, engineering, and construction
  • An attractive salary and benefits package
  • A commitment to inclusion, belonging, and colleague well-being through global initiatives and resource groups
  • A company committed to making a real difference by advancing the world's infrastructure for a better quality of life, where your contributions help build a more sustainable, connected, and resilient world
  • Fulltime
Read More
Arrow Right

Data Engineer

We’re seeking a Data Engineer to design and build scalable data pipelines in a m...
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with Azure Data Factory + Databricks
  • Strong skills in SQL and Python
  • Knowledge of data modeling (star/snowflake schemas)
  • Experience with data lakes, data warehouses, and cloud storage
  • Understanding of ETL/ELT best practices
Job Responsibility
Job Responsibility
  • Build and maintain ETL/ELT pipelines using Azure Data Factory
  • Develop data solutions in Azure Databricks (PySpark / Spark)
  • Optimize data processing performance and cost efficiency
  • Work with structured and unstructured data across cloud platforms
  • Collaborate with analytics and business stakeholders to define data requirements
  • Ensure data quality, governance, and documentation
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a financial services organization in ...
Location
Location
United States , Greer
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building and maintaining data pipelines using Snowflake
  • Practical knowledge of Apache Kafka for streaming or event-based data ingestion
  • Experience working in cloud-based data environments with a focus on scalable architecture
  • Familiarity with Azure Databricks and its role within broader data engineering ecosystems
  • Understanding of data quality, monitoring, and observability practices in production environments
  • Ability to troubleshoot pipeline failures and resolve performance or reliability issues efficiently
  • Experience following engineering best practices for version control, testing, and deployment
  • Exposure to AI-assisted development tools such as Claude or similar coding support platforms
Job Responsibility
Job Responsibility
  • Design, build, and deliver end-to-end data pipelines in Snowflake that support business reporting and data consumption needs
  • Create new ingestion and transformation workflows while troubleshooting pipeline issues to improve stability and performance
  • Contribute to a delivery model that balances new development with targeted optimization of existing data assets and workflows
  • Implement streaming and event-driven ingestion patterns using Kafka to support timely and scalable data movement
  • Improve observability across the data ecosystem by strengthening monitoring, alerting, and data quality controls
  • Help simplify legacy data processes by reducing technical debt and modernizing outdated pipeline components
  • Apply sound software engineering standards, including maintainable code, documentation, and repeatable development practices
  • Support the advancement of testing and CI/CD processes by helping establish more consistent engineering workflows
  • Leverage AI-assisted development tools to accelerate coding, validation, and technical documentation where appropriate
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right