CrawlJobs Logo

AWS Data Engineer

· Job Posted March 05, 2026
Apply Position
Job Link Share

Job Responsibility

  • Architect and maintain scalable storage solutions using AWS S3 and Apache Iceberg to manage high-volume, transactional data in a data lake environment
  • Design and deploy robust data processing pipelines using AWS EMR or Glue with PySpark for large-scale data transformation
  • Follow rigorous software engineering practices, including Git-based version control, CI/CD, and peer code reviews
  • Implement and manage complex, automated data workflows using Apache Airflow (MWAA)
  • Build centralized data catalogs via AWS Glue Catalog and enable high-speed interactive querying using AWS Athena
  • Apply advanced Data Modeling (Star Schema, Snowflake) and manage the end-to-end data journey from Raw to Processed zones

Requirements

  • Bachelor’s or master’s degree in computer science, Information Technology, Data Engineering, or a related quantitative field
  • Minimum 3 years experience
  • Expert proficiency in PySpark for distributed data processing
  • Deep hands-on experience with core AWS services (S3, EMR, Glue, Athena)
  • Experience building and scheduling DAGs in Apache Airflow
  • Advanced knowledge of OLAP modeling techniques and Data Lake design patterns (Medallion architecture)
  • Strong skills in Python, SQL, and source control management (Git)

Nice to have

  • Proficiency in Terraform for automated resource provisioning
  • Experience building deployment pipelines using GitLab CI/CD
  • AWS Certified Data Engineer – Associate or AWS Certified Data Analytics – Specialty

What we offer

  • Flexible and Remote Working
  • Career Growth
  • Performance Recognition
  • Health and Fitness Benefits
  • Extra Paid Annual Leave
  • Special Birthday Perk

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

AWS Data Engineer

8 matching positions

New

AWS Data Engineer

Join us as an AWS Data Engineer Barclays, responsible for supporting the success...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Firsthand Experience in developing, testing and maintaining applications on AWS Cloud
  • Strong hands‑on experience with the AWS Data Analytics stack (Amazon S3, AWS Glue, Athena, Lambda, IAM, Lake Formation, KMS, STS, and Step Functions), with a proven ability to build, test, and support secure, scalable, and well‑governed data pipelines
  • Firsthand experience in Airflow and PySpark and strong knowledge of Python
  • Design and implement scalable and efficient data transformation/storage solutions using Snowflake
  • Experience in Data ingestion to Snowflake for different storage format such Parquet, Iceberg, JSON, CSV etc
  • Experience in using DBT (Data Build Tool) with snowflake for ELT pipeline development
  • Experience in Writing advanced SQL and PL SQL programs
  • Experience in AWS data pipeline development
  • HandsOn Experience for building reusable components using Snowflake and AWS Tools/Technology
  • Must have completed two major projects
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right

AWS Data Engineer

We are seeking a detail-oriented and capable Data Engineer – AWS to join our Dat...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in data engineering or software engineering with data focus
  • Strong interest in cloud-based data platforms and distributed processing
  • Good analytical and problem-solving skills
  • Attention to detail and commitment to data quality and reliability
  • Effective communication and teamwork skills
  • Willingness to learn and develop in AWS and modern data engineering practices
  • Hands-on experience with AWS cloud services, especially AWS Glue, Python / PySpark, SQL querying and data manipulation
  • Exposure to YAML or configuration-driven pipelines (desirable)
  • Experience building or supporting data pipelines, ETL/ELT processes
  • Familiarity with data lakes and/or Lakehouse concepts, Distributed processing frameworks (e.g., Spark)
Job Responsibility
Job Responsibility
  • Support delivery across data engineering and platform development initiatives
  • Collaborate with architects, engineers, and stakeholders to implement data solutions on AWS
  • Assist in planning and executing engineering tasks, releases, and deliverables
  • Build and maintain data pipelines and workflows on AWS platforms
  • Develop ETL/ELT pipelines using AWS Glue, Python / PySpark, SQL, Configuration-driven frameworks (e.g., YAML)
  • Support ingestion, transformation, and processing of structured and semi-structured data
  • Contribute to the development of scalable, reusable data components and services
  • Test and validate data pipelines and processing jobs running on AWS services
  • Develop and execute data validation and reconciliation queries using SQL
  • Work with AWS services including AWS Glue, S3-based data lakes, Related data processing and orchestration services
Read More
Arrow Right

AWS Data Engineer

Join us as an AWS Data Engineer Barclays, responsible for supporting the success...
Location
Location
India , Pune; Chennai
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Firsthand Experience in developing, testing and maintaining applications on AWS Cloud
  • Strong hands‑on experience with the AWS Data Analytics stack (Amazon S3, AWS Glue, Athena, Lambda, IAM, Lake Formation, KMS, STS, and Step Functions), with a proven ability to build, test, and support secure, scalable, and well‑governed data pipelines
  • Firsthand experience in Airflow and PySpark and strong knowledge of Python
  • Design and implement scalable and efficient data transformation/storage solutions using Snowflake
  • Experience in Data ingestion to Snowflake for different storage format such Parquet, Iceberg, JSON, CSV etc
  • Experience in using DBT (Data Build Tool) with snowflake for ELT pipeline development
  • Experience in Writing advanced SQL and PL SQL programs
  • Experience in AWS data pipeline development
  • HandsOn Experience for building reusable components using Snowflake and AWS Tools/Technology
  • Must have completed two major projects
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
  • Engage stakeholders, gather requirements/user stories, and translate them into ETL components
  • Understand infrastructure setup and provide solutions independently or in collaboration with teams
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right

AWS Data Engineer

We are seeking a skilled AWS Data Engineer to join our team and help drive data ...
Location
Location
United States , Charlotte
Salary
Salary:
60.00 USD / Hour
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, or related field
  • 3+ years of experience in data engineering, with a focus on AWS cloud services
  • Proficiency in SQL, Python, and AWS data services such as S3, Glue, EMR, and Redshift
  • Experience with ETL processes, data modeling, and data visualization tools
  • Strong analytical and problem-solving skills
  • Excellent communication and teamwork abilities
Job Responsibility
Job Responsibility
  • Design and implement scalable and efficient data pipelines using AWS services such as S3, Glue, EMR, and Redshift
  • Develop and maintain data lakes and data warehouses to store and process large volumes of structured and unstructured data
  • Collaborate with data scientists and business analysts to deliver actionable insights and analytics solutions
  • Optimize data infrastructure for performance, reliability, and cost efficiency
  • Troubleshoot and resolve data integration and data quality issues
  • Stay current with industry trends and best practices in cloud data engineering
  • Provide technical guidance and mentorship to junior team members
Read More
Arrow Right

AWS Data Engineer

AlgebraIT is hiring an AWS Data Engineer in Austin, Texas! If you have at least ...
Location
Location
United States , Austin
Salary
Salary:
Not provided
algebrait.com Logo
AlgebraIT
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in data engineering with AWS
  • Proficiency in Python, SQL, and big data tools
  • Experience with AWS services such as Lambda and EC2
  • Strong communication and teamwork skills
  • Bachelor’s in Computer Science or similar
Job Responsibility
Job Responsibility
  • Develop and maintain data pipelines using AWS services
  • Automate data ingestion and processing workflows
  • Collaborate with cross-functional teams to ensure robust data solutions
  • Monitor and optimize data pipeline performance
  • Ensure data quality and implement security best practices
  • Integrate data from multiple sources for analytics
  • Implement data validation and error-handling processes
  • Write and maintain technical documentation for data workflows
  • Manage and configure cloud infrastructure related to data pipelines
  • Provide technical support and troubleshooting for data-related issues
  • Fulltime
Read More
Arrow Right

AWS Data Engineer

We are looking for a skilled AWS Data Engineer to build and support cloud-based ...
Location
Location
India
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–8 years of experience in data engineering or related roles
  • Hands-on experience with AWS Glue
  • Hands-on experience with Amazon EMR
  • Hands-on experience with AWS Lambda
  • Hands-on experience with Apache Airflow (MWAA)
  • Hands-on experience with Amazon EC2
  • Hands-on experience with Amazon CloudWatch
  • Hands-on experience with Amazon Redshift
  • Hands-on experience with Amazon DynamoDB
  • Hands-on experience with AWS DataZone
Job Responsibility
Job Responsibility
  • Develop and maintain scalable batch data pipelines on AWS
  • Implement ETL/ELT jobs using AWS Glue and Spark on EMR
  • Build and manage workflow orchestration using Apache Airflow (MWAA)
  • Develop serverless data processing functions using AWS Lambda
  • Work with Amazon Redshift for data warehousing and analytics
  • Implement data storage and retrieval using Amazon DynamoDB
  • Use AWS DataZone for data discovery, governance, and access control
  • Monitor data pipelines and system health using Amazon CloudWatch
  • Troubleshoot data processing failures and performance issues
  • Collaborate with analytics, reporting, and business teams
  • Fulltime
Read More
Arrow Right

AWS Data Engineer

We are looking for a highly skilled and experienced AWS Data Engineer to design,...
Location
Location
India
Salary
Salary:
Not provided
vidushiinfotech.com Logo
Vidushi Infotech SSP Pvt. Ltd.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of hands-on experience in Data Engineering, with a proven track record of creating high-impact data pipelines and assets
  • 4+ years of strong, hands-on programming experience with PySpark, Python, and Boto3, including expertise in Python frameworks and libraries, adhering to best practices
  • Deep knowledge of Code Versioning practices, including Git Repositories and experience with artifact management tools like JFrog Artifactory
  • Solid practical knowledge of AWS Architecture and its core data services
  • A true commitment to clean code, testability, and engineering best practices
Job Responsibility
Job Responsibility
  • Architecting Data Pipelines: Design, build, and maintain highly scalable and efficient data pipelines using cutting-edge AWS services
  • Driving Code Excellence: Perform significant Code Refactoring on a legacy codebase—cleaning, modernizing, and improving readability and long-term maintainability
  • Mastering Optimization: Apply your deep understanding of Spark SQL and PySpark to continuously optimize code for performance and cost efficiency
  • Embracing Quality: Champion Test-Driven Development (TDD) and meticulous Unit Testing to ensure functionality, catch bugs early, and maintain a high bar for code quality
  • Solving the Toughest Challenges: Dive into complex systems to debug and resolve difficult bugs related to performance, concurrency, or intricate logic flaws
  • Collaborating on Cloud Architecture: Leverage and explain the benefits of key AWS services like S3, EC2, Lambda, Redshift, and CloudFormation to build robust solutions
  • Fulltime
Read More
Arrow Right

AWS Data Engineer

About the Role: Key Responsibilities: Architect and implement scalable, secure, ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
cigres.com Logo
Cigres
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, or related field
  • 5–8 years of experience in data engineering, including at least 3 years of hands-on expertise with AWS Big Data platforms
  • Proficiency in Python, SQL, Spark, and various AWS data services
  • Strong understanding of data architecture, data modeling, and data warehousing concepts
  • Experience in DevOps practices and tools, including CI/CD, monitoring, and infrastructure-as-code (IaC)
  • Hands-on experience with key AWS services: Glue, S3, Redshift, Lambda, CloudWatch, IAM
  • Experience with CI/CD tools and IaC technologies such as Terraform or CloudFormation
  • Proficiency with Git for version control and collaborative development
Job Responsibility
Job Responsibility
  • Architect and implement scalable, secure, and cost-effective data platforms on AWS
  • Lead the development of complex ETL/ELT pipelines and data workflows
  • Define, standardize, and enforce data engineering best practices and coding standards
  • Collaborate closely with data scientists, analysts, and business stakeholders to deliver data-driven solutions
  • Conduct code reviews to ensure high-quality, maintainable deliverables
  • Optimize data workflows for performance, scalability, and cost-efficiency
  • Ensure strong data quality, governance, and security across all data environments
  • Work with cross-functional teams to gather, analyze, and refine data requirements
  • Monitor, maintain, and troubleshoot data pipelines and associated infrastructure
  • Fulltime
Read More
Arrow Right