CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Senior AWS Data Engineer

United States, Torrance · Job Posted April 22, 2026
Apply Position
Job Link Share

Job Description

This role is to support and enhance enterprise business intelligence and analytics environments. This role focuses on designing, building, and maintaining scalable data pipelines and cloud‑based data platforms using AWS services. The ideal candidate brings deep hands‑on experience with AWS Glue, PySpark, Redshift, and serverless architectures, along with strong SQL and data analysis skills. This role will collaborate closely with architecture, security, compliance, and development teams to ensure data solutions are performant, secure, and compliant with regulatory requirements.

Job Responsibility

  • Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue with PySpark for large‑scale data processing
  • Develop and support serverless integrations using AWS Lambda for event‑driven workflows and system integrations
  • Design and optimize Amazon Redshift data warehouse solutions, including: Advanced SQL analytics, Stored procedures, Performance tuning
  • Lead implementation of secure vendor file transfer and ingestion solutions using AWS Transfer Family
  • Design and implement database migration and replication pipelines using AWS Database Migration Service (DMS)
  • Build and manage workflow orchestration using Apache Airflow or similar orchestration tools
  • Analyze data quality, transformation logic, and pipeline performance using SQL and data analysis techniques
  • Troubleshoot and resolve production data pipeline and integration issues across AWS services
  • Provide technical guidance to development team members on: AWS best practices, Cost optimization, Performance optimization
  • Partner with enterprise architecture, security, and compliance teams to ensure SOX and regulatory compliance

Requirements

  • Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or equivalent practical experience
  • 7+ years of experience building enterprise data platforms or data engineering solutions
  • 5+ years of hands‑on experience with AWS cloud services
  • Strong hands‑on experience with AWS Glue and PySpark for ETL processing
  • Experience developing serverless applications using AWS Lambda
  • Deep expertise with Amazon Redshift, including performance tuning and advanced SQL
  • Experience with workflow orchestration tools such as Apache Airflow
  • Experience implementing secure vendor integrations using AWS Transfer Family
  • Experience designing and supporting data migration and replication pipelines using AWS DMS
  • Advanced SQL skills and experience analyzing complex datasets
  • Knowledge of AWS security, encryption, IAM policies, and compliance considerations
  • Strong troubleshooting, problem‑solving, and analytical skills

Nice to have

  • Experience working in financial services or other regulated environments
  • Experience supporting enterprise BI or analytics platforms
  • Strong communication skills and ability to work cross‑functionally with technical and non‑technical teams

What we offer

  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior AWS Data Engineer

8 matching positions

Senior AWS Data Engineer

We are seeking a highly skilled Senior Data Engineer with 5+ years of experience...
Location
Location
India , Pune
Salary
Salary:
Not provided
vidushiinfotech.com Logo
Vidushi Infotech SSP Pvt. Ltd.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in hands-on programming with Python and PySpark
  • Expertise in Boto3 and various Python frameworks and libraries, adhering strictly to Python best practices (PEP 8)
  • Strong experience in Spark SQL and PySpark optimization techniques (e.g., partitioning, caching, broadcast joins)
  • Deep architectural knowledge of AWS services, including: S3, EC2, Lambda, Redshift, CloudFormation
  • Advanced understanding of Git (branching strategies, PR reviews)
  • Experience with JFrog Artifactory for dependency management and artifact storage
  • Proficiency in CI/CD pipelines and automated testing frameworks
  • Analytical Mindset: Ability to debug complex, non-obvious issues in distributed systems
  • Clean Coder: Passion for writing 'clean code' and mentoring junior engineers on maintainability
  • Architectural Thinking: Ability to explain the 'why' behind choosing specific AWS components over others
Job Responsibility
Job Responsibility
  • Design, develop, and maintain complex ETL/ELT pipelines to build high-value data assets
  • Lead the code refactorization of legacy codebases, improving readability, maintainability, and performance
  • Perform deep code optimization using Spark SQL and PySpark to handle large-scale datasets efficiently
  • Implement a Test-Driven Development (TDD) approach, writing comprehensive unit tests to ensure functionality and catch bugs early in the lifecycle
  • Isolate and resolve difficult bugs, including those related to performance bottlenecks, concurrency issues, and complex logic flaws
  • Design and deploy solutions utilizing the full AWS stack, explaining the trade-offs and benefits of specific services for various use cases
  • Fulltime
Read More
Arrow Right

Senior AWS Data Engineer

This role is to support and enhance enterprise business intelligence and analyti...
Location
Location
United States , Torrance
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or equivalent practical experience
  • 7+ years of experience building enterprise data platforms or data engineering solutions
  • 5+ years of hands‑on experience with AWS cloud services
  • Strong hands‑on experience with AWS Glue and PySpark for ETL processing
  • Experience developing serverless applications using AWS Lambda
  • Deep expertise with Amazon Redshift, including performance tuning and advanced SQL
  • Experience with workflow orchestration tools such as Apache Airflow
  • Experience implementing secure vendor integrations using AWS Transfer Family
  • Experience designing and supporting data migration and replication pipelines using AWS DMS
  • Advanced SQL skills and experience analyzing complex datasets
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue with PySpark for large‑scale data processing
  • Develop and support serverless integrations using AWS Lambda for event‑driven workflows and system integrations
  • Design and optimize Amazon Redshift data warehouse solutions, including: Advanced SQL analytics, Stored procedures, Performance tuning
  • Lead implementation of secure vendor file transfer and ingestion solutions using AWS Transfer Family
  • Design and implement database migration and replication pipelines using AWS Database Migration Service (DMS)
  • Build and manage workflow orchestration using Apache Airflow or similar orchestration tools
  • Analyze data quality, transformation logic, and pipeline performance using SQL and data analysis techniques
  • Troubleshoot and resolve production data pipeline and integration issues across AWS services
  • Provide technical guidance to development team members on: AWS best practices, Cost optimization, Performance optimization
  • Partner with enterprise architecture, security, and compliance teams to ensure SOX and regulatory compliance
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Read More
Arrow Right

Senior AWS Data Engineer

We are looking for a skilled AWS Data Engineer to build and support cloud-based ...
Location
Location
India
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering or related roles
  • Hands-on experience with: AWS Glue
  • Amazon EMR
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Develop and maintain scalable batch data pipelines on AWS
  • Implement ETL/ELT jobs using AWS Glue and Spark on EMR
  • Build and manage workflow orchestration using Apache Airflow (MWAA)
  • Develop serverless data processing functions using AWS Lambda
  • Work with Amazon Redshift for data warehousing and analytics
  • Implement data storage and retrieval using Amazon DynamoDB
  • Use AWS DataZone for data discovery, governance, and access control
  • Monitor data pipelines and system health using Amazon CloudWatch
  • Troubleshoot data processing failures and performance issues
  • Collaborate with analytics, reporting, and business teams
  • Fulltime
Read More
Arrow Right

Senior AWS Data Engineer

We are looking for a skilled AWS Data Engineer to build and support cloud-based ...
Location
Location
India
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering or related roles
  • Hands-on experience with AWS Glue
  • Hands-on experience with Amazon EMR
  • Hands-on experience with AWS Lambda
  • Hands-on experience with Apache Airflow (MWAA)
  • Hands-on experience with Amazon EC2
  • Hands-on experience with Amazon CloudWatch
  • Hands-on experience with Amazon Redshift
  • Hands-on experience with Amazon DynamoDB
  • Hands-on experience with AWS DataZone
Job Responsibility
Job Responsibility
  • Develop and maintain scalable batch data pipelines on AWS
  • Implement ETL/ELT jobs using AWS Glue and Spark on EMR
  • Build and manage workflow orchestration using Apache Airflow (MWAA)
  • Develop serverless data processing functions using AWS Lambda
  • Work with Amazon Redshift for data warehousing and analytics
  • Implement data storage and retrieval using Amazon DynamoDB
  • Use AWS DataZone for data discovery, governance, and access control
  • Monitor data pipelines and system health using Amazon CloudWatch
  • Troubleshoot data processing failures and performance issues
  • Collaborate with analytics, reporting, and business teams
  • Fulltime
Read More
Arrow Right

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (AWS & Data)

We are seeking a Senior Software Engineer – AWS & Data to join a remote developm...
Location
Location
Poland
Salary
Salary:
130.00 - 150.00 PLN / Hour
cyclad.pl Logo
Cyclad Sp. z o.o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in AWS cloud-native development, preferably within data-related projects
  • Strong hands-on experience with AWS Glue and PySpark
  • Experience with ECS and/or Kubernetes (development and basic administration)
  • Solid frontend development experience with React
  • Strong experience in building REST APIs using FastAPI
  • Familiarity with DevOps tools and practices (e.g., GitHub Actions, Terraform)
  • Experience with Terraform in infrastructure automation
  • Knowledge of CI/CD pipeline design and optimization
  • Exposure to scalable data architecture patterns
  • Strong problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, develop, and maintain cloud-native applications using AWS services (including AWS Glue and ECS)
  • Build and optimize data processing solutions using AWS Glue and PySpark
  • Develop and maintain RESTful APIs using FastAPI
  • Design and implement user interfaces using React, ensuring seamless frontend-backend integration
  • Work with containerized environments (ECS/Kubernetes) for application deployment and management
  • Collaborate with product owners and cross-functional teams to deliver high-quality solutions
  • Participate in code reviews and contribute to best development practices
  • Troubleshoot and resolve issues related to performance, scalability, and security
  • Continuously improve development processes by staying up to date with new technologies
What we offer
What we offer
  • Remote working model
  • Private medical care with dental care (covering 70% of costs)
  • Multisport card (also for an accompanying person)
  • Life insurance
  • Honey Pot
  • Fulltime
Read More
Arrow Right

Senior Engineer - Data Engineer

Position - Data Engineer
Location
Location
India , Indore; Ahmedabad
Salary
Salary:
Not provided
arrow.com Logo
Arrow Electronics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 4 to 8 years in software/data engineering
  • Proficiency in SQL, NoSQL databases (e.g., DynamoDB, MongoDB), ETL tools, and data warehousing solutions
  • Proficiency in Python is a must
  • Cloud Platforms: Azure, AWS (e.g., EC2, S3, RDS) or GCP
  • Experience with data visualization tools (e.g., Tableau, Power BI, Looker)
  • Knowledge of data governance and security practices
  • Experience with DevOps practices, including CI/CD pipelines and containerization (Docker, Kubernetes)
  • Excellent verbal and written communication skills in English
  • Experience working in Agile development environments
  • Understanding of AI and ML concepts, frameworks (e.g., TensorFlow, PyTorch), and practical applications
Job Responsibility
Job Responsibility
  • Design and development of real time software and Cloud/Web/mobile based software application
  • Analyze domain specific technical, high level or low level requirement and modification as per end customer or system requirement
  • Perform software testing including unit, functional and system level requirement including manual and automated
  • Perform code review following coding guidelines and static code analysis & troubleshoots software problems of limited difficulty
  • Document technical deliverable like software specifications, design document, code commenting, test cases and test report, Release note etc. throughout the project life cycle
  • Develop software solutions from established programming languages or by learning new language required for specific project
  • Fulltime
Read More
Arrow Right

Senior Data Engineer - Data Platform

We are looking for a Senior Data Engineer - Data Platform to join our Data & AI ...
Location
Location
France , Paris
Salary
Salary:
Not provided
doctolib.fr Logo
Doctolib
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • More than 7 years of experience as Site Reliability Engineer, Data Ops, Data Platform Engineer or in a similar role, with a proven track record of building and maintaining complex data infrastructures
  • Strong proficiency in data engineering and infrastructure tools and technologies, such as stream and events processing (Kafka, PubSub, Firehose) and Kubernetes
  • Expertise in programming languages like Python
  • Familiar with cloud infrastructure and services, preferably AWS, Azure, or GCP, and have experience with infrastructure-as-code tools such as Terraform
  • Excellent problem-solving skills with a focus on identifying and resolving data infrastructure bottlenecks and performance issues
Job Responsibility
Job Responsibility
  • Design and implement a scalable and reliable data infrastructure that supports the collection, processing, storage, and analysis of large-scale datasets while pushing security and privacy best practices
  • Build and maintain data pipelines that efficiently extract, transform, and load data from various sources into our data warehouse
  • Implement automation and orchestration tools to streamline infrastructure provisioning, data workflows, reduce manual effort, and improve operational efficiency
  • Monitor data platform for performance and reliability, identify and troubleshoot issues, and implement proactive solutions to ensure data quality and availability
  • Streamline and monitor platform costs, identify optimizations and saving opportunities while collaborating with data engineers, data scientists, and other stakeholders
What we offer
What we offer
  • Free comprehensive health insurance for you and your children
  • Parent Care Program: receive one additional month of leave on top of the legal parental leave
  • Free mental health and coaching services through our partner Moka.care
  • For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
  • Work from EU countries and the UK for up to 10 days per year, thanks to our flexibility days policy
  • Up to 14 days of RTT
  • A subsidy from the work council to refund part of the membership to a sport club or a creative class
  • Lunch voucher with Swile card
  • Fulltime
Read More
Arrow Right