CrawlJobs Logo

Senior AWS Data Engineer / Data Platform Engineer

United Arab Emirates, Dubai · Job Posted December 26, 2025
Apply Position
Job Link Share

Job Description

We are seeking a highly experienced Senior AWS Data Engineer to design, build, and optimize large-scale data platforms on AWS. The ideal candidate will have deep hands-on experience with AWS data services, batch and streaming data processing, and orchestration frameworks, playing a key role in architecting and maintaining enterprise-grade data solutions.

Job Responsibility

  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Ensure data security, quality, performance, and cost optimization
  • Collaborate with architects, analytics teams, and business stakeholders
  • Provide technical guidance and mentorship to junior team members

Requirements

  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
  • Strong experience with batch data processing architectures
  • Proficiency in SQL, Python, and Spark
  • Experience working with large-scale datasets and distributed systems
  • Strong understanding of data modeling, data warehousing, and ETL patterns
  • Experience with CI/CD pipelines and Infrastructure as Code is a plus

Nice to have

  • AWS Certification (Data Analytics / Solutions Architect)
  • Experience with data governance and metadata management
  • Exposure to data lake and lakehouse architectures

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior AWS Data Engineer / Data Platform Engineer

8 matching positions

Senior Data Engineer - Data Platform

We are looking for a Senior Data Engineer - Data Platform to join our Data & AI ...
Location
Location
France , Paris
Salary
Salary:
Not provided
doctolib.fr Logo
Doctolib
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • More than 7 years of experience as Site Reliability Engineer, Data Ops, Data Platform Engineer or in a similar role, with a proven track record of building and maintaining complex data infrastructures
  • Strong proficiency in data engineering and infrastructure tools and technologies, such as stream and events processing (Kafka, PubSub, Firehose) and Kubernetes
  • Expertise in programming languages like Python
  • Familiar with cloud infrastructure and services, preferably AWS, Azure, or GCP, and have experience with infrastructure-as-code tools such as Terraform
  • Excellent problem-solving skills with a focus on identifying and resolving data infrastructure bottlenecks and performance issues
Job Responsibility
Job Responsibility
  • Design and implement a scalable and reliable data infrastructure that supports the collection, processing, storage, and analysis of large-scale datasets while pushing security and privacy best practices
  • Build and maintain data pipelines that efficiently extract, transform, and load data from various sources into our data warehouse
  • Implement automation and orchestration tools to streamline infrastructure provisioning, data workflows, reduce manual effort, and improve operational efficiency
  • Monitor data platform for performance and reliability, identify and troubleshoot issues, and implement proactive solutions to ensure data quality and availability
  • Streamline and monitor platform costs, identify optimizations and saving opportunities while collaborating with data engineers, data scientists, and other stakeholders
What we offer
What we offer
  • Free comprehensive health insurance for you and your children
  • Parent Care Program: receive one additional month of leave on top of the legal parental leave
  • Free mental health and coaching services through our partner Moka.care
  • For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
  • Work from EU countries and the UK for up to 10 days per year, thanks to our flexibility days policy
  • Up to 14 days of RTT
  • A subsidy from the work council to refund part of the membership to a sport club or a creative class
  • Lunch voucher with Swile card
  • Fulltime
Read More
Arrow Right

Senior Staff Data Engineer- Data Platform

At Marktplaats, data is at the heart of everything we do, but Intelligence is wh...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on experience in Software Development or Data Engineering
  • at least 5+ years specifically focused on building Data Platforms
  • deep understanding of how Platform infra supports Analytics workloads
  • proven experience evolving complex platforms from legacy patterns to modern, cloud-native solutions
  • deep knowledge of Spark internals, JVM tuning, and performance optimization for high-scale batch and streaming datasets
  • deep expertise in Unity Catalog, Delta Lake internals, and optimizing high-volume workloads
  • strict software engineering discipline (CI/CD, Testing, OOP) applied to data pipelines
  • understanding of microservices architecture
  • understanding the needs of Analytics/DWH teams (Data Modeling, dbt)
  • strong background in building automated pipelines using Terraform/Terragrunt and ensuring system observability
Job Responsibility
Job Responsibility
  • Lead the evolution of our Data Platform and architect the "Data Exchange" strategy
  • define robust patterns for API-based ingestion, Event-Driven Architectures (Kafka), and Reverse ETL
  • ensure architectures are optimized for cost and performance on AWS
  • act as a catalyst for technical evolution
  • constantly scan the horizon for next-generation technologies
  • lead the implementation of new paradigms
  • design the strategy for Unity Catalog implementation and Data Contracts
  • champion FinOps, automating cost controls for our highest-volume workloads
  • build the underlying infrastructure that allows Analytics/DWH teams to run efficient transformations
  • elevate the technical bar of the team, mentoring Staff and Senior engineers
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • a collaborative environment with an opportunity to explore your potential and grow
  • a range of locally relevant benefits
  • Fulltime
Read More
Arrow Right

Senior Data Entitlements Engineer - Market Data Platform

Join us as a Senior Data Entitlements Engineer - Market Data Platform at Barclay...
Location
Location
Czechia , Prague
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert-level experience designing and implementing entitlement and license governance frameworks for data platforms, including defining policies, rules, and workflows that control access to sensitive market data at scale
  • Expertise and hands-on experience with entitlements engines and access-control models (RBAC, ABAC, ...), with a proven track record of building or configuring fine-grained permission structures in production environments
  • Demonstrated experience implementing and managing entitlements across multiple analytics and data platforms — specifically AWS (IAM, Lake Formation), Snowflake, Databricks, and/or KDB — understanding platform-specific security models and how to harmonise them under a unified governance layer
  • Strong AWS cloud experience, including identity federation, and security services relevant to data access and governance
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right

Senior Lead Data Engineer (Enterprise Platform Technology) (Java, Python, Scala, AWS)

Do you love building and pioneering in the technology space? Do you enjoy solvin...
Location
Location
United States , McLean; New York
Salary
Salary:
229900.00 - 286200.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 6 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

Join our Data Platform team at 10x Genomics to architect and implement our strat...
Location
Location
United States , Pleasanton
Salary
Salary:
168200.00 - 227600.00 USD / Year
10xgenomics.com Logo
10x Genomics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Management, or a related field, or equivalent experience
  • 5+ years of hands-on experience in software engineering focused on data platform development, distributed systems, or enterprise integrations
  • Proven experience designing and implementing highly scalable data platforms on major cloud environments (e.g., AWS, GCP, or Azure)
  • Deep proficiency in one or more general-purpose programming languages (e.g., Python, Java, or similar)
  • Strong foundation in computer science fundamentals, including data structures, algorithms, and system design
Job Responsibility
Job Responsibility
  • Architect and implement the canonical data layer and Event-Driven Architecture (EDA) using technologies like Apache Iceberg and Kafka to decouple applications and ensure real-time data flow
  • Design, build, and optimize high-volume, code-first data pipelines (real-time and batch) across a large application landscape (e.g., Salesforce, Oracle, Workday)
  • Establish Amazon S3 as the Single Source of Truth (SSOT) and govern data using principles like the Medallion Architecture (Silver and Gold layers) and schema evolution
  • Develop, test, and maintain robust and scalable ELT pipelines and data models in Snowflake, including leveraging advanced features like Snowpipes, Streams, and Stored Procedures
  • Develop the data presentation layer for self-service analytics, including the Natural Language Query (NLQ) interface integrated with Generative AI (e.g., Bedrock)
  • Lead technical efforts to migrate key business domains off legacy middleware and onto the new platform, eliminating the 'Integration Bottleneck'
  • Define and enforce data governance, quality, and security standards across the Unified Data Platform
  • Collaborate with the Architecture Review Board (ARB) to promote modern approaches such as serverless computing and Domain-Driven Design
  • Take ownership of the full development lifecycle, from prototyping and design through deployment, monitoring, and operational excellence
What we offer
What we offer
  • Equity grants
  • Comprehensive health and retirement benefit programs
  • Annual bonus program or sales incentive program
  • Health Package
  • Easy-to-use Benefits
  • Family oriented policies including parental leave
  • Generous Time Off
  • Award-Winning Workplace
  • Fulltime
Read More
Arrow Right

Senior AWS Data Engineer

This role is to support and enhance enterprise business intelligence and analyti...
Location
Location
United States , Torrance
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or equivalent practical experience
  • 7+ years of experience building enterprise data platforms or data engineering solutions
  • 5+ years of hands‑on experience with AWS cloud services
  • Strong hands‑on experience with AWS Glue and PySpark for ETL processing
  • Experience developing serverless applications using AWS Lambda
  • Deep expertise with Amazon Redshift, including performance tuning and advanced SQL
  • Experience with workflow orchestration tools such as Apache Airflow
  • Experience implementing secure vendor integrations using AWS Transfer Family
  • Experience designing and supporting data migration and replication pipelines using AWS DMS
  • Advanced SQL skills and experience analyzing complex datasets
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue with PySpark for large‑scale data processing
  • Develop and support serverless integrations using AWS Lambda for event‑driven workflows and system integrations
  • Design and optimize Amazon Redshift data warehouse solutions, including: Advanced SQL analytics, Stored procedures, Performance tuning
  • Lead implementation of secure vendor file transfer and ingestion solutions using AWS Transfer Family
  • Design and implement database migration and replication pipelines using AWS Database Migration Service (DMS)
  • Build and manage workflow orchestration using Apache Airflow or similar orchestration tools
  • Analyze data quality, transformation logic, and pipeline performance using SQL and data analysis techniques
  • Troubleshoot and resolve production data pipeline and integration issues across AWS services
  • Provide technical guidance to development team members on: AWS best practices, Cost optimization, Performance optimization
  • Partner with enterprise architecture, security, and compliance teams to ensure SOX and regulatory compliance
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Read More
Arrow Right

Senior Platform Engineer - Data Reliability

The Feedzai Platform Data Reliability play a pivotal role in managing core data ...
Location
Location
Portugal
Salary
Salary:
Not provided
feedzai.com Logo
Feedzai
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A bachelor's degree in Computer Science, Information Systems, or the equivalent combination of education, experience, and training
  • 4+ years of experience in data reliability, platform engineering, or operating data services at scale
  • Proficiency in programming languages such as Go, Java, or similar
  • Hands-on experience with Container Technologies and Orchestration (e.g., Docker, Kubernetes)
  • Valuable experience with data streaming and messaging platforms, like Kafka, Elasticsearch, RabbitMQ
  • Familiarity with CI/CD pipelines and tools such as Jenkins, Gitlab, or similar
  • Demonstrated commitment to staying updated with industry trends and emerging technologies, showcasing a proactive approach to continuous learning
  • Demonstrated knowledge of best practices in security, ensuring the implementation of secure coding standards
  • Experience working with Cloud Providers, with a preference for AWS Cloud
  • Expertise in utilizing monitoring and observability stacks like Grafana and Prometheus
Job Responsibility
Job Responsibility
  • Build and maintain Kubernetes Operators, including deployment, monitoring, operations, and analytics tools developed by the team
  • Engage in development tasks using Go, Java, or similar languages
  • Operate services such as Kafka, Elasticsearch, RabbitMQ, Redis, Relational databases and Couchbase at an enterprise scale
  • Contribute to the self-healing capabilities of applications in our enterprise environments
  • Develop playbooks associated with actionable alerts to streamline response procedures
  • Work with AI-assisted development tools (e.g. Cursor) as part of your daily workflow to ship faster and iterate effectively
  • Maintain and enhance our Infrastructure as Code (IaC) to efficiently manage end-to-end lifecycle operations (monitoring, alerting, security, cost optimization, configuration, backup, etc.) in production environments
  • Utilize your experience and problem solving skills to help prevent and investigate production issues
Read More
Arrow Right

Senior AWS Data Engineer

This role is to support and enhance enterprise business intelligence and analyti...
Location
Location
United States , Torrance
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or equivalent practical experience
  • 7+ years of experience building enterprise data platforms or data engineering solutions
  • 5+ years of hands‑on experience with AWS cloud services
  • Strong hands‑on experience with AWS Glue and PySpark for ETL processing
  • Experience developing serverless applications using AWS Lambda
  • Deep expertise with Amazon Redshift, including performance tuning and advanced SQL
  • Experience with workflow orchestration tools such as Apache Airflow
  • Experience implementing secure vendor integrations using AWS Transfer Family
  • Experience designing and supporting data migration and replication pipelines using AWS DMS
  • Advanced SQL skills and experience analyzing complex datasets
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue with PySpark for large‑scale data processing
  • Develop and support serverless integrations using AWS Lambda for event‑driven workflows and system integrations
  • Design and optimize Amazon Redshift data warehouse solutions, including: Advanced SQL analytics, Stored procedures, Performance tuning
  • Lead implementation of secure vendor file transfer and ingestion solutions using AWS Transfer Family
  • Design and implement database migration and replication pipelines using AWS Database Migration Service (DMS)
  • Build and manage workflow orchestration using Apache Airflow or similar orchestration tools
  • Analyze data quality, transformation logic, and pipeline performance using SQL and data analysis techniques
  • Troubleshoot and resolve production data pipeline and integration issues across AWS services
  • Provide technical guidance to development team members on: AWS best practices, Cost optimization, Performance optimization
  • Partner with enterprise architecture, security, and compliance teams to ensure SOX and regulatory compliance
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Read More
Arrow Right