CrawlJobs Logo

AWS Lakehouse Platform Engineer

United Arab Emirates, Abu Dhabi or Dubai · Job Posted January 10, 2026
Apply Position
Job Link Share

Job Description

Riverflex is partnering with a leading financial institution in the UAE on a strategic Proof of Concept to establish (the foundations of) an AWS data platform. We are seeking a Platform Engineer to own the PoC end-to-end, define the reference architecture, and establish the standards and guardrails that will shape how the data platform is built going forward. This is not a data engineering role. This position is about platform ownership, architecture, governance, and long-term operability. You will serve as the internal authority on “how we do data platforms,” working closely with the partner’s Data Lead and embedded with the on-site platform engineering team to ensure the foundation is robust, scalable, and fit for enterprise-grade analytics and future AI use cases.

Job Responsibility

  • Platform ownership & architecture: Own the end-to-end design and delivery of an AWS-based lakehouse Proof of Concept
  • Act as lead architect and custodian of the data platform, defining reference architectures, reusable patterns, and engineering standards
  • Design and implement a governed lakehouse architecture using Amazon S3, AWS Glue, Athena, Lake Formation, with Apache Iceberg as a core table format
  • Governance, security & control: Establish security-first platform designs, including IAM patterns and role-based access, Data access controls, governance guardrails, auditability, etc
  • Ensure consistent cataloging, lineage, and metadata practices across the lakehouse
  • Engineering & operability: Build and manage platform infrastructure using Infrastructure as Code (AWS CDK or Terraform)
  • Ensure the platform is production-minded, with explicit focus on: long-term operability, scalability, cost efficiency and maintainability
  • Define and implement operational standards, including monitoring, alerting, and basic runbooks where applicable
  • Collaboration & enablement: Partner closely with the Data Lead to align platform architecture with data engineering and analytics needs
  • Work embedded with the on-site platform engineering team, acting as a hands-on technical leader and mentor
  • Document architectural decisions, standards, and operating models to enable reuse and scaling beyond the PoC

Requirements

  • 6+ years of experience in platform engineering, cloud engineering, or data platform engineering roles
  • Proven experience owning and shaping platform architectures rather than only implementing pipelines
  • Deep hands-on experience with: Amazon S3 (storage patterns, lifecycle policies)
  • Glue (jobs, catalog, orchestration)
  • Athena
  • Lake Formation
  • Apache Iceberg
  • AWS CDK or Terraform
  • Strong understanding of AWS Well-Architected Framework and platform best practices
  • Ability to design for reliability, cost control, and operational simplicity
  • Architectural mindset and being comfortable operating with reference architectures, engineering standards, guardrails and governance models
  • Able to balance short-term PoC delivery with long-term platform sustainability
  • Experience in financial services or other regulated environments is a strong advantage
  • Ability to be based in the UAE for a minimum of 3 months, working full-time on-site (Abu Dhabi or Dubai)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

AWS Lakehouse Platform Engineer

8 matching positions

Data Platform Engineer

We’re looking for a Data Platform Engineer to join us on a 12-month fixed-term c...
Location
Location
United Kingdom , Nottingham
Salary
Salary:
45000.00 GBP / Year
microlise.com Logo
Microlise
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • 2–5 years’ experience in cloud engineering, DevOps or platform engineering
  • Strong hands-on experience with AWS
  • Experience with Terraform and/or AWS CDK
  • Exposure to CI/CD pipelines and deployment processes
  • Understanding of cloud security basics (IAM, secrets management, secure deployments)
  • Experience supporting production systems, monitoring and troubleshooting
  • Strong problem-solving mindset with an eye for detail
Job Responsibility
Job Responsibility
  • Build and maintain platform components using Infrastructure as Code (Terraform / AWS CDK)
  • Support CI/CD pipelines for data platforms and services
  • Help deliver lakehouse, ingestion and data serving capabilities
  • Apply security, compliance and governance controls across deployments
  • Monitor platform health, logging and alerting — and resolve issues quickly
  • Support cost optimisation (FinOps) and efficient resource usage
  • Collaborate with Platform, Data Engineering and AI teams to improve ways of working
What we offer
What we offer
  • 37.5 hour week with flexible working opportunities
  • Access to our salary sacrifice EV Car Scheme
  • Private medical insurance with Vitality Health including rewards
  • 25 days holiday, excluding bank holidays, increasing with service
  • Invested in employee health and well-being with over 20 mental health first aiders
  • Employee Assistance Programmes
  • Free Costco membership
  • 20% off EE mobile and line rental
  • Other local discounts
  • Great staff extras: Easter eggs, yearly BBQ, Christmas gifts and annual staff awards
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer (Fixed Term Contract)

Location
Location
United Kingdom , Nottingham
Salary
Salary:
55000.00 GBP / Year
microlise.com Logo
Microlise
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Strong experience in platform engineering, cloud engineering or DevOps within data-driven environments
  • Hands-on expertise in AWS, infrastructure as code and CI/CD pipelines
  • Experience building secure, scalable cloud environments
  • A solid understanding of data platforms, pipelines or analytics ecosystems
  • A mindset focused on reliability, observability and continuous improvement
  • AWS (compute, storage, IAM, networking)
  • Terraform and/or AWS CDK
  • CI/CD tooling and pipeline engineering
  • Observability, monitoring and operational tooling
  • SQL and strong systems thinking
Job Responsibility
Job Responsibility
  • Designing, building and operating our AWS-based data platform using infrastructure as code
  • Creating and managing CI/CD pipelines to enable safe, controlled deployments
  • Supporting modern Lakehouse architecture, ingestion, processing and data serving layers
  • Embedding security, governance and compliance controls across the platform
  • Driving platform observability, monitoring, and performance optimisation
  • Owning aspects of cost management (FinOps) and platform efficiency
  • Collaborating with Data Engineers, Analytics & AI teams to deliver trusted data products
What we offer
What we offer
  • Professional development goals support
  • 37.5 hour week with flexible working opportunities
  • Salary sacrifice EV Car Scheme
  • Private medical insurance with Vitality Health including rewards for members such as Free Amazon Prime, Apple Watch, discounted gym membership and many more
  • 25 days holiday, excluding bank holidays, increasing with service
  • Over 20 mental health first aiders in the business
  • Employee Assistance Programmes
  • Free Costco membership
  • 20% off EE mobile and line rental
  • Other local discounts
  • Fulltime
Read More
Arrow Right

Platform Engineer - Data Systems & Orchestration

We're seeking a Senior Data Platform Engineer to design, build, and evolve our e...
Location
Location
Salary
Salary:
Not provided
invent.ai Logo
invent.ai
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree or higher in a related field
  • 4-6+ years working with distributed production systems at scale
  • Hands-on experience designing data platforms, including managing workflow orchestration (e.g., Apache Airflow, Dagster etc.) and utilizing Python/PySpark for data processing
  • Understanding of modern data lakehouse architectures (Delta Lake, Snowflake, Iceberg etc.), metadata management concepts, and experience integrating data catalogs (OpenMetadata, DataHub, etc.)
  • Experience in observing & tracing data quality, data lineage etc.
  • Hands-on experience manipulating data across varied storage systems, including traditional relational databases and NoSQL document/key-value stores
  • Strong grasp of Python software design, including Object-Oriented Programming (OOP) patterns and effective use of data structures for building robust, maintainable automation and tooling
  • Proficiency in designing and building internal REST APIs using modern Python frameworks (FastAPI, Flask, AWS Serverless etc.)
  • Hands-on experience building and maintaining scalable solutions within cloud environments
  • Proficiency in navigating modern cloud ecosystems and platforms (such as Azure, AWS, GCP, Databricks etc.) with the ability to adapt to multi-cloud architectures
Job Responsibility
Job Responsibility
  • Develop “best-in-class” architecture, design and production artifacts by ensuring that the services and the components are: well-defined and modularized, secure, scalable, reliable, reusable, diagnosable, and actively monitored
  • Contribute to all phases of new developments including architecting, prototyping, productizing, testing and support
  • Adhere to and drive modern software engineering practices through code and design reviews, exercise DevOps principles to deploy, maintain and monitor production workflows and services to provide continuous delivery with high quality and actionable telemetry data
  • Stay educated on existing and state of the art technologies, and do proof of concept studies to evaluate technology fits relevant to our product requirements
  • Understanding business objectives and developing models that help to achieve them, along with metrics to track their progress
  • Mentor junior developers with coaching and participating code/design reviews
What we offer
What we offer
  • We work flexibly and remotely
  • We provide monthly fixed contribution to internet bill and fun packets (Netflix, Amazon Prime etc.)
  • We care about your health and support it with comprehensive private health insurance
  • We support your career growth with Udemy, Medium, HBR and other learning tools
  • At Invent.ai, you have extra off days for different occasions (birthday, moving day, maternity & paternity leaves etc.)
  • Great people make the perfect match: We have a powerful referral bonus for the friend you refer
  • All-day snacks at the office, team activities, social club meetings, annual retreats, monthly happy Friday drinks and other celebrations
  • We have a Game Master at Invent
  • At Invent.ai we celebrate and reward our successful teammates who have won awards in arts and sports
  • Invent.ai gives you the opportunity to make a real difference in people's lives
  • Fulltime
Read More
Arrow Right

Databricks Platform Engineer

Bright Vision Technologies is looking for a skilled Databricks Platform Engineer...
Location
Location
United States , Bridgewater
Salary
Salary:
Not provided
bvteck.com Logo
Bright Vision Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Databricks Lakehouse Platform
  • Apache Spark
  • Delta Lake
  • Databricks Workflows
  • Databricks SQL
  • Cloud Platforms (AWS / Azure / GCP)
  • Data Engineering Pipelines
  • ETL/ELT
  • Python
  • Scala
What we offer
What we offer
  • H-1B sponsorship for the 2026 quota
  • Equal employment opportunity
  • Inclusive work environment
  • Fulltime
Read More
Arrow Right

Staff Data Platform Engineer

We are looking for a Principal Engineer to lead the architecture and development...
Location
Location
United States , San Francisco; New York City
Salary
Salary:
196000.00 - 294000.00 USD / Year
vercel.com Logo
Vercel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years in data engineering or data architecture, including senior/principal-level work
  • Deep experience designing and operating large-scale distributed data systems
  • Strong expertise with Kafka and analytics/lakehouse technologies (ClickHouse, Tinybird, Snowflake, Iceberg)
  • Strong cloud experience (AWS, GCP, or Azure)
  • Experience with data governance, reliability, and secure data operations
  • Excellent communication skills and ability to influence across engineering and product teams
  • Demonstrated leadership through mentorship, design ownership, or technical direction
Job Responsibility
Job Responsibility
  • Architect and build a scalable data platform for batch and real-time workloads
  • Design streaming and event-driven systems using Kafka and related tooling
  • Implement modern lakehouse foundations, including Iceberg-based storage and governance
  • Partner with engineering, product, and leadership to define data strategy and technical direction
  • Establish best practices for ingestion, modeling, storage, quality, and security
  • Write production-grade code and set engineering standards across the team
  • Improve reliability through strong observability, monitoring, and fault tolerance
  • Drive long-term architectural decisions and evaluate build-vs-buy tradeoffs
  • Support analytics and ML teams by delivering high-quality data systems and tooling
What we offer
What we offer
  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills
  • Flexible Time Off
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed
  • Fulltime
Read More
Arrow Right

Lead AWS Data Engineer

We are seeking an accomplished and detail-oriented Lead Data Engineer – AWS to j...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in data engineering and cloud-based platform delivery
  • Strong understanding of distributed data processing and scalable system design
  • Ability to lead delivery while remaining hands-on technically
  • Strong analytical, problem-solving, and communication skills
  • Experience working in client-facing and delivery-focused environments
  • Ability to mentor and develop engineering teams
  • Strong hands-on experience with: AWS cloud services, especially AWS Glue
  • Python / PySpark for large-scale data processing
  • SQL for querying, transformation, and validation
  • Configuration-driven development (e.g., YAML)
Job Responsibility
Job Responsibility
  • Act as a senior engineer within data engineering and cloud platform initiatives, supporting delivery across complex transformation programmes
  • Collaborate with architects and stakeholders to define and implement scalable AWS-based data solutions
  • Contribute to solution design, estimation, and delivery planning
  • Lead engineering workstreams and ensure high-quality technical delivery
  • Design, build, and optimise scalable data pipelines and data processing frameworks on AWS
  • Develop and maintain ETL/ELT pipelines using: AWS Glue
  • Python / PySpark
  • SQL
  • Configuration-driven frameworks (e.g., YAML)
  • Implement robust data ingestion, transformation, and processing patterns
What we offer
What we offer
  • Range of tailored benefits that support your physical, emotional, and financial wellbeing
  • Continuous growth and development opportunities
  • Opportunity to have flexible work options
  • Fulltime
Read More
Arrow Right

AWS Data Engineer

We are seeking a detail-oriented and capable Data Engineer – AWS to join our Dat...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in data engineering or software engineering with data focus
  • Strong interest in cloud-based data platforms and distributed processing
  • Good analytical and problem-solving skills
  • Attention to detail and commitment to data quality and reliability
  • Effective communication and teamwork skills
  • Willingness to learn and develop in AWS and modern data engineering practices
  • Hands-on experience with AWS cloud services, especially AWS Glue, Python / PySpark, SQL querying and data manipulation
  • Exposure to YAML or configuration-driven pipelines (desirable)
  • Experience building or supporting data pipelines, ETL/ELT processes
  • Familiarity with data lakes and/or Lakehouse concepts, Distributed processing frameworks (e.g., Spark)
Job Responsibility
Job Responsibility
  • Support delivery across data engineering and platform development initiatives
  • Collaborate with architects, engineers, and stakeholders to implement data solutions on AWS
  • Assist in planning and executing engineering tasks, releases, and deliverables
  • Build and maintain data pipelines and workflows on AWS platforms
  • Develop ETL/ELT pipelines using AWS Glue, Python / PySpark, SQL, Configuration-driven frameworks (e.g., YAML)
  • Support ingestion, transformation, and processing of structured and semi-structured data
  • Contribute to the development of scalable, reusable data components and services
  • Test and validate data pipelines and processing jobs running on AWS services
  • Develop and execute data validation and reconciliation queries using SQL
  • Work with AWS services including AWS Glue, S3-based data lakes, Related data processing and orchestration services
Read More
Arrow Right

Senior Software Engineer, Data Platform

We’re looking for a seasoned software engineer to join Parafin’s Infrastructure ...
Location
Location
United States , San Francisco
Salary
Salary:
230000.00 - 265000.00 USD / Year
parafin.com Logo
Parafin
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in software engineering with a strong background in data infrastructure, pipelines, and distributed systems
  • Advanced proficiency in Python and SQL
  • Hands-on Spark development experience
  • Expertise with modern cloud data stacks—AWS (S3, RDS), Databricks, and Airflow—and lakehouse architectures
  • Hands‑on experience with foundational data‑infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms), Delta Lake/Iceberg, and distributed query engines like Trino/Presto
  • Familiarity with ingestion frameworks, developer‑experience tooling, and best practices for data versioning, lineage, partitioning, and clustering
  • Strong problem-solving skills and a proactive attitude toward ownership and platform health
  • Excellent communication and collaboration skills, especially in cross-functional settings
Job Responsibility
Job Responsibility
  • Design and build robust, highly scalable data pipelines and lakehouse infrastructure with PySpark, Databricks, and Airflow on AWS
  • Improve the data platform development experience for Engineering, Data Science, and Product by creating intuitive abstractions, self‑service tooling, and clear documentation
  • Own and maintain core data pipelines and models that power internal dashboards, ML models, and customer-facing products
  • Own the Data & ML platform infrastructure using Terraform, including end‑to‑end administration of Databricks workspaces: manage user access, monitor performance, optimize configurations (e.g., clusters, lakehouse settings), and ensure high availability of data pipelines
  • Lead projects to improve data quality, testing, observability, and cost efficiency across existing pipelines and backend systems (e.g., migrating Databricks SQL pipelines to dbt, scaling data ingestion, improving data-lineage tracking, and enhancing monitoring)
  • Act as the primary engineering partner for the Data Science team—embedded closely to gather requirements, design scalable solutions, and provide end-to-end support on all engineering aspects of their work
  • Work closely with backend engineers and data scientists to design performant data models and support new product development initiatives
  • Share best practices and mentor other engineers working on data-centric systems
What we offer
What we offer
  • Equity grant
  • Medical, dental & vision insurance
  • Work from home flexibility
  • Unlimited PTO
  • Commuter benefits
  • Free lunches
  • Paid parental leave
  • 401(k)
  • Employee assistance program
  • Fulltime
Read More
Arrow Right