CrawlJobs Logo

Data Platform Engineer - OLAP

Netherlands, Amsterdam · Job Posted March 05, 2026
Apply Position
Job Link Share

Job Description

Sitting at the intersection of Data Engineering, Backend Engineering, and Systems Engineering, Data Platform Engineers at Adyen build the foundational layer of tooling and processes for our on-premise Analytical Data Platforms. These tools support 10s of products, 100s of developers, and 1000s of daily jobs that add to Adyen’s strong portfolio of capabilities. We’re looking for an expert with deep knowledge in distributed systems, to focus on our internal Online Analytical Processing (OLAP) ecosystem. You’ll collaborate with Data and ML Engineers to continuously improve this ecosystem. You’ll also collaborate with other platform engineers to position this ecosystem properly within the larger Data/AI/ML Platform capabilities, powered by Hadoop, Kubernetes, Spark, Trino, Flink, and Ray.

Job Responsibility

  • Performance at Scale: Develop and maintain high-performance OLAP systems, supporting multi-tenant query workloads and ingestion pipelines with real Big Data scale
  • Reliability: Work with system reliability in mind, ensuring high availability for business-critical analytical products through observability and engineering excellence
  • Productize the Platform: Build self-service tooling that enables Data Engineers and Analysts to independently manage their data assets and diagnose issues
  • Data Quality: Engineer automated frameworks to validate data integrity and leverage metadata-driven tools to enhance data discoverability, lineage, and cataloging across the ecosystem
  • Ecosystem Integration: Architect seamless integrations of the OLAP ecosystem with adjacent distributed systems (e.g. storage, messaging, and batch / stream processing systems)
  • Efficiency & Governance: Monitor and optimize cluster resource-efficiency while making sure the platform adheres to global security and data privacy standards

Requirements

  • Fluency in Python and/or Java
  • Team player with strong communication skills
  • Ability to work closely with diverse stakeholders you enable (analysts, data scientists, data engineers, etc.) and depend upon (infrastructure, security, etc)
  • Experience in OLAP technologies, like Druid, Clickhouse, Pinot, Doris, Starrocks, etc
  • Experience in CI/CD pipelines, for code and infrastructure automation
  • Experience in Kubernetes
  • Experience in infrastructure and large-scale private cloud systems
  • Additional experience developing and maintaining: Other distributed data and compute systems like Spark, Trino, etc
  • Data modelling for databases
  • Real-time and batch data pipelines (via Kafka, Spark streaming) with an eye for frameworks, and emphasis on user friendliness and quality

Nice to have

Golang or Rust are also appreciated

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Platform Engineer - OLAP

8 matching positions

Manager, Data Engineer

We’re looking for a Manager, Data Engineering to lead the team responsible for t...
Location
Location
United States
Salary
Salary:
180000.00 - 200000.00 USD / Year
digitalmediasolutions.com Logo
Digital Media Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of data or database engineering experience, with 2+ years in an engineering management role
  • Deep hands-on experience with MySQL and/or PostgreSQL in high-availability production environments
  • Proven track record leading and developing teams of engineers in fast-paced, data-intensive environments
  • Strong expertise in binlog/logical replication and integrating OLTP systems with Kafka
  • Experience designing and supporting ELT/ETL pipelines safely at scale
  • Deep understanding of ACID principles, transaction isolation, and database internals
  • Experience with AWS-managed database services (RDS, Aurora, DynamoDB) and infrastructure cost management
  • Experience evaluating or migrating data warehouse platforms (Redshift, Snowflake, Databricks, or similar)
  • Experience designing or redesigning dimensional or analytical data models for large-scale warehouse environments
  • OLTP vs OLAP workload separation and architectural decision-making experience
Job Responsibility
Job Responsibility
  • Lead, mentor, and grow a team of data engineers and architects
  • Define and execute the technical roadmap for production database systems (MySQL, PostgreSQL, DynamoDB, Elastic)
  • Own the architecture and governance of binlog replication, logical replication, and CDC workflows
  • Drive strategy and reliability for ELT/ETL pipelines and Kafka-based streaming architectures
  • Set standards for performance optimization, query tuning, indexing, and database scaling across teams
  • Oversee backup, failover, disaster recovery (PITR), and incident response for all production data systems
  • Drive cost efficiency, infrastructure optimization, and monitoring across cloud-managed data services (AWS RDS, Aurora, DynamoDB)
  • Champion data integrity, security, and compliance standards across all data engineering work
  • Partner cross-functionally with backend, data science, infrastructure, and product teams to align on data platform priorities
  • Establish engineering guardrails, best practices, and documentation to enable team autonomy and quality at scale
  • Fulltime
Read More
Arrow Right

Senior Data Engineer Lead / Architect - Senior Vice President

At Citi Services - Global Trade Technology Organization, we are on a mission to ...
Location
Location
India , Pune, Maharashtra, India, Chennai, Tamil Nadu, India
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of professional experience in data engineering, with a proven track record of designing and building large-scale data systems
  • 3+ years in a technical leadership or architect role, with experience mentoring junior and senior engineers
  • Expert-level proficiency in at least one programming language (Python or Scala preferred) and exceptional SQL skills
  • Proven hands-on experience with Python or Scala for data manipulation, scripting, machine learning, and backend development
  • Deep, hands-on experience with a major cloud platform (AWS, GCP, or Azure) and its data ecosystem (e.g., S3/GCS, Redshift/BigQuery, EMR/Dataproc, Kinesis/Dataflow)
  • Extensive hands-on experience with modern big data technologies and Data streaming (like Hadoop, Hive, Impala, Apache Spark, Kafka, or Flink)
  • Proficiency with workflow orchestration tools such as Airflow, Dagster, or Prefect
  • Proficiency in designing and implementing microservices architectures, RESTful APIs, and event-driven systems with 'Data as a Product' Principle
  • Solid understanding of data modeling concepts and database design for both analytical (OLAP) and transactional (OLTP) workloads
  • Deep understanding and hands-on experience with relational databases (e.g., PostgreSQL, Oracle), NoSQL databases (e.g., MongoDB, Cassandra), data warehousing, and big data technologies (e.g., Spark, Kafka)
Job Responsibility
Job Responsibility
  • Architect & Design: Design, architect, and oversee the development of robust, scalable, and reliable data infrastructure, including data lakes, data warehouses, and real-time streaming platforms on the cloud
  • Build & Code: Act as a senior individual contributor and hands-on technical leader. Write clean, maintainable, and high-performance code for data ingestion, transformation, and serving layers (e.g., using Python, Scala, SQL, and Spark)
  • Lead & Mentor: Lead a team of data engineers, providing technical guidance, mentorship, and career development support. Foster a collaborative and inclusive team environment
  • Champion Culture: Define, document, and champion data engineering best practices across the organization, including CI/CD, data quality, testing frameworks, observability, and code review standards
  • Drive Strategy: Partner with leadership, product managers, data scientists, and analysts to understand data needs and develop a long-term data strategy and roadmap
  • Innovate & Evaluate: Stay at the forefront of data engineering technologies. Evaluate, prototype, and recommend new tools and frameworks to continuously improve our data platform
  • Ensure Governance: Implement and enforce robust data governance, security, and privacy policies in partnership with our security and compliance teams
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

We are on the lookout for a Principal Data Engineer to help define and lead the ...
Location
Location
South Africa; United Kingdom; Poland
Salary
Salary:
Not provided
dotdigital.com Logo
Dotdigital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience delivering python-based projects in the data engineering space
  • Extensive experience working with SQL and NoSQL database technologies
  • Proven experience with modern data warehousing and large-scale data processing tools
  • Hands on experience with data orchestration tools
  • Experience using cloud environments (e.g. Azure, AWS, GCP) to process, store and surface large scale data
  • Experience using Kafka or similar event-based architectures
  • Strong grasp of data architecture and data modelling principles for both OLAP and OLTP workloads
  • Capable in the wider software development lifecycle in terms of agile ways of working and continuous integration/deployment of data solutions
  • Experience as a lead or Principal Engineer on large-scale data initiative or product builds
  • Demonstrated ability to architect data systems and data structures for high volume, high throughput systems
Job Responsibility
Job Responsibility
  • Lead the design and implementation of scalable, secure and resilient data systems across streaming, batch and real-time use cases
  • Architect data pipelines, model and storage solutions that power analytical and product use cases
  • using primarily Python and SQL via orchestration tooling that run workloads in the cloud
  • Leverage AI to automate both data processing and engineering processes
  • Assure and drive best practices relating to data infrastructure, governance, security and observability
  • Work with technologists across multiple teams to deliver coherent features and data outcomes
  • Support the data team to help adopt data engineering principles
  • Identify, validate and promote new tools and technologies that improve the performance and stability of data services
What we offer
What we offer
  • Parental leave
  • Medical benefits
  • Paid sick leave
  • Dotdigital day
  • Share reward
  • Wellbeing reward
  • Wellbeing Days
  • Loyalty reward
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are seeking a Senior Data Engineer to help evolve and enhance our data platfo...
Location
Location
United Kingdom
Salary
Salary:
Not provided
dotdigital.com Logo
Dotdigital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant experience delivering Python-based projects for data engineering.
  • Experience building and tuning spark pipelines that run at scale across large quantities of data.
  • Strong hands-on experience with SQL and NoSQL databases (e.g. SQL Server, MongoDB, Cassandra).
  • Proven experience with modern data warehousing and large-scale processing (e.g. Snowflake, DBT, BigQuery, Clickhouse).
  • Proficient with data orchestration tools such as Airflow, Dagster, or Prefect.
  • Experience with cloud platforms (Azure, AWS, or GCP) for data processing and storage.
  • Practical experience with Kafka or equivalent event-driven architectures (e.g. AWS SQS, Azure EventHubs, AWS Kinesis).
  • Good understanding of data modelling for OLAP and OLTP workloads.
  • Familiar with agile methodologies and CI/CD processes in the context of data solutions.
  • Experienced as a senior team member on complex data engineering projects.
Job Responsibility
Job Responsibility
  • Design and build scalable, reliable, and secure data pipelines for streaming, batch, and real-time processing.
  • Work in partnership with the Data Science teams to build scalable Pyspark workloads that can be leveraged to generate advanced models.
  • Implement and optimise data models and storage solutions using Python and SQL with orchestration tools in a cloud environment.
  • Leverage AI to automate both data processing and engineering processes.
  • Advocate and uphold best practices for data governance, security, and monitoring.
  • Collaborate cross-functionally with engineers, analysts, and data scientists to deliver impactful data solutions.
  • Mentor and support junior engineers in data engineering principles and practices.
  • Evaluate and recommend new tools and technologies to strengthen data services.
What we offer
What we offer
  • Parental leave
  • Medical benefits
  • Paid sick leave
  • Dotdigital day
  • Share reward
  • Wellbeing reward
  • Wellbeing Days
  • Loyalty reward
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

The Senior Data Engineer at NTT DATA will be responsible for designing and maint...
Location
Location
Thailand , Bangkok
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or master’s in computer science, Engineering, Data Science, or related fields
  • 5+ years of experience in Data Engineering or related fields
  • Strong expertise with one or more major cloud platforms: AWS: Redshift, Glue, S3, EMR, Kinesis, Lambda
  • GCP: BigQuery, Dataflow, Pub/Sub, Dataproc, GCS
  • Azure: Synapse, ADLS, Data Factory, Databricks
  • Proficient in Python, SQL, and at least one distributed processing framework (Spark, Beam, Databricks)
  • Strong experience with ETL/ELT pipelines and data workflow orchestration tools (Airflow, Cloud Composer, Dagster, Prefect)
  • Experience with IaC (Terraform, CloudFormation, CDK)
  • Excellent understanding of data modeling (OLTP, OLAP, star schema, snowflake schema)
  • Familiarity with DevOps and CI/CD for data engineering
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable and secure data pipelines on cloud platforms (AWS/GCP/Azure)
  • Architect and implement data lake, data warehouse, and data mart solutions for enterprise workloads
  • Develop and optimize ETL/ELT pipelines using modern tools and cloud-native services
  • Work closely with Data Analysts, Data Scientists, and Business teams to support analytical and ML use cases
  • Ensure high data quality, governance, security, and compliance across all data systems
  • Implement best practices in data modeling, data partitioning, orchestration, and workflows
  • Lead performance tuning, cost optimization, and reliability improvements for cloud data pipelines
  • Build CI/CD pipelines and infrastructure as code (IaC) for data platform automation
  • Evaluate and introduce new technologies and frameworks to enhance the data ecosystem
  • Mentor junior engineers and lead technical discussions within the data team
  • Fulltime
Read More
Arrow Right

Mid/Senior Data Engineer

Mid/Senior Data Engineer (GCP/ETL/Airflow)
Location
Location
Vietnam , Ho Chi Minh
Salary
Salary:
Not provided
saigontechnology.com Logo
Saigon Technology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in Data engineering
  • Experience with Apache Airflow for scheduling/orchestration
  • Experience with ETL/ELT design
  • Experience with Python/Java/Scala
  • Experience with compliance (GDPR, CCPA)
  • Experience with OLTP (Online Transaction Processing) and OLAP (Online Analytical Processing)
  • Experience with CI/CD pipelines and DevOps tools
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data infrastructure on modern cloud platforms
  • Collaborate cross-functionally (engineering, analytics, product) to develop end-to-end data pipelines
  • Ensure system reliability, performance, and cost optimization
  • Establish and enforce data quality and governance standards while promoting DevOps practices (CI/CD, Infrastructure as Code)
  • Partner with Data Science and Analytics teams to enable BI, advanced analytics, and machine learning use cases
What we offer
What we offer
  • Competitive Salary and Brilliant Health Benefits
  • Attractive salary (13th-month salary, salary review twice/year) and project bonus
  • Bonus programs for candidate referral, technical article writing
  • Interest-free loan support for personal plan
  • Allowance for sickness, maternity, paternity and periodic health examination
  • PVI health care program
  • The staff of the quarter and year reward
  • Progressive and Fun Working Environment
  • A professional English-speaking working environment with Agile – Scrum model
  • Hybrid Working Model: Flexible working time and WFH support
  • Fulltime
Read More
Arrow Right

Data engineer AI and Analytics - Vice president

We are seeking a highly skilled and forward-thinking Vice President to lead our ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of technology experience, with a significant track record in wealth management technology at leading financial institutions
  • Deep, hands-on experience managing large-scale, high-throughput OLTP databases (e.g., Oracle, PostgreSQL, SQL Server)
  • Extensive experience with analytical data platforms, data warehousing, and data lakes (e.g., Snowflake, BigQuery, Redshift, Hadoop ecosystem)
  • Hands-on experience with the data engineering aspects of AI/ML, including feature engineering, data preparation for model training, and deploying models into production pipelines. Familiarity with MLOps principles
  • Proven track record of designing, building, and operating mission-critical, real-time RESTful APIs at scale
  • Strong data modeling skills for both transactional and analytical use cases
  • Expertise with performance measurement and monitoring tools (e.g., AppDynamics, Splunk, Prometheus, Grafana)
  • Proven ability to lead, mentor, and manage a high-performing engineering team
  • A strong, demonstrable work ethic and a deep sense of ownership, with a history of seeing complex systems through from conception to long-term operational stability
  • The ability to maintain a holistic, end-to-end view of a complex data ecosystem, understanding the flow of data from real-time transaction to analytical insight
Job Responsibility
Job Responsibility
  • Unified Data Platform Ownership:Lead a team of skilled engineers responsible for the design, development, and 24/7 operation of the unified client and account data platform, encompassing both high-throughput OLTP systems and large-scale OLAP analytical stores
  • AI & Advanced Analytics Enablement:Pioneer the application of AI/ML models on core client and account data to generate actionable insights, identify patterns, and create intelligent features for advisor and client applications. Partner with data science teams to provide them with high-quality, curated data
  • Real-Time API Management:Oversee the entire lifecycle of the high-throughput, low-latency APIs that provide real-time data to advisor workstations, client-facing portals, and other critical applications, ensuring they are performant, reliable, and secure
  • Data Integrity & Scale:Take ultimate responsibility for the integrity, availability, and performance of massive volumes of data across both transactional and analytical systems
  • Measurement & Analytics:Champion a culture of measurement. Define, monitor, and report on key performance indicators (KPIs) across the entire ecosystem, from database performance and API latency to data quality and the efficacy of AI models
  • End-to-End Ecosystem View:Serve as the subject matter expert for the entire client and account data ecosystem, from the foundational OLTP databases and real-time APIs to the analytical data warehouses/lakes and the AI/ML models they feed
  • Technical Strategy:Partner with global architects and business leaders to define the technical roadmap for the core data platforms, including strategies for data replication, ETL/ELT processes, and the integration of AI/ML capabilities
  • Fulltime
Read More
Arrow Right

Data Engineer

At Wave, we help small businesses to thrive so the heart of our communities beat...
Location
Location
Canada
Salary
Salary:
101000.00 - 113000.00 USD / Year
waveapps.com Logo
Wave
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience building data pipelines and managing a secure, modern data stack, including CDC streaming ingestion (e.g., Debezium) into data warehouses that support AI/ML workloads
  • At least 3 years of experience working with AWS cloud infrastructure, including Kafka (MSK), Spark / AWS Glue, and infrastructure as code (IaC) using Terraform
  • Fluency in SQL, strong understanding of data modelling principles and data storage structures for both OLTP and OLAP
  • Experience writing and reviewing high-quality, maintainable code to improve the reliability and scalability of data platforms, using Python, SQL, and dbt, and leveraging third-party frameworks as needed
  • Prior experience building data lakes on S3 using Apache Hudi with Parquet, Avro, JSON, and CSV file formats
  • Experience developing and deploying data pipeline solutions using CI/CD best practices to ensure reliability and scalability
Job Responsibility
Job Responsibility
  • Design, build, and deploy components of a modern data platform, including CDC-based ingestion using Debezium and Kafka, a centralized Hudi-based data lake, and a mix of batch, incremental, and streaming data pipelines
  • Maintain and enhance the Amazon Redshift warehouse and legacy Python ELT pipelines, while driving the transition to a Databricks and dbt–based analytics environment that will replace the current stack
  • Build fault-tolerant, scalable, and cost-efficient data systems, and continuously improve observability, performance, and reliability across both legacy and modern platforms
  • Partner with cross-functional teams to design and deliver data infrastructure and pipelines that support analytics, machine learning, and GenAI use cases, ensuring timely and accurate data delivery
  • Work autonomously to identify and implement opportunities to optimize data pipelines and improve workflows under tight timelines and evolving requirements
  • Respond to PagerDuty alerts, troubleshoot incidents, and proactively implement monitoring and alerting to minimize incidents and maintain high availability
  • Provide technical guidance to colleagues, clearly communicating complex concepts and actively listening to build trust and resolve issues efficiently
  • Assess existing systems, improve data accessibility, and deliver practical solutions that enable internal teams to generate actionable insights and enhance the experience of our external customers
What we offer
What we offer
  • Bonus Structure
  • Employer-paid Benefits Plan
  • Health & Wellness Flex Account
  • Professional Development Account
  • Wellness Days
  • Holiday Shutdown
  • Wave Days (extra vacation days in the summer)
  • Get A-Wave Program (work from anywhere in the world up to 90 days)
  • Fulltime
Read More
Arrow Right