CrawlJobs Logo
Adyen Logo Adyen · IT - Software Development

Senior Data Platform Engineer - OLAP

Netherlands, Amsterdam · Job Posted June 15, 2026
Apply Position
Job Link Share

Job Description

Sitting at the intersection of Data Engineering, Backend Engineering, and Systems Engineering, Data Platform Engineers at Adyen build the foundational layer of tooling and processes for our on-premise Big Data Platforms. These tools support 10s of products, 100s of developers, and 1000s of daily jobs that add to Adyen’s strong portfolio of capabilities. You’ll collaborate with data engineers and ML scientists and engineers to build and roll-out these tools. Along with DataOps Engineers, you’ll develop and operate multiple big data platforms, of which the biggest is 500+ nodes, with 25k+ CPU cores, 240+ TBs of RAM, and 23+ PBs of storage capacity, running tens of thousands of spark jobs a day.

Job Responsibility

  • Build the foundational layer of tooling and processes for Adyen's on-premise Big Data Platforms
  • Collaborate with data engineers and ML scientists/engineers to build and roll-out tools
  • Develop and operate multiple big data platforms
  • Drive scaling and optimizing real-time analytical powerhouses (Druid, FastAPI, Java, Kafka)
  • Design and build data contracts, validation frameworks, optimization tooling, and robust Kafka ingestion pipelines

Requirements

  • 6+ years of experience with object-oriented programming
  • Python or Java Expert
  • Proven experience developing and maintaining distributed compute/data systems (e.g., Spark, Trino, Druid, ClickHouse)
  • Proven experience developing and maintaining real-time and batch pipelines (Kafka, Spark Streaming) with a focus on user-friendliness and reliability
  • Proven experience developing and maintaining DevOps pipelines and data modeling tooling
Adyen - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Data Platform Engineer - OLAP

8 matching positions

Senior Data Engineer Lead / Architect - Senior Vice President

At Citi Services - Global Trade Technology Organization, we are on a mission to ...
Location
Location
India , Pune, Maharashtra, India, Chennai, Tamil Nadu, India
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of professional experience in data engineering, with a proven track record of designing and building large-scale data systems
  • 3+ years in a technical leadership or architect role, with experience mentoring junior and senior engineers
  • Expert-level proficiency in at least one programming language (Python or Scala preferred) and exceptional SQL skills
  • Proven hands-on experience with Python or Scala for data manipulation, scripting, machine learning, and backend development
  • Deep, hands-on experience with a major cloud platform (AWS, GCP, or Azure) and its data ecosystem (e.g., S3/GCS, Redshift/BigQuery, EMR/Dataproc, Kinesis/Dataflow)
  • Extensive hands-on experience with modern big data technologies and Data streaming (like Hadoop, Hive, Impala, Apache Spark, Kafka, or Flink)
  • Proficiency with workflow orchestration tools such as Airflow, Dagster, or Prefect
  • Proficiency in designing and implementing microservices architectures, RESTful APIs, and event-driven systems with 'Data as a Product' Principle
  • Solid understanding of data modeling concepts and database design for both analytical (OLAP) and transactional (OLTP) workloads
  • Deep understanding and hands-on experience with relational databases (e.g., PostgreSQL, Oracle), NoSQL databases (e.g., MongoDB, Cassandra), data warehousing, and big data technologies (e.g., Spark, Kafka)
Job Responsibility
Job Responsibility
  • Architect & Design: Design, architect, and oversee the development of robust, scalable, and reliable data infrastructure, including data lakes, data warehouses, and real-time streaming platforms on the cloud
  • Build & Code: Act as a senior individual contributor and hands-on technical leader. Write clean, maintainable, and high-performance code for data ingestion, transformation, and serving layers (e.g., using Python, Scala, SQL, and Spark)
  • Lead & Mentor: Lead a team of data engineers, providing technical guidance, mentorship, and career development support. Foster a collaborative and inclusive team environment
  • Champion Culture: Define, document, and champion data engineering best practices across the organization, including CI/CD, data quality, testing frameworks, observability, and code review standards
  • Drive Strategy: Partner with leadership, product managers, data scientists, and analysts to understand data needs and develop a long-term data strategy and roadmap
  • Innovate & Evaluate: Stay at the forefront of data engineering technologies. Evaluate, prototype, and recommend new tools and frameworks to continuously improve our data platform
  • Ensure Governance: Implement and enforce robust data governance, security, and privacy policies in partnership with our security and compliance teams
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are seeking a Senior Data Engineer to help evolve and enhance our data platfo...
Location
Location
United Kingdom
Salary
Salary:
Not provided
dotdigital.com Logo
Dotdigital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant experience delivering Python-based projects for data engineering.
  • Experience building and tuning spark pipelines that run at scale across large quantities of data.
  • Strong hands-on experience with SQL and NoSQL databases (e.g. SQL Server, MongoDB, Cassandra).
  • Proven experience with modern data warehousing and large-scale processing (e.g. Snowflake, DBT, BigQuery, Clickhouse).
  • Proficient with data orchestration tools such as Airflow, Dagster, or Prefect.
  • Experience with cloud platforms (Azure, AWS, or GCP) for data processing and storage.
  • Practical experience with Kafka or equivalent event-driven architectures (e.g. AWS SQS, Azure EventHubs, AWS Kinesis).
  • Good understanding of data modelling for OLAP and OLTP workloads.
  • Familiar with agile methodologies and CI/CD processes in the context of data solutions.
  • Experienced as a senior team member on complex data engineering projects.
Job Responsibility
Job Responsibility
  • Design and build scalable, reliable, and secure data pipelines for streaming, batch, and real-time processing.
  • Work in partnership with the Data Science teams to build scalable Pyspark workloads that can be leveraged to generate advanced models.
  • Implement and optimise data models and storage solutions using Python and SQL with orchestration tools in a cloud environment.
  • Leverage AI to automate both data processing and engineering processes.
  • Advocate and uphold best practices for data governance, security, and monitoring.
  • Collaborate cross-functionally with engineers, analysts, and data scientists to deliver impactful data solutions.
  • Mentor and support junior engineers in data engineering principles and practices.
  • Evaluate and recommend new tools and technologies to strengthen data services.
What we offer
What we offer
  • Parental leave
  • Medical benefits
  • Paid sick leave
  • Dotdigital day
  • Share reward
  • Wellbeing reward
  • Wellbeing Days
  • Loyalty reward
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

The Senior Data Engineer at NTT DATA will be responsible for designing and maint...
Location
Location
Thailand , Bangkok
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or master’s in computer science, Engineering, Data Science, or related fields
  • 5+ years of experience in Data Engineering or related fields
  • Strong expertise with one or more major cloud platforms: AWS: Redshift, Glue, S3, EMR, Kinesis, Lambda
  • GCP: BigQuery, Dataflow, Pub/Sub, Dataproc, GCS
  • Azure: Synapse, ADLS, Data Factory, Databricks
  • Proficient in Python, SQL, and at least one distributed processing framework (Spark, Beam, Databricks)
  • Strong experience with ETL/ELT pipelines and data workflow orchestration tools (Airflow, Cloud Composer, Dagster, Prefect)
  • Experience with IaC (Terraform, CloudFormation, CDK)
  • Excellent understanding of data modeling (OLTP, OLAP, star schema, snowflake schema)
  • Familiarity with DevOps and CI/CD for data engineering
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable and secure data pipelines on cloud platforms (AWS/GCP/Azure)
  • Architect and implement data lake, data warehouse, and data mart solutions for enterprise workloads
  • Develop and optimize ETL/ELT pipelines using modern tools and cloud-native services
  • Work closely with Data Analysts, Data Scientists, and Business teams to support analytical and ML use cases
  • Ensure high data quality, governance, security, and compliance across all data systems
  • Implement best practices in data modeling, data partitioning, orchestration, and workflows
  • Lead performance tuning, cost optimization, and reliability improvements for cloud data pipelines
  • Build CI/CD pipelines and infrastructure as code (IaC) for data platform automation
  • Evaluate and introduce new technologies and frameworks to enhance the data ecosystem
  • Mentor junior engineers and lead technical discussions within the data team
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Reporting to the Manager, Data Engineering, as a Senior Data Engineer, you will ...
Location
Location
Canada
Salary
Salary:
145000.00 - 154000.00 USD / Year
waveapps.com Logo
Wave
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in building data pipelines and managing a secure, modern data stack
  • Experience with CDC streaming ingestion using tools like Debezium into a data warehouse that supports AI/ML workloads
  • At least 3 years of experience working with AWS cloud infrastructure, including Kafka (MSK), Spark / AWS Glue, and infrastructure as code (IaC) using Terraform
  • Fluency in SQL, strong understanding of data modelling principles and data storage structures for both OLTP and OLAP
  • Experience developing or maintaining a production data system on Databricks
  • Write and review high-quality, maintainable code using Python, SQL, and dbt
  • Prior experience building data lakes on S3 using Apache Hudi with Parquet, Avro, JSON, and CSV file formats
  • Experience developing and deploying data pipeline solutions using CI/CD best practices
  • Strong communication skills
  • Self-motivated and comfortable working autonomously
Job Responsibility
Job Responsibility
  • Design, build, and deploy components of a modern data platform, including CDC-based ingestion using Debezium and Kafka, a centralized Hudi-based data lake, and a mix of batch, incremental, and streaming data pipelines
  • Maintain and enhance the existing Amazon Redshift data warehouse and legacy Python ELT pipelines
  • Accelerate the transition to a brand-new Databricks-based analytics and processing environment integrated with dbt
  • Build fault-tolerant, scalable, and cost-efficient data systems
  • Continuously improve observability, performance, and reliability across both legacy and modern platforms
  • Work closely with cross-functional partners to plan and roll out data infrastructure and processing pipelines that support analytics, machine learning, and GenAI use cases
  • Respond to PagerDuty alerts, troubleshoot incidents, and proactively implement monitoring and alerting
  • Assess existing systems, improve data accessibility, and deliver practical solutions that enable internal teams to generate actionable insights
What we offer
What we offer
  • Bonus Structure
  • Employer-paid Benefits Plan
  • Health & Wellness Flex Account
  • Professional Development Account
  • Wellness Days
  • Holiday Shutdown
  • Wave Days (extra vacation days in the summer)
  • Get A-Wave Program (work from anywhere in the world up to 90 days)
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Location
Location
Poland
Salary
Salary:
Not provided
dcg.pl Logo
DCG Sp. z o. o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 5 years of experience in designing and building Business Intelligence, ETL/ELT, Data Warehouse, Data Lake, Data Lakehouse, Big Data, OLAP class solutions
  • Practical knowledge of various relational (e.g., SQL Server, Oracle, Redshift, PostgreSQL, Teradata) and non-relational database engines (e.g., MongoDB, Cosmos DB, DynamoDB, Neo4j, HBase, Redis, InfluxDB)
  • Strong proficiency in SQL and Python (minimum 5 years of experience)
  • Familiarity with data engineering and orchestration tools, particularly Spark/Databricks (including structured streaming mechanisms, DLT, etc.), Hadoop/CDP, Azure/Fabric Data Factory, Apache Flink, Apache Kafka, Apache Airflow, dbt, Debezium, and more
  • Understanding of data governance, data quality, and batch/streaming data processing challenges
  • Knowledge of architectural patterns in data, including Data Mesh, Data Vault, Dimensional Modeling, Medallion Architecture, and Lambda/Kappa Architectures
  • Proficiency in using git repositories (Bitbucket, GitHub, GitLab)
  • Experience with data services on the Azure and/or AWS platforms
  • Flexibility, self-reliance, and efficiency, with a strong sense of responsibility for assigned tasks
  • Practical knowledge of English at a minimum B2 level (C1+ preferred)
Job Responsibility
Job Responsibility
  • Designing new solutions and coming up with initiatives for improvements to existing solutions within data platforms - both as part of orders coming from the business (functional changes) and from technology (architectural changes)
  • Development of data platforms and ETL/ELT processes: technical support and active participation in the development of data platforms
  • Work on building and optimizing ETL/ELT processes that are responsible for processing large data sets
  • Implement processes to ensure optimal data processing, using data engineering best practices
  • Standardize and streamline technical processes: implementing and optimizing code, test and documentation management standards
  • Selecting and configuring tools and development environments that support data engineering processes to maintain code quality and facilitate code scaling
  • Ensure standards compliance and code review: responsible for applying existing platform development standards, initiating new guidelines where improvements are needed, and monitoring the quality of delivered solutions by conducting regular code-reviews
  • Work directly with technology as a Data Engineer and Data Analyst to maintain a high level of technology sophistication, understand current challenges, and drive improvements based on actual technical needs
  • Act as a mentor to the team, providing subject matter support in the areas of solution design, code standardization, process optimization and best practice implementation
What we offer
What we offer
  • Private medical care
  • Co-financing for the sports card
  • Training & learning opportunities
  • Language course co-financing
Read More
Arrow Right

Senior Data Engineer/Team Lead

We are seeking a Senior Data Engineer / Team Lead to drive the design and develo...
Location
Location
Salary
Salary:
Not provided
itransition.com Logo
Itransition
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience as a Data Engineer
  • Strong proficiency in SQL and/or PySpark
  • Experience with Microsoft Fabric and/or Azure Databricks
  • Experience with BI visualization tools (e.g. Power BI, SSRS, Tableau or Qlik)
  • Proven experience designing, building, and maintaining complex ETL/ELT pipelines
  • Advanced knowledge of data modeling
  • Advanced experience with at least one orchestration tool (Azure Data Factory preferred
  • SSIS, Apache Airflow, AWS Glue, Talend, or similar)
  • Experience with at least one relational database (Microsoft SQL Server, PostgreSQL, Oracle)
  • Ability to optimize and tune OLAP and OLTP queries
Job Responsibility
Job Responsibility
  • Design, build, and evolve complex, scalable ETL/ELT pipelines
  • Ensure reliable and efficient data flows across BI and analytics platforms
  • Lead by example through hands-on development and ownership of critical data components
  • Collaborate closely with product managers, analysts, and engineers to define and deliver high-impact data solutions
  • Continuously improve system performance, scalability, and maintainability, including advanced SQL query optimization
  • Conduct and oversee code reviews, ensuring high code quality, performance, and adherence to best practices
  • Establish, follow, and actively promote data engineering standards, best practices, and architectural guidelines
  • Mentor and support team members, fostering technical growth and knowledge sharing
What we offer
What we offer
  • Projects for such clients as PayPal, Wargaming, Xerox, Philips, Adidas and Toyota
  • Competitive compensation that depends on your qualification and skills
  • Career development system with clear skill qualifications
  • Flexible working hours aligned to your schedule
  • Options to work remotely
  • Corporate medical insurance covering services of private and public medical centers
  • English courses online
  • Corporate parties and events for employees and their children
  • Internal conferences, workshops and meetups for learning and experience sharing
  • Gym membership compensation
Read More
Arrow Right

Senior Backend Engineer - Golang

We’re looking for a Senior Backend Engineer to join us and play a key role in de...
Location
Location
Germany , Dresden
Salary
Salary:
Not provided
staffbase.com Logo
Staffbase
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional experience in backend software development
  • Strong proficiency in Golang and preferably experience with Java/Kotlin
  • Solid experience with cloud platforms (AWS, GCP, or Azure)
  • Real-time OLAP experience (ClickHouse, Apache Doris, StarRocks etc.)
  • Hands-on experience with Docker and Kubernetes
  • A pragmatic mindset: you care about maintainability, reliability, and shipping
Job Responsibility
Job Responsibility
  • Design, develop, and operate scalable, reliable backend services
  • Build APIs and services that integrate with internal systems and external platforms
  • Take responsibility for production systems, from development to monitoring and operations
  • Work with emerging AI/LLM-based components as part of broader backend systems
  • Help integrate model-based services into existing architectures in a pragmatic way
  • Contribute to early experimentation: validating ideas, learning what works, and hardening successful prototypes for production
  • Collaborate with ML and Data colleagues to bring AI-driven features into real products
  • Define and implement observability standards (logging, metrics, tracing)
  • Ensure systems are secure, performant, and cost-aware
  • Work with cloud infrastructure and containerized environments to support reliable deployments
What we offer
What we offer
  • Competitive Compensation - we offer attractive salary packages including LTIP (unit-based Long Term Incentive Plan)
  • Flexibility - we offer flexible working time models and the option of hybrid work, and support this with a yearly flex work allowance of €1560
  • Recharge - with 31 vacation days annually (incl. one floating holiday), plus pro rata fully paid Fridays off during August
  • Support - we’re offering a company pension scheme
  • Volunteers Day - you’ll get one day off per year for supporting a social project
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer - Golang

We’re looking for a Senior Backend Engineer to join us and play a key role in de...
Location
Location
Germany , Chemnitz
Salary
Salary:
Not provided
staffbase.com Logo
Staffbase
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional experience in backend software development
  • Strong proficiency in Golang and preferably experience with Java/Kotlin
  • Solid experience with cloud platforms (AWS, GCP, or Azure)
  • Real-time OLAP experience (ClickHouse, Apache Doris, StarRocks etc.)
  • Hands-on experience with Docker and Kubernetes
  • A pragmatic mindset: you care about maintainability, reliability, and shipping
Job Responsibility
Job Responsibility
  • Design, develop, and operate scalable, reliable backend services
  • Build APIs and services that integrate with internal systems and external platforms
  • Take responsibility for production systems, from development to monitoring and operations
  • Work with emerging AI/LLM-based components as part of broader backend systems
  • Help integrate model-based services into existing architectures in a pragmatic way
  • Contribute to early experimentation: validating ideas, learning what works, and hardening successful prototypes for production
  • Collaborate with ML and Data colleagues to bring AI-driven features into real products
  • Define and implement observability standards (logging, metrics, tracing)
  • Ensure systems are secure, performant, and cost-aware
  • Work with cloud infrastructure and containerized environments to support reliable deployments
What we offer
What we offer
  • Competitive Compensation - we offer attractive salary packages including LTIP (unit-based Long Term Incentive Plan)
  • Flexibility - we offer flexible working time models and the option of hybrid work, and support this with a yearly flex work allowance of €1560
  • Recharge - with 31 vacation days annually (incl. one floating holiday), plus pro rata fully paid Fridays off during August
  • Support - we’re offering a company pension scheme
  • Volunteers Day - you’ll get one day off per year for supporting a social project
  • Fulltime
Read More
Arrow Right