CrawlJobs Logo
Adyen Logo Adyen · IT - Software Development

Senior Platform Engineer - DataStores

India, Bengaluru · Job Posted March 05, 2026
Apply Position
Job Link Share

Job Description

We are on the lookout for a Senior Platform Engineer to join our Platform Engineering organization. Our teams in this area are responsible for provisioning, running, and managing critical data systems like Apache Kafka, Apache Flink and ElasticSearch for all product teams, at massive scale. Within this role the candidate will primarily focus on one of these areas (ElasticSearch or Apache Kafka). As a Senior Platform Engineer your work will directly influence the resilience, performance, and developer experience of Adyen's core platform. A platform that was responsible for processing over a trillion euros worth of payments in 2025.

Job Responsibility

  • Design and implement: Build, maintain, and evolve the infrastructure and tooling that supports our core data platforms
  • System reliability: Ensure the high availability, performance, and scalability of our Kafka, Flink and ElasticSearch platform
  • Troubleshoot and optimize: Deep dive into performance bottlenecks, identify root causes, and implement effective solutions. This includes analyzing system metrics, core dumps, traces, and logs
  • Automation: Develop and maintain tooling to streamline operational tasks and improve efficiency
  • Code and debug: Write high-quality, maintainable code in languages such as Go or Python to solve complex engineering problems and debug existing systems
  • Collaboration: Work closely with other engineering teams to provide expert guidance and support for their data platform needs

Requirements

  • Strong Linux expertise
  • Strong systems engineering knowledge in distributed systems/high availability
  • 7+ years of industry experience
  • Knowledgeable in a programming language like Go or Python
  • Hands-on Kubernetes or OpenStack experience
  • Strong knowledge of scaling, availability, and operational best practices for distributed systems (Kafka or ElasticSearch)
  • Can drive technical projects while fostering a strong team culture
  • Works well with product, reliability, and other engineering teams
  • Identifies problems before they arise and drives meaningful improvements
  • Participate in an on-call rotation

Nice to have

  • Experience with running or managing an Apache Kafka or ElasticSearch platform offering
  • Experience with other database technologies or distributed systems
  • Experience with Puppet, Ansible, Terraform and/or Vault
  • Familiarity with observability tools (e.g. Prometheus, Grafana, ELK stack)
  • Experience in a fast-paced, high-growth environment
Adyen - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Platform Engineer - DataStores

8 matching positions

Data Engineer Senior Consultant

The Data Engineer will play a crucial role in migrating data from on-prem DataLa...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
  • Ability to troubleshoot (SQL) and basic scripting experience
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices & K8s deployment experience
  • Temporal Data Modeling: Managing state changes over time (e.g., SCD Type 2)
  • Schema Management: Expertise in Schema Evolution (Ref: Iceberg Apache) and enforcement strategies
  • Performance Optimization: Advanced knowledge of data partitioning and clustering
  • Architectural Theory: Balancing Normalization vs. Denormalization and the strategic use of Natural vs. Surrogate Keys
Job Responsibility
Job Responsibility
  • Perform end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
  • Pipeline Migration: Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Data Transfer: Executing the physical migration of underlying datasets while ensuring data integrity
  • Stakeholder Engagement: Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners to ensure migrated assets meet business requirements
  • Consumption Pattern Migration: Code Conversion - Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg
  • Usage analysis: Understand usage patterns to deliver the required data products
  • Data Reconciliation & Quality: Work with reconciliation frameworks to build confidence that migrated data is functionally equivalent to that already used within production flows
  • Work with other internal data management platform and have an aptitude for learning new workflows and language constructs as necessary
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin, Texas; Warren, Michigan
Salary
Salary:
138700.00 - 175450.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent experience
  • 5+ years of relevant full-time experience
  • or equivalent knowledge
  • Strong experience in data engineering, including pipeline development, data modeling, data integration, and production support for enterprise data platforms
  • Data engineering experience, including Python or Scala, SQL, and relational/non-relational data storage (ETL frameworks, big data processing, NoSQL)
  • Experience with cloud platforms – Azure preferred
  • AWS or GCP also considered
  • Proficiency with SQL, key-value datastores, and document stores
  • Design, build, and optimize scalable batch and streaming data pipelines using Databricks (Apache Spark, Delta Lake) to support Medallion Architecture
  • Experience with modern cloud data platforms, distributed processing, and production-grade data pipelines
Job Responsibility
Job Responsibility
  • Design, build, and productionize reliable, scalable, and secure data pipelines and data products in Azure Databricks that support AI, analytics, and operational use cases
  • Lead the transformation of raw data from multiple source systems into trusted, well-structured datasets suitable for downstream analytics, model development, and AI enablement
  • Drive improvements in internal processes, delivery patterns, and technical solutions that support broader functional strategy and increase team efficiency
  • Solve complex and non-standard data engineering problems using advanced analytical and problem-solving techniques, with strong ownership and sound technical judgment
  • Partner closely with data scientists, analysts, software engineers, product stakeholders, and business teams to ensure data is accessible, trustworthy, and aligned to business outcomes
  • Support AI and data science use cases by enabling high-quality feature-ready data, experimentation workflows, and scalable patterns for model development and deployment
  • Contribute to technical direction within the team, influence key engineering decisions in their area, and act as a go-to resource for peers and less experienced engineers
  • Mentor team members through technical guidance, knowledge sharing, and strong engineering practices consistent with Level 7 expectations
What we offer
What we offer
  • Relocation benefits
  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin, Texas; Warren, Michigan
Salary
Salary:
129400.00 - 168650.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Software Engineering, or related field, or equivalent experience
  • 7+ years of data engineering/development experience, including Python or Scala, SQL, and relational/non-relational data storage
  • 3+ years of experience in distributed data processing (Spark) and container orchestration (Kubernetes)
  • Proficiency in data streaming in Kubernetes and Kafka
  • Experience with cloud platforms – Azure preferred
  • AWS or GCP also considered
  • Solid understanding of CI/CD principles and tools
  • Familiarity with big data technologies such as Hadoop, Hive, HBase, Object Storage (ADLS/S3), Event Queues
  • Strong understanding of performance optimization techniques such as partitioning, clustering, and caching
  • Proficiency with SQL, key-value datastores, and document stores
Job Responsibility
Job Responsibility
  • Assemble large, complex data sets that meet functional and non-functional business requirements
  • Identify, design, and implement process improvements, including automation, data delivery optimization, and infrastructure redesign for scalability
  • Lead and deliver data-driven solutions across multiple languages, tools, and technologies
  • Contribute to architecture discussions, solution design, and strategic technology adoption
  • Build and optimize highly scalable data pipelines incorporating complex transformations and efficient code
  • Design and develop new source system integrations from varied formats (files, database extracts, APIs)
  • Design and implement solutions for delivering data that meets SLA requirements
  • Work with operations teams to resolve production issues related to the platform
  • Apply best practices such as Agile methodologies, design thinking, and continuous deployment
  • Develop tooling and automation to make deployments and production monitoring more repeatable
What we offer
What we offer
  • Incentive pay program based on company performance, job level, and individual performance
  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin; Warren
Salary
Salary:
153000.00 - 227000.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Software Engineering, or related field, or equivalent experience
  • 7+ years of data engineering/development experience, including Python or Scala, SQL, and relational/non-relational data storage. (ETL frameworks, big data processing, NoSQL)
  • 3+ years of experience in distributed data processing (Spark) and container orchestration (Kubernetes)
  • Proficiency in data streaming in Kubernetes and Kafka
  • Experience with cloud platforms – Azure preferred
  • AWS or GCP also considered
  • Solid understanding of CI/CD principles and tools
  • Familiarity with big data technologies such as Hadoop, Hive, HBase, Object Storage (ADLS/S3), Event Queues
  • Strong understanding of performance optimization techniques such as partitioning, clustering, and caching
  • Proficiency with SQL, key-value datastores, and document stores
Job Responsibility
Job Responsibility
  • Assemble large, complex data sets that meet functional and non-functional business requirements
  • Identify, design, and implement process improvements, including automation, data delivery optimization, and infrastructure redesign for scalability
  • Lead and deliver data-driven solutions across multiple languages, tools, and technologies
  • Contribute to architecture discussions, solution design, and strategic technology adoption
  • Build and optimize highly scalable data pipelines incorporating complex transformations and efficient code
  • Design and develop new source system integrations from varied formats (files, database extracts, APIs)
  • Design and implement solutions for delivering data that meets SLA requirements
  • Work with operations teams to resolve production issues related to the platform
  • Apply best practices such as Agile methodologies, design thinking, and continuous deployment
  • Develop tooling and automation to make deployments and production monitoring more repeatable
What we offer
What we offer
  • Health and wellbeing benefit programs
  • Medical
  • Dental
  • Vision
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Application Security

Uber is seeking a Senior Software Engineer to join our Application Security team...
Location
Location
United States , Seattle
Salary
Salary:
202000.00 - 224000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Understanding of Agents, MCP servers, and LLMs
  • BS/BE degree in Computer Science or related fields
  • 5+ years of experience in software engineering
  • Experience building applications from end to end
  • Hands-on experience with Go, Java, C, or Python (Uber heavily utilizes Go)
  • Deep knowledge of datastore technologies, including RDBMS and NoSQL systems
  • Experience implementing REST or gRPC APIs
  • Service design and architecture experience
  • Implementation of secure system design, including authentication, authorization, and encryption
Job Responsibility
Job Responsibility
  • Design end-to-end features and autonomous systems for Agent & MCP Security, Code Scanning, and Vulnerability Remediation applications
  • Develop security automation capable of identifying vulnerabilities and performing automated exploit validation across Uber's microrepository landscape
  • Collaborate and consult with multiple engineering teams and stakeholders from Privacy, Security, Compliance, Infrastructure, and Product for integration into our security platforms
  • Design and develop new systems, such as automated security scoring and repository-to-service mapping, to empower fast, data-driven security decisions
  • Build distributed backend systems, including workflows, that serve real-time analytics and security features at Uber scale
  • Mentor junior engineers and lead technical design reviews for high-impact security projects
What we offer
What we offer
  • Bonus program
  • Equity award
  • 401(k) plan
  • Various benefits
  • Fulltime
Read More
Arrow Right

Senior Security Engineer, Add-ons Operations

addons.mozilla.org (AMO) is the foundation of the Firefox add-ons ecosystem. It’...
Location
Location
Salary
Salary:
Not provided
mozilla.org Logo
Mozilla
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience building modern web applications
  • Strong experience with Python/Django or similar backend frameworks
  • Understanding of web security principles and practices
  • Strong collaboration and communication skills in a distributed team environment
  • Adept at navigating ambiguity, exploring solutions, and shaping direction in new problem spaces
  • Commitment to our values: Welcoming differences, Being relationship-minded, Practicing responsible participation, Having grit
Job Responsibility
Job Responsibility
  • Deliver major features and architectural improvements across the Add-ons stack, including automated moderation pipelines, Reviewer tools, and DevHub
  • Create robust observability systems and data-backed insights
  • Provide peer feedback, share knowledge and help others grow
  • Improve platform reliability through deployments, monitoring, and incident response
  • Help keep the platform safe and trustworthy, with attention to security and user trust
  • Step in to resolve issues impacting users and developers, from small bugs to larger incidents
  • Collaborate with designers, product managers, QA, and community contributors to deliver end-to-end improvements
  • Contribute in the open through pull requests, code reviews, and discussions
  • Work on: Full stack development: React/TypeScript frontends, Django backend, MySQL datastore
  • Platform reliability: deployments, monitoring, and incident response on Google Cloud
What we offer
What we offer
  • Generous performance-based bonus plans
  • Rich medical, dental, and vision coverage
  • Generous retirement contributions with 100% immediate vesting
  • Quarterly all-company wellness days
  • Country specific holidays plus a day off for your birthday
  • One-time home office stipend
  • Annual professional development budget
  • Quarterly well-being stipend
  • Considerable paid parental leave
  • Employee referral bonus program
Read More
Arrow Right

Senior Backend Engineer

Join the Financial Markets team to power the core FX and liquidity technology at...
Location
Location
Australia , Melbourne
Salary
Salary:
Not provided
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience building and operating backend systems in production
  • Strong programming experience in one or more JVM languages (e.g. Kotlin, Java) or a comparable backend stack
  • Solid understanding of distributed systems fundamentals: concurrency, data consistency, idempotency, retries, backoff, and failure modes in networked services
  • Experience designing and working with REST and/or gRPC APIs, and persistence layers using relational databases (e.g. PostgreSQL) and/or key-value stores
  • Proficiency with event-driven architectures and message brokers/streams (e.g. Kafka or similar)
  • Strong focus on testing and quality: unit, integration and contract tests
  • familiarity with CI/CD pipelines
  • Good grasp of observability: metrics, logging, tracing and alerting
  • Clear written and verbal communication skills
Job Responsibility
Job Responsibility
  • Design, build and own backend services for FX pricing, execution and risk management
  • Contribute to the evolution of our FX platform architecture (microservices, event-driven workflows, Kafka, gRPC, SQL/NoSQL datastores)
  • Implement and maintain robust controls for pricing, limits, risk, reconciliation and monitoring
  • Work end-to-end on features: from requirements and solution design, to implementation, automated testing, deployment and operational runbooks
  • Collaborate with Product, Treasury, Risk, Data and other engineering teams to design APIs and data contracts
  • Instrument services with metrics, logs and tracing
  • Participate in code reviews, technical design discussions and knowledge-sharing sessions
  • mentor less-experienced engineers
  • Take part in our on-call rotation
What we offer
What we offer
  • Competitive salaries
  • Comprehensive health benefits
  • Flexible work environment
  • Work-life balance
  • Fulltime
Read More
Arrow Right

Senior Infrastructure Engineer

At Webflow, we’re building the world’s leading AI-native Digital Experience Plat...
Location
Location
Argentina
Salary
Salary:
Not provided
webflow.com Logo
Webflow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Background as an operations or production engineer with an enthusiasm for code, or a software engineer with an enthusiasm for systems and infrastructure
  • 5+ years of experience building, maintaining, and debugging distributed systems in a customer-facing environment with little to no downtime
  • Hands-on experience operating and scaling production datastores (MongoDB and/or PostgreSQL), including performance tuning, schema or index design, and incident-level troubleshooting
  • Experience supporting multiple teams using shared datastore infrastructure, including establishing guardrails, best practices, and patterns that scale with growth
  • Experience navigating and scaling multi-tier cloud environments on AWS or GCP using containerized and Kubernetes-based architectures
  • Experience with infrastructure-as-code tools such as Terraform or Pulumi, including managing stateful infrastructure
  • Enthusiasm for mentoring and sponsoring less-experienced engineers
Job Responsibility
Job Responsibility
  • Join our Data Stores team, which owns the reliability, scalability, and operational excellence of core datastores (MongoDB, PostgreSQL), including schema and index strategy, connection best practices, and performance tuning
  • Partner cross-functionally with product, application, and platform teams (including embedded engagements) to support new use cases, onboard new products, and unblock dependency-driven work
  • Reduce toil by designing and implementing automation and Infrastructure as Code (IaC) for datastore provisioning, upgrades, backups, and disaster recovery
  • Lead efforts to identify systemic datastore issues, drive root-cause analysis, and implement durable fixes to improve long-term stability
  • Establish guardrails, standards, and best practices to ensure consistent and scalable adoption of datastores across teams
  • anticipating growth and avoiding repeat failure modes
  • Guide and empower engineers on other teams to introduce new features and functionality into production in a safe, sustainable way
  • Occasionally dive into the main Webflow application (TypeScript, Node, or Go) to debug and sometimes fix production behavior
  • Participate in and continuously improve on-call and incident response processes
  • Help define the culture of this growing team as it expands its international presence
What we offer
What we offer
  • Ownership in what you help build. Every permanent Webflower receives equity (RSUs) in our growing, privately held company
  • Health coverage that actually covers you. Comprehensive medical, dental, and vision plans for full-time employees and their dependents, with Webflow covering most premiums
  • Support for every stage of family life. 12 weeks of paid parental leave for all parents and 6+ weeks of additional paid leave for birthing parents. Plus inclusive care for family planning, menopause, and midlife transitions
  • Time off that’s actually off. Flexible vacation, paid holidays, and a sabbatical program to help you recharge and come back inspired
  • Wellness for the whole you. Access to mental health resources, therapy and coaching
  • Invest in your future. A 401(k) with 100% employer match (up to $6,000/year) in the U.S., and support for retirement savings globally
  • Monthly stipends that flex with your life. Localized support for work and wellness expenses — from Wi-Fi to workouts
  • Bonus for building together. All full-time, permanent, non-commission employees are eligible for our annual WIN bonus program
  • Fulltime
Read More
Arrow Right