CrawlJobs Logo

Staff Data Platform Engineer

United States, San Francisco 196000.00 - 294000.00 USD / Year · Job Posted January 03, 2026
Apply Position
Job Link Share

Job Description

We are looking for a Principal Engineer to lead the architecture and development of Vercel’s next-generation Data Platform. You will design the systems that power data across our products and internal teams, enabling real-time analytics, observability, and future AI/ML capabilities. This role combines hands-on engineering with technical leadership. You will set the vision for our data ecosystem, build scalable distributed systems using technologies like Kafka, ClickHouse, Tinybird, and Snowflake, and work across the company to align data strategy with product and engineering goals.

Job Responsibility

  • Architect and build a scalable data platform for batch and real-time workloads
  • Design streaming and event-driven systems using Kafka and related tooling
  • Implement modern lakehouse foundations, including Iceberg-based storage and governance
  • Partner with engineering, product, and leadership to define data strategy and technical direction
  • Establish best practices for ingestion, modeling, storage, quality, and security
  • Write production-grade code and set engineering standards across the team
  • Improve reliability through strong observability, monitoring, and fault tolerance
  • Drive long-term architectural decisions and evaluate build-vs-buy tradeoffs
  • Support analytics and ML teams by delivering high-quality data systems and tooling

Requirements

  • 8+ years in data engineering or data architecture, including senior/principal-level work
  • Deep experience designing and operating large-scale distributed data systems
  • Strong expertise with Kafka and analytics/lakehouse technologies (ClickHouse, Tinybird, Snowflake, Iceberg)
  • Strong cloud experience (AWS, GCP, or Azure)
  • Experience with data governance, reliability, and secure data operations
  • Excellent communication skills and ability to influence across engineering and product teams
  • Demonstrated leadership through mentorship, design ownership, or technical direction

What we offer

  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills
  • Flexible Time Off
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Staff Data Platform Engineer

8 matching positions

Staff Data Platform Engineer

As a high level architect(staff engineer), you will oversee the strategy, archit...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A minimum of 8 years of experience in Data Platform or an equivalent combination of work and academic exposure in a quantitative field
  • Proven experience leading company-wide initiatives across multiple teams or influencing tech roadmap planning
  • Effective collaboration with diverse teams and stakeholders to drive tangible business outcomes
  • Demonstrated ability to balance execution and velocity with in-depth research, statistical understanding, and scalable design
  • Track record of mentoring and investing in the development of scientists, engineers, and peers
  • Experience providing technical leadership on significant projects, covering ETL frameworks, metrics stores, infrastructure management, and data security
  • Proficiency in building, deploying, and maintaining reliable multi-geographical data pipelines at scale
  • Familiarity with workflow or orchestration frameworks such as Airflow, DBT, etc.
Job Responsibility
Job Responsibility
  • Spearheaded the identification and resolution of Airwallex-wide challenges using cutting-edge data platform solutions
  • Provide visionary technical direction, fostering a community within Airwallex's data realm, and actively leading in solving complex problems hands-on
  • Advocate for best practices across the data platform, instilling a culture of craftsmanship and innovation
  • Mentor the data platform team, nurturing both technical and professional development.
What we offer
What we offer
  • Competitive salary plus valuable equity within Airwallex
  • Collaborative open office space with a fully stocked kitchen
  • Regular team-building events
  • Freedom to be creative.
  • Fulltime
Read More
Arrow Right

Staff Data Platform Engineer

As a high level architect (staff engineer), you will oversee the strategy, archi...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A minimum of 8 years of experience in Data Platform or an equivalent combination of work and academic exposure in a quantitative field
  • Proven experience leading company-wide initiatives across multiple teams or influencing tech roadmap planning
  • Effective collaboration with diverse teams and stakeholders to drive tangible business outcomes
  • Demonstrated ability to balance execution and velocity with in-depth research, statistical understanding, and scalable design
  • Track record of mentoring and investing in the development of scientists, engineers, and peers
  • Experience providing technical leadership on significant projects, covering ETL frameworks, metrics stores, infrastructure management, and data security
  • Proficiency in building, deploying, and maintaining reliable multi-geographical data pipelines at scale
  • Familiarity with workflow or orchestration frameworks such as Airflow, DBT, etc.
Job Responsibility
Job Responsibility
  • Spearheaded the identification and resolution of Airwallex-wide challenges using cutting-edge data platform solutions
  • Provide visionary technical direction, fostering a community within Airwallex's data realm, and actively leading in solving complex problems hands-on
  • Advocate for best practices across the data platform, instilling a culture of craftsmanship and innovation
  • Mentor the data platform team, nurturing both technical and professional development.
What we offer
What we offer
  • Competitive salary plus valuable equity within Airwallex
  • Collaborative open office space with a fully stocked kitchen
  • Regular team-building events
  • Freedom to be creative.
  • Fulltime
Read More
Arrow Right

Staff Data Platform Engineer

Staff Data Platform Engineer role at a high-growth, product-led software company...
Location
Location
United States , San Francisco; New York
Salary
Salary:
310000.00 USD / Year
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working on data platforms where data is central to the product
  • Strong software engineering background with a data focus
  • Comfortable operating at Staff level with real ownership and technical judgment
  • Experience with distributed systems and production data workloads
  • Product-minded — you care how data is used, not just how it’s stored
Job Responsibility
Job Responsibility
  • Designing and building software-oriented data systems (not classic BI / analytics)
  • Owning the platforms that ingest, refresh, and serve people and jobs data
  • Working on live web scraping, data freshness, and reliability at scale
  • Building internal data services that power product features like search and enrichment
  • Shaping architecture and technical direction as the platform grows
What we offer
What we offer
  • Very strong equity with real liquidity history
  • Fulltime
Read More
Arrow Right

Staff Data Platform Engineer

Staff Data Platform Engineer role at a high-growth, product-led software company...
Location
Location
United States , San Francisco or New York
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working on data platforms where data is central to the product
  • Strong software engineering background with a data focus
  • Comfortable operating at Staff level with real ownership and technical judgment
  • Experience with distributed systems and production data workloads
  • Product-minded — you care how data is used, not just how it’s stored
Job Responsibility
Job Responsibility
  • Designing and building software-oriented data systems (not classic BI / analytics)
  • Owning the platforms that ingest, refresh, and serve people and jobs data
  • Working on live web scraping, data freshness, and reliability at scale
  • Building internal data services that power product features like search and enrichment
  • Shaping architecture and technical direction as the platform grows
What we offer
What we offer
  • Very strong equity with real liquidity history
Read More
Arrow Right

Senior Staff Data Engineer- Data Platform

At Marktplaats, data is at the heart of everything we do, but Intelligence is wh...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on experience in Software Development or Data Engineering
  • at least 5+ years specifically focused on building Data Platforms
  • deep understanding of how Platform infra supports Analytics workloads
  • proven experience evolving complex platforms from legacy patterns to modern, cloud-native solutions
  • deep knowledge of Spark internals, JVM tuning, and performance optimization for high-scale batch and streaming datasets
  • deep expertise in Unity Catalog, Delta Lake internals, and optimizing high-volume workloads
  • strict software engineering discipline (CI/CD, Testing, OOP) applied to data pipelines
  • understanding of microservices architecture
  • understanding the needs of Analytics/DWH teams (Data Modeling, dbt)
  • strong background in building automated pipelines using Terraform/Terragrunt and ensuring system observability
Job Responsibility
Job Responsibility
  • Lead the evolution of our Data Platform and architect the "Data Exchange" strategy
  • define robust patterns for API-based ingestion, Event-Driven Architectures (Kafka), and Reverse ETL
  • ensure architectures are optimized for cost and performance on AWS
  • act as a catalyst for technical evolution
  • constantly scan the horizon for next-generation technologies
  • lead the implementation of new paradigms
  • design the strategy for Unity Catalog implementation and Data Contracts
  • champion FinOps, automating cost controls for our highest-volume workloads
  • build the underlying infrastructure that allows Analytics/DWH teams to run efficient transformations
  • elevate the technical bar of the team, mentoring Staff and Senior engineers
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • a collaborative environment with an opportunity to explore your potential and grow
  • a range of locally relevant benefits
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, Data Platform

Lead the design and development of core data storage, streaming, caching, and in...
Location
Location
United States , San Francisco; Seattle; New York
Salary
Salary:
248400.00 - 310500.00 USD / Year
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of full-time engineering experience, post-graduation with specialties in back-end systems, specifically related to building large-scale data storage, streaming, and warehousing systems
  • Extensive experience in various database technologies (MongoDB, Postgres), streaming/processing solutions (Kinesis, Flink, Spark), indexing/caching (ElasticSearch, Redis), and various data query engines (Trino, Presto, Snowflake, etc.)
  • Show a track record of mentoring and leading teams in successful projects
  • Possess excellent communication and collaboration skills, and the ability to translate complex technical concepts to non-technical stakeholders
  • Experience working fluently with standard containerization & deployment technologies like Kubernetes and various public cloud offerings
  • Extensive experience in software development and a deep understanding of distributed systems, cloud platforms and data systems
  • Experience driving cross functional collaboration and communication at an organizational or broader level
Job Responsibility
Job Responsibility
  • Drive the architecture, design, implementation, and reliability of our foundational data platforms and systems, working closely with stakeholders and internal customers to understand and refine requirements
  • Collaborate with cross-functional teams to define, design, and deliver new features
  • Proactively identify opportunities for, and driving improvements to, current programming practices, including process enhancements and tool upgrades
  • Present technical information to teams and stakeholders, providing guidance and insight on development processes and technologies
  • Provide technical leadership, including: upholding and upleveling engineering standards across the organization, mentoring junior engineers
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO
  • equity grant
  • commuter stipend
  • Fulltime
Read More
Arrow Right

Staff Data Engineer - Analytics Platform

We’re starting up a brand-new Analytics Platform team to drive the data strategy...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
octopus.energy Logo
Octopus Energy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep expertise with dbt Core
  • Advanced SQL, Jinja and Git
  • Data Modelling Techniques e.g. Kimball, OBT
  • Experience with a cloud warehouse provider e.g. Databricks, Snowflake, BigQuery
  • A record of working with multiple stakeholders across domains
Job Responsibility
Job Responsibility
  • Build, document and consult on: Analytics for business domains using dbt & modern BI tools such as Lightdash
  • Strategies to model & govern a Data Mesh – improving discoverability, consistency, performance, and performance
  • Comprehensive testing frameworks to ensure data quality, using tools like dbt_expectations and Elementary
  • Robust CI/CD pipelines for testing and deployment of AE and BI models
  • Monitoring and alerting tools for insights on AE performance
  • Work hands-on with ~20 teams, guiding them to adopt tools & data modelling approaches at scale (1000s of models!)
  • Fulltime
Read More
Arrow Right

Staff Data Ops Engineer - Platform

We are looking for a Staff Data Ops Engineer - Platform to join the Data & AI Pl...
Location
Location
France , Paris
Salary
Salary:
Not provided
doctolib.fr Logo
Doctolib
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience after graduation as a Staff Data Platform Engineer, or Staff Data Ops or Staff Site Reliability Engineer or in a similar role, with a history of architecting and scaling robust data platforms
  • Extensive experience with Google Cloud Platform and a command of Kubernetes & Terraform for automated deployments
  • Authority on implementing network and IAM security best practices
  • Deep technical proficiency in orchestrating data pipelines using Airflow or Dagster, deploying applications to the cloud, and leveraging modern data warehouses such as BigQuery
  • Highly skilled in programming with Python, and have a solid understanding of software development principles
  • Excellent troubleshooter who excels at diagnosing and fixing data infrastructure and identifying performance bottlenecks
  • Strong communicator who can articulate complex technical concepts to both technical and non-technical audiences
Job Responsibility
Job Responsibility
  • Design and implement enterprise-scale data infrastructure strategies, conducting thorough impact and cost analysis for major technical decisions, and establishing architectural standards across the organization
  • Build and optimize complex, multi-region data pipelines handling petabyte-scale datasets, ensuring 99.9% reliability and implementing advanced monitoring and alerting systems
  • Lead cost analysis initiatives, identify optimization opportunities across our data stack, and implement solutions that reduce infrastructure spend while improving performance and reliability
  • Provide technical guidance to data engineers and cross-functional teams, conduct architecture reviews, and drive adoption of best practices in DataOps, security, and governance
  • Evaluate emerging technologies, conduct proof-of-concepts for new data tools and platforms, and lead the technical roadmap for data infrastructure modernization
What we offer
What we offer
  • Free comprehensive health insurance for you and your children
  • Parent Care Program: receive one additional month of leave on top of the legal parental leave
  • Free mental health and coaching services through our partner Moka.care
  • For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
  • Work from EU countries and the UK for up to 10 days per year, thanks to our flexibility days policy
  • Work Council subsidy to refund part of sport club membership or creative class
  • Up to 14 days of RTT
  • A subsidy from the work council to refund part of the membership to a sport club or a creative class
  • Lunch voucher with Swile card
  • Fulltime
Read More
Arrow Right