Staff Software Engineer, Data Platform Job at Scale (San Francisco)

Sr Staff Software Engineer (Data & Ai Platform)

We are looking for a talented and experienced Sr Staff Software Engineer to join...

Location

Israel , Petah Tikva

Salary:

Not provided

Palo Alto Networks

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field
At least 5 years of experience with Python
Minimum of 2 years of hands-on experience with AWS
Proven experience with the full Software Development Life Cycle (SDLC), including design, development, testing, and deployment
Excellent problem-solving skills and strong attention to detail
Ability to manage multiple projects simultaneously and strong organizational skills

Job Responsibility

Define and implement best practices for the R&D platform
Collaborate with internal and external stakeholders to understand requirements and deliver high-quality solutions
Work on edge technologies and cloud platforms to enhance our services
Participate in all phases of the SDLC, including design, development, testing, and deployment
Ensure high ROI on deliverables by optimizing processes and solutions
Share knowledge and best practices across the company to promote a culture of continuous improvement

Fulltime

Senior Staff Software Engineer: Data & Storage Platform

Uber’s Data Platform is the heart of the company’s critical decision-making and ...

Location

United States , Seattle; San Francisco; Sunnyvale

Salary:

267000.00 - 297000.00 USD / Year

Uber

Expiration Date

Until further notice

Requirements

14+ Years of Engineering Excellence: Proven experience designing and operating world-class distributed data and storage systems
Mastery of Storage Internals: Extensive storage experience is a must
Deep expertise in: Batch & Object Storage: HDFS, Cloud Object Storage (S3/GCS/OCI), and Blobstore metadata management
Storage Optimization: Practical experience with Apache Hudi or Apache Iceberg for lakehouse architectures
Transactional Systems: Experience with distributed transactional storage (e.g., Docstore, Google Spanner, TiDB)
NoSQL & Cache: Cassandra, Redis, and high-throughput Key-Value stores
Data + AI Convergence: Deep understanding of how compute fabrics (Spark, Flink, Ray) integrate with vector databases and model-serving platforms
Query Engine Proficiency: Architect-level knowledge of Presto, Trino, or Hive for large-scale analytical processing
Systems Programming: Expert-level command of Java, Go, Scala, or C++ with a focus on performance tuning and distributed consensus

Job Responsibility

Architect the Multi-Modal Fabric: Unify batch, streaming, and AI compute into one intelligent fabric, enabling real-time insights and trustworthy AI agents at a global scale
Revolutionize Storage & Catalog: Drive the architecture for a unified catalog and metadata management service for unstructured data, leveraging native cloud object store capabilities
Operationalize AI Intelligence: Partner with teams like QueryCopilot and DataIQ to bridge human validation with autonomous reasoning through agentic workflows
Lead Storage Modernization: Evolve our massive-scale persistence layers—including Docstore (Transactional Distributed Storage) and Distributed MySQL—to increase resiliency and reduce operational overhead
Open Source & Act as a force multiplier by contributing to the community (Hudi, Iceberg, Presto)

What we offer

Eligible to participate in Uber's bonus program
May be offered an equity award & other types of comp
All full-time employees are eligible to participate in a 401(k) plan
Eligible for various benefits

Fulltime

Staff Software Engineer (L4) Data Platform

We are seeking an experienced Staff Engineer to join our Data Substrate team. In...

Location

United States

Salary:

171120.00 - 213900.00 USD / Year

Stytch

Expiration Date

Until further notice

Requirements

Bachelor's or Master's degree in Computer Science, Engineering, or a related field
8+ years of experience in software development, or a related field
Proven track record of architecting and delivering complex data projects at scale, with a deep understanding of data infrastructure and distributed systems
Expertise in big data technologies such as Hadoop, Spark, Kafka, and other distributed computing systems
Experience designing, building, and operating large-scale systems using AWS technologies
Proficiency in programming languages such as Python, Java, or Scala, with strong problem-solving skills and attention to detail
Experience designing or working with Data Lakehouse architectures, including hands-on experience with Hudi, Iceberg, or Delta data formats
Excellent communication and collaboration skills, with the ability to influence technical decisions and drive alignment across teams
Strong leadership skills, with a track record of mentoring and developing junior engineers
Demonstrated ability to thrive in a fast-paced, dynamic environment and deliver results under tight timelines

Job Responsibility

Serve as a subject matter expert in distributed systems, data technologies, with strong software engineering skills
Architect and implement scalable and efficient data systems, storage solutions, and processing frameworks using state-of-the-art technologies
Drive technical innovation and research to stay at the forefront of emerging data technologies and best practices
Mentor and coach a team of talented engineers, fostering a culture of technical excellence, collaboration, and continuous learning
Collaborate closely with cross-functional teams to understand business requirements and translate them into scalable and efficient technical solutions
Ensure data quality, integrity, and security throughout the data lifecycle, adhering to industry best practices and compliance standards

Fulltime

Staff Software Engineer - Platform Engineer

You will have an opportunity to own the core platform of a company at hypergrowt...

Location

United States , San Francisco

Salary:

250000.00 - 325000.00 USD / Year

Nooks

Expiration Date

Until further notice

Requirements

GCP
Kubernetes
Datadog
Typescript / NodeJS
Python
Github Actions
PostgreSQL (≥intermediate)
Data pipeline experience

Job Responsibility

Own the core platform of a company at hypergrowth stage
Build out the foundations for the next 2-3 years
Have full autonomy and leadership opportunities to drive your own projects with plenty of 0-1 work

What we offer

Equity
Comprehensive health, dental, vision, life and disability insurance coverage
Hybrid work
Unlimited paid time off

Fulltime

Senior Staff Data Engineer- Data Platform

At Marktplaats, data is at the heart of everything we do, but Intelligence is wh...

Location

Netherlands , Amsterdam

Salary:

Not provided

Adevinta

Expiration Date

Until further notice

Requirements

10+ years of hands-on experience in Software Development or Data Engineering
at least 5+ years specifically focused on building Data Platforms
deep understanding of how Platform infra supports Analytics workloads
proven experience evolving complex platforms from legacy patterns to modern, cloud-native solutions
deep knowledge of Spark internals, JVM tuning, and performance optimization for high-scale batch and streaming datasets
deep expertise in Unity Catalog, Delta Lake internals, and optimizing high-volume workloads
strict software engineering discipline (CI/CD, Testing, OOP) applied to data pipelines
understanding of microservices architecture
understanding the needs of Analytics/DWH teams (Data Modeling, dbt)
strong background in building automated pipelines using Terraform/Terragrunt and ensuring system observability

Job Responsibility

Lead the evolution of our Data Platform and architect the "Data Exchange" strategy
define robust patterns for API-based ingestion, Event-Driven Architectures (Kafka), and Reverse ETL
ensure architectures are optimized for cost and performance on AWS
act as a catalyst for technical evolution
constantly scan the horizon for next-generation technologies
lead the implementation of new paradigms
design the strategy for Unity Catalog implementation and Data Contracts
champion FinOps, automating cost controls for our highest-volume workloads
build the underlying infrastructure that allows Analytics/DWH teams to run efficient transformations
elevate the technical bar of the team, mentoring Staff and Senior engineers

What we offer

An attractive Base Salary
Participation in our Short Term Incentive plan (annual bonus)
Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
A 24/7 Employee Assistance Program for you and your family
a collaborative environment with an opportunity to explore your potential and grow
a range of locally relevant benefits

Fulltime

Senior/Staff Software Engineer - Data Platform

Perplexity is looking for experienced Data Platform Engineers to design, build, ...

Location

United States , San Francisco, Seattle, New York City

Salary:

250000.00 - 385000.00 USD / Year

Perplexity

Expiration Date

Until further notice

Requirements

5+ years (Senior) or 8+ years (Staff) of software engineering experience
Strong experience building production data infrastructure systems
Hands-on experience with batch and/or streaming data processing at scale
Deep familiarity with data orchestration systems (Airflow, Dagster, or similar)
Proficiency in Python and at least one additional backend language (Go, TypeScript, etc.)
Strong systems thinking: you understand tradeoffs across reliability, latency, cost, and complexity
Experience supporting ML/AI workflows, training pipelines, or evaluation systems
Familiarity with data quality, lineage, observability, and governance tooling
Prior ownership of internal platforms used by many teams

Job Responsibility

Design and operate large-scale batch and streaming data pipelines supporting product features, AI training/evaluation, analytics, and experimentation
Build and evolve event-driven and streaming systems (e.g., Kafka/Kinesis/PubSub-style architectures) for real-time ingestion, transformation, and delivery
Own batch processing frameworks for backfills, aggregations, and offline computation
Lead the design and operation of data orchestration systems (e.g., Airflow, Dagster, or equivalent), including scheduling, dependency management, retries, SLAs, and observability
Establish strong guarantees around data correctness, freshness, lineage, and recoverability
Design systems that handle scale, partial failure, and evolving schemas
Build self-serve data platforms that empower engineers, data scientists, and analysts to safely create and operate pipelines
Improve developer experience for data work through better abstractions, tooling, documentation, and paved paths
Set standards for data modeling, testing, validation, and deployment
Drive architectural decisions across data infrastructure for storage, compute, orchestration, and APIs

What we offer

Equity
Health
Dental
Vision
Retirement
Fitness
Commuter and dependent care accounts

Fulltime