CrawlJobs Logo

Senior Software Engineer, Data Platform

United States, San Mateo 130000.00 - 280000.00 USD / Year · Job Posted January 06, 2026
Apply Position
Job Link Share

Job Description

As a member of our Infrastructure team, you will build data infrastructure, data pipeline and services to allow the teams to make data driven decisions, and ultimately put quality features into the hands of users. We emphasize tools over processes, automation over operation, metrics over anecdotes, iteration over perfection, and proactive over responsive.

Job Responsibility

  • Design and implement reliable, scalable and efficient data infrastructure to allow the team to gain insights and make quality data driven decisions
  • Work cross-functionally to build data products that allows other teams to gain insights and ultimately improve Verkada products and Verkada customer experience
  • Design and implement solutions to ensure data quality, security, and compliance
  • Lead whole projects from design to implementation
  • Help lead and grow junior engineers

Requirements

  • 5+ years of data engineering related development experience
  • Flexible and adaptive in a fast-paced startup environment
  • Passion for product quality and building systems to ship high quality releases
  • In-depth expertise in distributed systems and data processing
  • Experience with data infrastructure and data analytics

Nice to have

  • Experience with Kubernetes is preferred
  • Experience in data visualization and dashboard design is preferred

What we offer

  • Healthcare programs that can be tailored to meet the personal health and financial well-being needs - Premiums are 100% covered for the employee under at least one plan and 80% for family premiums under all plans
  • Nationwide medical, vision and dental coverage
  • Health Saving Account (HSA) with annual employer contributions and Flexible Spending Account (FSA) with tax saving options
  • Expanded mental health support
  • Paid parental leave policy & fertility benefits
  • Time off to relax and recharge through our paid holidays, firmwide extended holidays, flexible PTO and personal sick time
  • Professional development stipend
  • Fertility stipend
  • Wellness/fitness benefits
  • Healthy lunches provided daily
  • Commuter benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer, Data Platform

8 matching positions

Senior Software Engineer, Data Platform

We’re looking for a Senior Data Platform Engineer to help design and scale the f...
Location
Location
United States , Los Angeles
Salary
Salary:
180000.00 - 220000.00 USD / Year
geniussports.com Logo
Genius Sports
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation to successful production deployment
  • A product-minded approach—you understand how our software impacts user experience and business outcomes
  • Demonstrated mentorship and leadership experience, growing engineers and fostering a culture of technical excellence
  • Excellent collaboration and communication skills, with the ability to influence across teams
  • Broad expertise across the data systems engineering landscape, with deep experience in one or more of the following areas: Hands-on experience designing and operating modern data lakehouse systems (Iceberg, BigQuery, Clickhouse, etc.)
  • Expertise in distributed data processing and streaming architectures, including Spark, Pulsar, Kafka, and Flink, with a strong understanding of batch vs. real-time trade-offs
  • Experience working with large-scale datasets, including performance tuning, cost optimization, and observability in production environments
  • Solid understanding of data modeling, schema evolution, and data quality practices in distributed data platforms
Job Responsibility
Job Responsibility
  • Design, build, and maintain the Data Platform's foundational systems and features that enable internal teams to discover, access, and act on data quickly, reliably, and securely
  • Drive the modernization of our data infrastructure, navigating technical complexity and making sound architectural tradeoffs to strengthen our foundation and increase organizational productivity
  • Serve as a technical leader for large-scale Data Platform initiatives, driving architectural decisions and shaping engineering direction in close partnership with product and cross-functional stakeholders
  • Provide technical mentorship to junior and mid-level engineers, upskilling the team and preparing them to take on greater responsibilities
  • Stay up-to-date with emerging technologies and industry trends in data systems and platform development
What we offer
What we offer
  • Competitive salary
  • Range of benefits
  • Support for employee wellbeing
  • Help you grow your skills, experience and career
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Platform

We’re looking for a seasoned software engineer to join Parafin’s Infrastructure ...
Location
Location
United States , San Francisco
Salary
Salary:
230000.00 - 265000.00 USD / Year
parafin.com Logo
Parafin
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in software engineering with a strong background in data infrastructure, pipelines, and distributed systems
  • Advanced proficiency in Python and SQL
  • Hands-on Spark development experience
  • Expertise with modern cloud data stacks—AWS (S3, RDS), Databricks, and Airflow—and lakehouse architectures
  • Hands‑on experience with foundational data‑infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms), Delta Lake/Iceberg, and distributed query engines like Trino/Presto
  • Familiarity with ingestion frameworks, developer‑experience tooling, and best practices for data versioning, lineage, partitioning, and clustering
  • Strong problem-solving skills and a proactive attitude toward ownership and platform health
  • Excellent communication and collaboration skills, especially in cross-functional settings
Job Responsibility
Job Responsibility
  • Design and build robust, highly scalable data pipelines and lakehouse infrastructure with PySpark, Databricks, and Airflow on AWS
  • Improve the data platform development experience for Engineering, Data Science, and Product by creating intuitive abstractions, self‑service tooling, and clear documentation
  • Own and maintain core data pipelines and models that power internal dashboards, ML models, and customer-facing products
  • Own the Data & ML platform infrastructure using Terraform, including end‑to‑end administration of Databricks workspaces: manage user access, monitor performance, optimize configurations (e.g., clusters, lakehouse settings), and ensure high availability of data pipelines
  • Lead projects to improve data quality, testing, observability, and cost efficiency across existing pipelines and backend systems (e.g., migrating Databricks SQL pipelines to dbt, scaling data ingestion, improving data-lineage tracking, and enhancing monitoring)
  • Act as the primary engineering partner for the Data Science team—embedded closely to gather requirements, design scalable solutions, and provide end-to-end support on all engineering aspects of their work
  • Work closely with backend engineers and data scientists to design performant data models and support new product development initiatives
  • Share best practices and mentor other engineers working on data-centric systems
What we offer
What we offer
  • Equity grant
  • Medical, dental & vision insurance
  • Work from home flexibility
  • Unlimited PTO
  • Commuter benefits
  • Free lunches
  • Paid parental leave
  • 401(k)
  • Employee assistance program
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Platform

We are seeking a senior software engineer to help grow our data platform as Stra...
Location
Location
United States , San Francisco
Salary
Salary:
180000.00 - 200000.00 USD / Year
strava.com Logo
Strava
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience developing data-intensive software using languages like Python, Scala, Java, Go, or Ruby
  • Ability to evaluate and adopt new technologies as business needs evolve
  • Comfortable reading and reasoning about SQL queries in data pipeline contexts (e.g., dbt models)
  • Understanding how transformations impact downstream systems
  • Hands-on experience working with distributed data processing tools (e.g., Spark, Flink, Kafka) on production datasets
  • Understanding of tradeoffs and appropriate use cases for data processing tools
  • Experience building or maintaining data pipelines using cloud data warehouses (e.g., Snowflake, BigQuery, Redshift), Data lakes (e.g., Iceberg, Hudi) or similar solutions
  • Understanding of performance optimization and cost considerations
  • Understand the underlying infrastructure needed to serve production data platforms (e.g., Kubernetes, AWS, GCP, Azure)
  • Experience deploying and managing data infrastructure components like clusters, storage systems, and compute resources
Job Responsibility
Job Responsibility
  • Collaborate with people across teams and functions that hold deep curiosity for data
  • Work with hefty data systems at the global scale of Strava, supporting functions including analytics, AI/ML, engineering, and finance
  • Help strengthen our infrastructure as we grow
  • Deliver value more through software, leaning into tooling and automation rather than repetitive toil
  • Grow your expertise in the steadily evolving technologies and ecosystem of data
  • Building scalable software solutions to existing data problems utilizing modern data technologies
  • Writing high quality and reliable code that supports our end user experience
  • Understanding that data security and privacy is of utmost importance
  • Holding empathy for the users of our platform to truly understand the challenges we address for them
  • Fostering an inclusive and motivating team culture to help everyone achieve their best
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Platform

We are looking for an experienced software engineer to own, maintain, and evolve...
Location
Location
United States
Salary
Salary:
107000.00 - 120000.00 USD / Year
missionwired.com Logo
MissionWired
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive hands-on software engineering experience, with a strong track record of delivering production data pipelines or platforms in a mission critical environment
  • Strong experience with Python in production systems
  • Experience building and operating Databricks (or Spark) based pipelines
  • Experience with SQL
  • Experience with at least one major cloud infrastructure provider (GCP, AWS, Azure)
  • Experience with supporting business-critical systems with on-call ownership
  • Passion, energy, and excitement for progressive and philanthropic causes and all things digital
Job Responsibility
Job Responsibility
  • Joining each and every one of your colleagues in creating an inclusive workspace
  • Owning, maintaining, and supporting the reliability, architecture, and evolution of our production machine learning and delivery platform
  • Designing, operating, and improving large scale Databricks/Spark pipelines and workflows
  • Partner with our data scientists to productionize new data and ML-powered products
  • Leading improvements on the software integration layers between data pipelines and product workflows
  • Growing the team via mentorship and leadership, reviewing technical documents, improving code quality, and improving team performance and processes
  • Acting as a senior technical owner in debugging complex production issues and improving system observability
  • Collaborating with cross-functional teams to support their data infrastructure needs
What we offer
What we offer
  • 100% employer-paid premiums for platinum-level medical plan on a national health care network
  • 100% employer-paid life insurance and short term disability
  • 50% employer-paid vision and dental insurance
  • 401(k) with 3% employer contribution
  • 17 vacation days in addition to 12 paid holidays, sick days, bereavement leave, and a volunteer day off
  • Paid parental leave at 100% of your salary
  • Financial support for reproductive and transgender care
  • Flexible telecommute and remote work policies
  • Company issued Mac products for home offices
  • Cell phone service reimbursement, meal and ride-share reimbursement, and other perks available
  • Fulltime
Read More
Arrow Right

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Data Platform, AI Infrastructure

We are building a large-scale, productized data platform that powers critical in...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
  • Strong programming experience in Python
  • Experience building and operating large-scale distributed systems
  • Hands-on experience with: Backend services or APIs (e.g., FastAPI, Flask, or similar)
  • Cloud-based infrastructure (Azure, AWS, or GCP)
  • Monitoring and observability systems (metrics, logging, alerting)
  • Experience designing systems with reliability, scalability, and operational clarity in mind
  • Proven ability to own and deliver production systems end-to-end
  • Ability to break down ambiguous problems, ask the right questions, and execute effectively
Job Responsibility
Job Responsibility
  • Design, build, and operate core components of a distributed data platform, including: Orchestration systems (e.g., Airflow or equivalent)
  • Backend services and APIs (Python/FastAPI or similar)
  • Monitoring, alerting, and reliability systems
  • Own the end-to-end lifecycle of platform components - from design through deployment, scaling, and maintenance
  • Ensure systems meet requirements for availability, performance, and data reliability at large scale
  • Define and enforce standardized patterns for infrastructure, deployment, and observability across the platform
  • Partner with data engineering teams to enable efficient, reliable data processing workflows
  • Diagnose and resolve complex issues in distributed systems, including performance bottlenecks and failure modes
  • Contribute to infrastructure-as-code and deployment systems to support reproducibility and operational excellence
  • Drive continuous improvements in system robustness, cost efficiency, and operational clarity
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Data Platform

Help build the future of data by creating the technical "nervous system" of the ...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
multiverse.io Logo
Multiverse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant experience in commercial software (Python, TypeScript, and Go)
  • Passion for modular, readable code
  • Understanding of how to treat "data as software"
  • Comfortable with cloud-native tools (AWS/Azure, Kubernetes)
  • Ability to explain complex architectural choices to both product managers and engineers
Job Responsibility
Job Responsibility
  • Architect for growth: define and refactor data models to ensure they stay fast and clear as we scale
  • Create a universal data layer: build GraphQL APIs and connectors so anyone can access data safely
  • Enable GenAI: build infrastructure for Vector Databases and AI-driven automation
  • Automate safety: implement "Privacy by Design" by automating security checks
What we offer
What we offer
  • 27 days holiday
  • 5 additional days off: 1 life event day, 2 volunteer days, 2 company-wide wellbeing days
  • 8 bank holidays per year
  • Private medical Insurance with Bupa
  • Medical cashback scheme
  • Life insurance
  • Gym membership & wellness resources through Wellhub
  • Access to Spill - mental health support
  • Work-from-anywhere scheme - up to 10 days per year
  • Kitchen that's always stocked
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Data Platform

The Vibe team is a passionate, competitive bunch focused on one thing: allowing ...
Location
Location
France , Paris
Salary
Salary:
Not provided
vibe.co Logo
Vibe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong and successful experience as a Data Engineer or Software Engineer, with ownership over complex data systems
  • Proven ability to design scalable data architectures handling large volumes and complex computations
  • Solid knowledge of the big data ecosystem (batch and streaming)
  • Comfortable working in a cloud-native environment
  • Strong coding standards and attention to code quality
  • Perfect fluency in English
Job Responsibility
Job Responsibility
  • Data platform architecture & strategy: Envision the optimal architecture and operating model for Vibe’s data platform
  • Actively participate in the design and evolution of the company’s data stack
  • Make informed trade-offs between scalability, performance, reliability and cost
  • Data pipelines & processing: Design, build and operate batch and streaming data pipelines at scale
  • Handle large volumes of data generated by real-time systems
  • Ensure data freshness, correctness and availability across use cases
  • Data availability & enablement: Make data easily accessible wherever it is needed across the company
  • Work with other teams to understand data usage patterns and define the right solutions
  • Choose appropriate technologies and data models to support diverse analytical and product needs
  • Quality, reliability & cost control: Ensure high standards of data quality, monitoring and observability
What we offer
What we offer
  • Very competitive compensation (salary and stock-options/BSPCE)
  • Remote-first (in France or elsewhere) with the option to work on-site in an ultra-cozy coworking space in the heart of Paris (Morning Laffitte)
  • Health insurance (Alan)
  • Meal vouchers (Swile)
  • Two annual offsites
  • Guaranteed childcare placement
  • Fulltime
Read More
Arrow Right