CrawlJobs Logo

Staff Software Engineer, Search & Distributed Systems

acvauctions.com Logo

ACV Auctions

Location Icon

Location:
USA , Buffalo

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

165000.00 - 260000.00 USD / Year

Job Description:

We are looking for a Staff Software Engineer who would thrive on being accountable for our Search infrastructure: its scalability, reliability, and data resiliency. We don't just need someone who knows how to write a complex query; we need a battle-scarred Distributed Systems expert who understands the deep internals of Elasticsearch and who has a deep toolbox for analyzing, monitoring, alerting, and quickly resolving critical issues as they arise. You know exactly how Elasticsearch fails, why it fails under load, and how to architect a topology that prevents it. Because our search ecosystem doesn't exist in a vacuum, you will also own the architectural connective tissue—ensuring our service layers and event-based ecosystem interact with Search flawlessly. As a Staff Engineer, you will set the technical standard, drive systemic reliability, and mentor senior engineers across the organization.

Job Responsibility:

  • Architect for Scale: Design, configure, and scale our Elasticsearch clusters. You will define our global strategies for shard routing, Index Lifecycle Management (ILM), heap tuning, and data tiering to support massive auction throughput.
  • Master the Failure Modes: Anticipate and engineer away points of failure. You will design circuit breakers, implement backpressure mechanisms, and tune asymmetric timeouts to prevent retry storms between our BFFs, K8s services, and the Search layer.
  • Expert Troubleshooting & IR: Act as the ultimate technical escalation point for complex, cross-system performance degradation. You will dive deep into JVM metrics, Garbage Collection pauses, K8s network bottlenecks, and slow logs to uncover and remediate root causes.
  • Holistic System Ownership: Manage the entire data lifecycle. You will optimize the ingestion pipelines syncing our event datastreams driven by producers and consumers (Kafka) to Elasticsearch, ensuring eventual consistency and data integrity at scale.
  • Drive Engineering Excellence: Draft authoritative architectural Blueprints, SOPs, and Runbooks. You will elevate the surrounding engineering culture by coaching teams on distributed systems design, observability best practices, and incident management.
  • Modernize & Innovate: Scan the horizon for emerging technologies. You will help evaluate and integrate next-generation search capabilities (e.g., Vector Search, RAG architectures) to support our broader AI and machine learning initiatives.

Requirements:

  • 8+ years of software engineering experience, with at least 3+ years operating at a Senior or Staff level focusing on distributed systems and high-throughput platforms.
  • Deep, authoritative knowledge of Elasticsearch internals. You have managed large-scale clusters and deeply understand mapping, analysis, query optimization, cluster state management, and split-brain mitigation.
  • Proficiency in the systems upstream and downstream of Search. You have hands-on experience with Kubernetes (EKS/GKE), API Gateway/BFF architectures, and event streams (Kafka).
  • A proven track record of implementing fault-tolerant patterns (retries, rate limiting, circuit breaking, dead letter queues) in microservice architectures.
  • Expert-level ability to instrument systems and diagnose complex performance issues using modern observability stacks (Datadog, Prometheus, Grafana, OpenTelemetry).
  • Strong communication skills with a proven ability to influence cross-functional teams, build consensus around architectural decisions (the Knoster model!), and mentor mid-level and senior engineers.

Nice to have:

  • Experience with Infrastructure as Code (Terraform, Helm) for stateful applications.
  • Familiarity with FinOps practices, specifically optimizing Elasticsearch compute and storage costs.
  • Experience integrating AI-assisted development tools into your daily workflow.
What we offer:
  • Multiple medical plans including a high deductible, low cost health plan
  • Company-sponsored (paid) Short-Term Disability, Long-Term Disability, and Life Insurance
  • Comprehensive optional benefits such as Dental, Vision, Supplemental Life/AD&D, Legal/ID Protection, and Accident and Critical Illness Insurance
  • Generous paid time off options, including uncapped vacation days, the greater of 3 paid sick days or in accordance with the applicable state or local paid sick leave law, 6 paid company holidays, 2 floating holidays, parental leave, bereavement leave, jury duty leave, voting leave, and other forms of paid leave as required by applicable law or regulation
  • Employee Stock Purchase Program with additional opportunities to earn stock in the Company
  • Retirement planning through the Company's 401(k)

Additional Information:

Job Posted:
May 05, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Staff Software Engineer, Search & Distributed Systems

Staff Software Engineer (Backend)

Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://6sense.com Logo
6sense
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of industry experience, primarily within technology-focused organizations, with a preference for start-ups
  • Hands-on experience and deep understanding of working with large-scale datasets (10s of Millions of documents), highly scalable and available system architecture
  • Experience with in-memory cache eg. Redis, and distributed NoSql stores like Elastic Search, Cassandra, HBase, MongoDB, etc
  • Experience in one of the languages like Java, Python, and Scala is preferred
  • Ability to work with complex business flows and deal with huge amounts of data
  • Experience in building microservices and distributed systems preferred
What we offer
What we offer
  • health coverage
  • paid parental leave
  • generous paid time-off and holidays
  • quarterly self-care days off
  • stock options
  • equipment and support to work and connect with teams
  • numerous learning and development initiatives including access to LinkedIn Learning platform
  • quarterly wellness education sessions
  • wellness days
  • ERG-hosted events
  • Fulltime
Read More
Arrow Right

Staff Backend Software Engineer, Insights

Cresta Insights: As a Staff full-stack engineer, with a backend focus, you will ...
Location
Location
Romania , Bucharest; Cluj
Salary
Salary:
Not provided
cresta.com Logo
Cresta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Backend Engineer with a focus on database design and system architecture
  • Strong expertise in ClickHouse or similar columnar databases for managing large-scale, real-time analytical queries
  • Hands-on experience with Elasticsearch for indexing and searching large datasets
  • Proficient in backend programming languages such as Python, Go
  • Experience with RESTful API design and development
  • Solid understanding of distributed systems, microservices architecture, and cloud infrastructure
  • Experience with performance tuning, data modeling, and query optimization
  • Strong problem-solving skills and attention to detail
  • Excellent communication and teamwork abilities
Job Responsibility
Job Responsibility
  • Design, implement, and maintain backend services and APIs to support applications
  • Build and optimize data storage solutions using Postgres, ClickHouse and Elasticsearch to ensure high performance and scalability
  • Collaborate with cross-functional teams, including frontend engineers, data scientists, and machine learning engineers, to deliver end-to-end solutions
  • Monitor and troubleshoot performance issues in distributed systems and databases
  • Write clean, maintainable, and efficient code following best practices for backend development
  • Participate in code reviews, testing, and continuous integration efforts
  • Ensure security, scalability, and reliability of backend services
  • Analyze and improve system architecture, focusing on performance bottlenecks, scaling, and security
Read More
Arrow Right
New

Staff Software Developer, Search & Distributed Systems

If you are looking for a career at a dynamic company with a people-first mindset...
Location
Location
Canada , Toronto
Salary
Salary:
147000.00 - 220000.00 CAD / Year
acvauctions.com Logo
ACV Auctions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of software engineering experience, with at least 3+ years operating at a Senior or Staff level focusing on distributed systems and high-throughput platforms
  • Deep, authoritative knowledge of Elasticsearch internals. You have managed large-scale clusters and deeply understand mapping, analysis, query optimization, cluster state management, and split-brain mitigation
  • Proficiency in the systems upstream and downstream of Search. You have hands-on experience with Kubernetes (EKS/GKE), API Gateway/BFF architectures, and event streams (Kafka)
  • A proven track record of implementing fault-tolerant patterns (retries, rate limiting, circuit breaking, dead letter queues) in microservice architectures
  • Expert-level ability to instrument systems and diagnose complex performance issues using modern observability stacks (Datadog, Prometheus, Grafana, OpenTelemetry)
  • Strong communication skills with a proven ability to influence cross-functional teams, build consensus around architectural decisions (the Knoster model!), and mentor mid-level and senior engineers
Job Responsibility
Job Responsibility
  • Architect for Scale: Design, configure, and scale our Elasticsearch clusters. You will define our global strategies for shard routing, Index Lifecycle Management (ILM), heap tuning, and data tiering to support massive auction throughput
  • Master the Failure Modes: Anticipate and engineer away points of failure. You will design circuit breakers, implement backpressure mechanisms, and tune asymmetric timeouts to prevent retry storms between our BFFs, K8s services, and the Search layer
  • Expert Troubleshooting & IR: Act as the ultimate technical escalation point for complex, cross-system performance degradation. You will dive deep into JVM metrics, Garbage Collection pauses, K8s network bottlenecks, and slow logs to uncover and remediate root causes
  • Holistic System Ownership: Manage the entire data lifecycle. You will optimize the ingestion pipelines syncing our event datastreams driven by producers and consumers (Kafka) to Elasticsearch, ensuring eventual consistency and data integrity at scale
  • Drive Engineering Excellence: Draft authoritative architectural Blueprints, SOPs, and Runbooks. You will elevate the surrounding engineering culture by coaching teams on distributed systems design, observability best practices, and incident management
  • Modernize & Innovate: Scan the horizon for emerging technologies. You will help evaluate and integrate next-generation search capabilities (e.g., Vector Search, RAG architectures) to support our broader AI and machine learning initiatives
What we offer
What we offer
  • Company Sponsored (paid) Healthcare
  • Dental
  • Vision
  • Life/AD&D
  • Short-Term and Long-Term Disability
  • Comprehensive additional optional benefits such Critical Illness and Supplemental Life/AD&D
  • Generous Parental Leave Top-Up Pay and Vacation Programs
  • Employee Stock Purchase Program with additional opportunities to earn stock in the company
  • Retirement planning through the Company's RRSP
  • Fulltime
Read More
Arrow Right
New

Senior Staff Software Engineer (Search)

We are on a mission to build a reliable, fast, and scalable search for DoorDash....
Location
Location
United States , San Francisco, CA; Sunnyvale, CA; Seattle, WA
Salary
Salary:
231200.00 - 340000.00 USD / Year
doordash.com Logo
DoorDash
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S. or M.S. in Computer Science or equivalent
  • 10+ years of industry experience, with a track record of leading large-scale, high-impact components and systems
  • Proven ability to drive multi-quarter technical roadmaps as a technical lead, with clear ownership of architectural decisions
  • Deep expertise in distributed systems and data pipelines at scale. Expertise in search infrastructure, including indexing and serving stack
  • Strong understanding of ML systems, embedding-based retrieval, model serving tradeoffs, and multi-stage ranking architectures
  • Strong technical intuition paired with the ability to influence and align cross-functional stakeholders
  • Humility and growth mindset, leading through expertise and collaboration, not hierarchy
Job Responsibility
Job Responsibility
  • Lead at scale: Serve as the uber tech lead for Search, providing technical vision and architectural direction across the entire organization. Own a multi-year roadmap that spans multiple services and teams powering mission-critical products at DoorDash
  • Architect the next-generation search stack: Drive the rebuild of core search infrastructure, including indexing pipelines, embedding-based retrieval, and ML ranker serving in latency-sensitive paths. This stack will power both consumer search and agentic commerce experiences at DoorDash scale
  • Influence across teams: Drive alignment across ML, Infrastructure, Product, and partner engineering teams. Mentor staff and senior engineers across the search org to raise the bar of technical excellence
  • Shape engineering culture: Set the technical bar for how the search org designs, ships, and operates large-scale systems, and define the patterns that will outlast any single project
  • Hands-on problem solving: Dig into complex distributed systems challenges, from low-latency serving to indexing freshness tradeoffs, and write code that moves the needle
What we offer
What we offer
  • 401(k) plan with employer matching
  • 16 weeks of paid parental leave
  • wellness benefits
  • commuter benefits match
  • paid time off and paid sick leave in compliance with applicable laws
  • medical, dental, and vision benefits
  • 11 paid holidays
  • disability and basic life insurance
  • family-forming assistance
  • mental health program
  • Fulltime
Read More
Arrow Right

Senior Staff Software Engineer

As a Senior Staff Engineer, you will be a technical leader responsible for shapi...
Location
Location
India
Salary
Salary:
Not provided
bloomreach.com Logo
Bloomreach
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–12+ years of professional software engineering experience, with deep expertise in backend and distributed systems
  • Strong, hands-on experience building large-scale Search or Information Retrieval systems
  • Deep expertise in search relevance, ranking, and query/catalog understanding
  • Proven experience designing and operating distributed, low-latency systems at scale
  • Strong coding skills in Java and/or Python, with a focus on production-quality, maintainable systems
  • Experience working in cloud environments (AWS or GCP) and modern deployment platforms
  • Ability to lead technical initiatives across teams and influence without direct authority
  • Clear, effective communicator able to explain complex technical concepts and tradeoffs
Job Responsibility
Job Responsibility
  • Own and evolve core Search architecture, spanning indexing, retrieval, ranking, and query-time execution
  • Lead design and execution of large, cross-cutting search initiatives across multiple teams and services
  • Drive technical strategy for search relevance and ranking systems, balancing precision, recall, latency, and cost
  • Partner with Applied Science and ML teams to productionize ranking models and semantic retrieval techniques
  • Ensure search systems meet strict latency, availability, and scalability SLAs under real-world traffic
  • Act as a technical mentor and multiplier, raising the bar through design reviews, code reviews, and technical coaching
  • Influence roadmap and prioritization by articulating clear technical tradeoffs and long-term platform implications
  • Serve as a technical escalation point for complex production and architecture decisions
What we offer
What we offer
  • A great deal of freedom and trust
  • Flexible working hours
  • Work virtual-first with several Bloomreach Hubs available across three continents
  • Company events
  • 5 paid days off to volunteer
  • People Development Program
  • Communication coach available
  • Leader Development Program
  • $1,500 professional education budget annually
  • Employee Assistance Program with counselors
  • Fulltime
Read More
Arrow Right

Staff Software Engineer

The Discovery team sits at the core of Harmonic’s product and data engine. We ma...
Location
Location
United States , New York
Salary
Salary:
210000.00 - 280000.00 USD / Year
harmonic.ai Logo
Harmonic
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-8+ YoE building distributed systems or large scale backend architecture
  • Designed and scaled search, recommendation, or ranking systems that balance precision, recall, and performance
  • Led or heavily contributed to ML or LLM integrations in production
  • A track record of technical leadership mentoring others, introducing frameworks, and influencing technical direction
  • Strong experience with data-intensive systems, asynchronous processing, or event-driven architectures
Job Responsibility
Job Responsibility
  • Architect the core intelligence behind Scout
  • Own the end to end architecture of our sourcing engine from data ingestion, ranking, personalization, and model orchestration
  • Define scalable frameworks for retrieval, reranking, and LLM driven evaluation to ensure we deliver highly personalized and high quality results
  • Create architectural patterns that integrate Scout seamlessly with our existing products to power repeatable sourcing workflows
  • Lead agentic experimentation and evaluation
  • Drive technical discovery for emerging technologies (e.g. memory systems, schema, prompt libraries, embedding models, and agentic frameworks)
  • Improve and extend our evaluation pipelines to test new models and determine lifts in specific parts of our product
  • Build systems that allow fast iteration without compromising quality or reliability
  • Shape AI native product experiences
  • Partner with product and design to define patterns that make LLM powered sourcing intuitive and fast
What we offer
What we offer
  • Top of the line health, dental and vision insurance, with 100% premium covered
  • 401k matching
  • Free lunch in office
  • Monthly team dinner for each office
  • Commuter benefits
Read More
Arrow Right

Staff Software Engineer, Search Platform

As a vital member of the Search PlatformTeam, you will be part of a specialized ...
Location
Location
Singapore; China , Singapore; Shanghai
Salary
Salary:
Not provided
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • More than 7 years of back-end development experience
  • Have experience in developing large-scale distributed systems
  • Proficient in coding and scripting languages (Java(Kotlin) /C++ /Python, etc.) with strong software and system design abilities
  • Deep familiarity with the standard library, idiomatic usage, and best practices of your primary programming languages
  • Able to write clear, maintainable, and efficient code
  • In depth knowledge on storage & streaming over PostgreSQL or Kafka
Job Responsibility
Job Responsibility
  • Work closely with Product Managers to analyze the product requirements and then produce the technique solutions & execution plan to deliver the software products
  • Hands-on design, implement and deliver production-grade streaming ingestion using Flink (or similar technologies), focusing on low-latency, high-throughput, and fault-tolerant design
  • Tackle challenging problems in timely computation, stateful stream processing, partitioning, and resilience
  • Proactively troubleshooting and addressing technical bottlenecks
  • Participate in and contribute to critical code, design, and performance reviews, raising the technical bar across the team
  • Engage with the Technical leads in building a backlog that continuously contributes to the execution of the roadmap
  • Collaborate with local/global engineering teams, infrastructure teams, and product development teams and translate business requirements into robust engineering solutions
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, AI Agentic Search

We are seeking a Staff Software Engineer with 10+ years of experience to work in...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
notion.so Logo
Notion
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of fullstack engineering experience
  • Proven track record of execution
  • Experience building world-class product experiences
  • Experience shipping quality user interfaces with web technologies (HTML, CSS, JavaScript, modern UI framework like React)
  • Experience with distributed systems, data pipelines, vector databases, and production infrastructure
  • Ability to write clean code, take end-to-end ownership, and make pragmatic architectural decisions
  • Ability to mentor teammates
  • Thoughtful problem-solving approach
  • Ability to navigate ambiguity and decompose complex problems
  • Not ideological about technology
Job Responsibility
Job Responsibility
  • Build the end-to-end AI agentic search experience
  • Design and ship connectors from scratch, keeping third-party data continuously in sync
  • Build semantic search infrastructure powered by vector embeddings and efficient storage systems
  • Transform natural language questions into intelligent queries across multiple data sources
  • Implement ranking systems that surface the most relevant results while respecting user permissions and access controls
  • Scale to millions of documents across thousands of customers
  • Work with a team of engineers and cross-functional partners to define product strategy and drive execution
  • Build and maintain foundational pieces of Notion’s building blocks
  • Contribute to the overall performance, reliability, and robustness of the Notion product
  • Partner with engineering leaders to identify and execute against high leverage technical investment
  • Fulltime
Read More
Arrow Right