CrawlJobs Logo

Senior Software Engineer, Streaming Platform

sentry.io Logo

Sentry

Location Icon

Location:
United States , San Francisco

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

190000.00 - 280000.00 USD / Year

Job Description:

The Streaming Platform team at Sentry is building the next generation of infrastructure that powers our ingestion pipelines and real-time data processing systems. Our platform ingests, processes, and distributes hundreds of thousands of events per second with low latency and high reliability. We are creating a system that makes it easy for Sentry engineers to deploy and run streaming applications at scale by simplifying the complexity of Kafka, scaling consumers automatically, and managing state so product teams can focus on building great experiences for developers. As part of this team, you will work on challenges at the intersection of distributed systems, real-time data processing, and developer experience. You will help us create a self-service streaming platform that improves stability, accelerates time to production, and reduces operational overhead.

Job Responsibility:

  • Design, build, and operate components of our Streaming Platform, including Kafka, the streaming runtime, high-level APIs, and developer-facing abstractions
  • Implement resilient, high-throughput stream processing systems that handle unbounded datasets with strong correctness guarantees (delivery, checkpointing, watermarking, and more)
  • Build scalable automation and control plane for Kafka fleet management and improve efficiency
  • Partner with product engineers to ensure our abstractions enable fast, reliable, and consistent ingestion pipelines
  • Improve observability, monitoring, and failover for mission-critical real-time systems

Requirements:

  • 5+ years of software engineering experience, with background in distributed systems, data infrastructure, or real-time streaming
  • Proficiency in a programming language such as Python, Rust, Go, or Java (we primarily use Python and Rust, but experience in similar languages is valuable)
  • Experience with streaming technologies such as Kafka, Flink, Spark Streaming, or similar tools
  • Strong understanding of partitioning, watermarks, windowing, stateful/stateless processing, and delivery guarantees
  • Experience building and operating systems in cloud environments such as Kubernetes, AWS, or GCP

Nice to have:

experience with ClickHouse, Arrow or other columnar data processing, or modern streaming SQL engines such as Materialize or RisingWave

What we offer:

incentive compensation, equity grants, paid time off, and group health insurance coverage

Additional Information:

Job Posted:
January 22, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Software Engineer, Streaming Platform

Senior Principal Data Platform Software Engineer

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a k...
Location
Location
Salary
Salary:
239400.00 - 312550.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
  • Demonstrated experience building and operating data platforms or large‑scale data services in production
  • Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
  • Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
  • Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
  • Strong programming skills in one or more of: Kotlin, Scala, Java, Python
  • Experience leading cross‑team technical initiatives and influencing senior stakeholders
  • Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
  • Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
  • Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
  • Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
  • Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
  • Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
  • Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
  • Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
  • Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
  • Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Wikidata Platform

The Wikimedia Foundation is seeking a Senior Software Engineer to join the team ...
Location
Location
Salary
Salary:
141352.00 - 175725.00 USD / Year
wikimediafoundation.org Logo
Wikimedia Foundation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience as a backend or platform engineer working on distributed systems or data platforms
  • Deep understanding of database and knowledge graph representation technologies and standards
  • Proficiency in Java, C++, or other systems languages. Ability to set up, scale, and investigate systems is more important than expertise in a particular language.
  • Experience building and operating production-grade services with SLOs
  • Familiarity with modern observability tools (metrics, logging, tracing)
  • Understanding of graph databases, search indexes, or data processing pipelines
  • Ability to work collaboratively across disciplines and communicate clearly across technical and non-technical audiences
  • A commitment to learning, resilience, and contributing to a mission-driven engineering culture
Job Responsibility
Job Responsibility
  • Design, build, and maintain backend systems and APIs that power Wikidata’s query infrastructure
  • Improve reliability, observability, and automation of the Wikidata Query Service and data pipelines
  • Collaborate with SRE, data engineers, and product teams to ensure stability and scalability under growing usage
  • Monitor production systems, respond to operational incidents, and proactively identify and resolve bottlenecks
  • Support platform migrations and system upgrades (e.g., triple stores, streaming ingestion)
  • Contribute to deployment automation, CI/CD workflows, and service instrumentation
  • Participate in code reviews, design discussions, and technical planning
  • Document systems and share knowledge with team members and Wikimedia’s broader technical community
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Experience Platform Team

The Experience Platform team is looking for a full-stack/backend software engine...
Location
Location
United States , New York City
Salary
Salary:
Not provided
pinecone.io Logo
Pinecone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of experience in full-stack or backend development (NodeJS, Rust, Python, or Go)
  • Experience with queueing and streaming technologies like Kafka, Kinesis, or Pub/Sub
  • Familiarity with creating web interfaces with React or other frontend frameworks
  • Expertise in event-driven system design and distributed systems principles
  • Proficiency in building reliable data processing pipelines for usage tracking and reconciliation
  • Familiarity with integrating third-party APIs and handling inconsistent data
  • Hands-on experience with one or more major cloud providers (AWS, GCP, Azure), especially services related to data streaming, serverless compute, and data storage
  • Strong understanding of RESTful API design
Job Responsibility
Job Responsibility
  • Design event-driven architectures and distributed systems for reliable real-time and batch event processing
  • Develop queueing and streaming systems (e.g., Kafka, Kinesis) with robust event handling mechanisms
  • Build pipelines for ingesting, transforming, and aggregating usage data, ensuring accuracy and reliability
  • Integrate with external APIs and vendor systems, designing for resiliency against outages or inconsistent data
  • Create auditable and observable systems with monitoring, alerting, and verification mechanisms
  • Implement end-to-end user experiences across multiple services and web applications
What we offer
What we offer
  • Comprehensive health coverage including medical, dental, vision, and mental health resources
  • 401(k) Plan
  • Equity award
  • Flexible time off
  • Paid parental leave
  • Annual Company Retreat
  • WFH Equipment Stipend
Read More
Arrow Right

Senior Software Engineer

AnaVation is seeking a highly skilled Senior Software Engineer to join our team ...
Location
Location
United States , Chantilly
Salary
Salary:
Not provided
anavationllc.com Logo
AnaVation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Software Engineering, or related field
  • Minimum of 8 years of experience in software engineering
  • Active Top Secret (TS) clearance with eligibility for Sensitive Compartmented Information (SCI)
  • Experience with SAFe Agile framework
  • Strong understanding of forensic and investigative system requirements
  • Demonstrated experience designing and implementing complex software solutions in secure government environments
  • Advanced proficiency with: One or more programming languages: Java, .NET(C#), Python
  • Complex system architecture design
  • Message brokers such as RabbitMQ, Kafka, and Redis
  • Elasticsearch, Splunk, and other data platforms
Job Responsibility
Job Responsibility
  • Design, develop, test, and manage application development projects in support of IT infrastructure
  • Integrate third-party components and introduce new custom capabilities
  • Modify existing code and recommend process improvements
  • Automate operations and maintenance tasks
  • Develop and implement technical efforts for large-scale data processing and advanced analytics
  • Participate in all aspects of the software development life cycle
  • Contribute to planning, requirements, development, testing, and quality assurance
  • Participate in technical project milestone reviews and code architecture sessions
  • Provide resource estimation and development best practices knowledge transfer
  • Participate in Program Increments (PIs) and Agile Release Train (ART) activities
What we offer
What we offer
  • Generous cost sharing for medical insurance for the employee and dependents
  • 100% company paid dental insurance for employees and dependents
  • 100% company paid long-term and short term disability insurance
  • 100% company paid vision insurance for employees and dependents
  • 401k plan with generous match and 100% immediate vesting
  • Competitive Pay
  • Generous paid leave and holiday package
  • Tuition and training reimbursement
  • Life and AD&D Insurance
  • Fulltime
Read More
Arrow Right

Senior Software Engineering Manager - Digital Engineering

Senior Engineering Manager of Digital Engineering responsible for leading back-e...
Location
Location
United States
Salary
Salary:
106605.00 - 260590.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • 7+ years of software development experience with focus on enterprise-level solutions and cloud technologies
  • 2+ years of experience leading large cross-functional project management initiatives including microservices, event-driven architectures, and streaming platforms like Apache Kafka
  • 2+ years of experience with Agile/Scrum practices
  • Bachelor's Degree in Computer Science or related field, or equivalent experience
Job Responsibility
Job Responsibility
  • Leading back-end engineering teams in creating exceptional member experiences
  • Identifying, prioritizing, and shaping complex enterprise initiatives with business stakeholders
  • Guiding teams of engineers in delivering digital services that enhance healthcare's cost transparency
  • Overseeing migration of data and services from legacy infrastructure to cloud
  • Integrating emerging AI and agentic technologies to improve offerings
  • Providing leadership, coaching, and strategic guidance to application development teams
  • Leading digital engineering teams responsible for back-end service development, data migration, micro-services, and emerging AI technologies
  • Influencing strategic roadmaps for future initiatives
  • Collaborating with business partners to ensure alignment with business initiatives and objectives
What we offer
What we offer
  • Affordable medical plan options
  • 401(k) plan with matching company contributions
  • Employee stock purchase plan
  • No-cost wellness screenings
  • Tobacco cessation and weight management programs
  • Confidential counseling and financial coaching
  • Paid time off
  • Flexible work schedules
  • Family leave
  • Dependent care resources
  • Fulltime
Read More
Arrow Right

Senior Manager, Software Engineering (Orchestration Services)

The Data and Storage Services team is responsible for handling all of Affirm’s D...
Location
Location
United States
Salary
Salary:
232000.00 - 310000.00 USD / Year
affirm.com Logo
Affirm
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid leadership and interpersonal skills
  • 10+ years of experience in managing multiple diverse and inclusive teams and delivering large cross-functional technical programs
  • Proven track record in stakeholder management, ownership, and successful delivery
  • Expertise in managing large-scale, geographically distributed compute and data processing systems, including data lake solutions and Workflow Orchestration frameworks
  • Expertise in scaling frameworks like Spark, Flink and, Kafka on Kubernetes and cloud providers like AWS, leveraging storage systems such as AWS S3 and Apache Iceberg
  • Capable of mentorship, cross-functional project execution, and individual contribution
  • Strong interpersonal, written, and verbal communication skills with a growth mindset
  • Experience in the data infrastructure domain and a passion for leading technical teams and contributing to Open Source solutions
  • Bachelor’s degree in Computer Science, related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Lead a team of engineers and managers with empathy while fostering a high-performance, ownership-driven & inclusive culture to develop frameworks, systems, and tools for new Affirm products
  • Oversee teams managing storage services including relational, key-value, and analytics storage infrastructure and tools at scale
  • Understand and drive business and engineering metrics, promoting a culture of reliability, security, and productivity
  • Collaborate with tech leads, program managers, and other engineering managers on security, tools, architecture, planning, and delivery of multiple concurrent projects
  • Work across the engineering organization and with internal and external partners
  • Provide leadership and growth opportunities to team members, mentor engineers, recruit, and represent Affirm hiring brands
  • Lead technical decisions, projects, and roadmaps within the Batch and Streaming teams, shaping Affirm’s strategy for managing and serving orchestration workloads
  • Collaborate with peers, leadership, and stakeholders across platform engineering and product engineering organizations
  • In collaboration with tech leads, develop a multi year roadmap to design and implement frameworks, services, and tools for new Affirm products and business needs
  • Guide, tutor, and aid in the professional growth of junior and senior engineers within the team
What we offer
What we offer
  • Health care coverage - Affirm covers all premiums for all levels of coverage for you and your dependents
  • Flexible Spending Wallets - generous stipends for spending on Technology, Food, various Lifestyle needs, and family forming expenses
  • Time off - competitive vacation and holiday schedules allowing you to take time off to rest and recharge
  • ESPP - An employee stock purchase plan enabling you to buy shares of Affirm at a discount
  • Fulltime
Read More
Arrow Right

Senior Manager, Software Engineering (Orchestration Services)

The Data and Storage Services team is responsible for handling all of Affirm’s D...
Location
Location
Canada
Salary
Salary:
206000.00 - 256000.00 CAD / Year
affirm.com Logo
Affirm
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid leadership and interpersonal skills
  • 10+ years of experience in managing multiple diverse and inclusive teams and delivering large cross-functional technical programs
  • Proven track record in stakeholder management, ownership, and successful delivery
  • Expertise in managing large-scale, geographically distributed compute and data processing systems, including data lake solutions and Workflow Orchestration frameworks
  • Expertise in scaling frameworks like Spark, Flink and, Kafka on Kubernetes and cloud providers like AWS, leveraging storage systems such as AWS S3 and Apache Iceberg
  • Capable of mentorship, cross-functional project execution, and individual contribution
  • Strong interpersonal, written, and verbal communication skills with a growth mindset
  • Experience in the data infrastructure domain and a passion for leading technical teams and contributing to Open Source solutions
  • Bachelor’s degree in Computer Science, related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Lead a team of engineers and managers with empathy while fostering a high-performance, ownership-driven & inclusive culture to develop frameworks, systems, and tools for new Affirm products
  • Oversee teams managing storage services including relational, key-value, and analytics storage infrastructure and tools at scale
  • Understand and drive business and engineering metrics, promoting a culture of reliability, security, and productivity
  • Collaborate with tech leads, program managers, and other engineering managers on security, tools, architecture, planning, and delivery of multiple concurrent projects
  • Work across the engineering organization and with internal and external partners
  • Provide leadership and growth opportunities to team members, mentor engineers, recruit, and represent Affirm hiring brands
  • Lead technical decisions, projects, and roadmaps within the Batch and Streaming teams, shaping Affirm’s strategy for managing and serving orchestration workloads
  • Collaborate with peers, leadership, and stakeholders across platform engineering and product engineering organizations
  • In collaboration with tech leads, develop a multi year roadmap to design and implement frameworks, services, and tools for new Affirm products and business needs
  • Guide, tutor, and aid in the professional growth of junior and senior engineers within the team
What we offer
What we offer
  • Health care coverage - Affirm covers all premiums for all levels of coverage for you and your dependents
  • Flexible Spending Wallets - generous stipends for spending on Technology, Food, various Lifestyle needs, and family forming expenses
  • Time off - competitive vacation and holiday schedules allowing you to take time off to rest and recharge
  • ESPP - An employee stock purchase plan enabling you to buy shares of Affirm at a discount
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Network Enablement (Applied ML)

We build simple yet innovative consumer products and developer APIs that shape h...
Location
Location
United States , San Francisco
Salary
Salary:
180000.00 - 270000.00 USD / Year
plaid.com Logo
Plaid
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong software engineering skills including systems design, APIs, and building reliable backend services (Go or Python preferred)
  • Production experience with batch and streaming data pipelines and orchestration tools such as Airflow or Spark
  • Experience building or operating real-time scoring and online feature-serving systems, including feature stores and low-latency model inference
  • Experience integrating model outputs into product flows (APIs, feature flags) and measuring impact through experiments and product metrics
  • Experience with model lifecycle and operations: model registries, CI/CD for models, reproducible training, offline & online parity, monitoring and incident response
Job Responsibility
Job Responsibility
  • Embed model inference into Network Enablement product flows and decision logic (APIs, feature flags, backend flows)
  • Define and instrument product + ML success metrics (fraud reduction, retention lift, false positives, downstream impact)
  • Design and run experiments and rollout plans (backtesting, shadow scoring, A/B tests, feature-flagged releases) to validate product hypotheses
  • Build and operate offline training pipelines and production batch scoring for bank intelligence products
  • Ship and maintain online feature serving and low-latency model inference endpoints for real-time partner/bank scoring
  • Implement model CI/CD, model/version registry, and safe rollout/rollback strategies
  • Monitor model/data health: drift/regression detection, model-quality dashboards, alerts, and SLOs targeted to partner product needs
  • Ensure offline and online parity, data lineage, and automated validation / data contracts to reduce regressions
  • Optimize inference performance and cost for real-time scoring (batching, caching, runtime selection)
  • Ensure fairness, explainability and PII-aware handling for partner-facing ML features
What we offer
What we offer
  • medical
  • dental
  • vision
  • 401(k)
  • equity
  • commission
  • Fulltime
Read More
Arrow Right