CrawlJobs Logo

Senior Software Engineer, Streaming Platform

United States, San Francisco 190000.00 - 280000.00 USD / Year · Job Posted January 22, 2026
Apply Position
Job Link Share

Job Description

The Streaming Platform team at Sentry is building the next generation of infrastructure that powers our ingestion pipelines and real-time data processing systems. Our platform ingests, processes, and distributes hundreds of thousands of events per second with low latency and high reliability. We are creating a system that makes it easy for Sentry engineers to deploy and run streaming applications at scale by simplifying the complexity of Kafka, scaling consumers automatically, and managing state so product teams can focus on building great experiences for developers. As part of this team, you will work on challenges at the intersection of distributed systems, real-time data processing, and developer experience. You will help us create a self-service streaming platform that improves stability, accelerates time to production, and reduces operational overhead.

Job Responsibility

  • Design, build, and operate components of our Streaming Platform, including Kafka, the streaming runtime, high-level APIs, and developer-facing abstractions
  • Implement resilient, high-throughput stream processing systems that handle unbounded datasets with strong correctness guarantees (delivery, checkpointing, watermarking, and more)
  • Build scalable automation and control plane for Kafka fleet management and improve efficiency
  • Partner with product engineers to ensure our abstractions enable fast, reliable, and consistent ingestion pipelines
  • Improve observability, monitoring, and failover for mission-critical real-time systems

Requirements

  • 5+ years of software engineering experience, with background in distributed systems, data infrastructure, or real-time streaming
  • Proficiency in a programming language such as Python, Rust, Go, or Java (we primarily use Python and Rust, but experience in similar languages is valuable)
  • Experience with streaming technologies such as Kafka, Flink, Spark Streaming, or similar tools
  • Strong understanding of partitioning, watermarks, windowing, stateful/stateless processing, and delivery guarantees
  • Experience building and operating systems in cloud environments such as Kubernetes, AWS, or GCP

Nice to have

experience with ClickHouse, Arrow or other columnar data processing, or modern streaming SQL engines such as Materialize or RisingWave

What we offer

incentive compensation, equity grants, paid time off, and group health insurance coverage

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer, Streaming Platform

8 matching positions

Senior Software Engineer, Streaming Platform

The Streaming Platform team at Sentry is building the next generation of infrast...
Location
Location
United States , San Francisco
Salary
Salary:
190000.00 - 280000.00 USD / Year
sentry.io Logo
Sentry
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software engineering experience, with background in distributed systems, data infrastructure, or real-time streaming
  • Proficiency in a programming language such as Python, Rust, Go, or Java (we primarily use Python and Rust, but experience in similar languages is valuable)
  • Experience with streaming technologies such as Kafka, Flink, Spark Streaming, or similar tools
  • Strong understanding of partitioning, watermarks, windowing, stateful/stateless processing, and delivery guarantees
  • Experience building and operating systems in cloud environments such as Kubernetes, AWS, or GCP
Job Responsibility
Job Responsibility
  • Design, build, and operate components of our Streaming Platform, including Kafka, the streaming runtime, high-level APIs, and developer-facing abstractions
  • Implement resilient, high-throughput stream processing systems that handle unbounded datasets with strong correctness guarantees (delivery, checkpointing, watermarking, and more)
  • Build scalable automation and control plane for Kafka fleet management and improve efficiency
  • Partner with product engineers to ensure our abstractions enable fast, reliable, and consistent ingestion pipelines
  • Improve observability, monitoring, and failover for mission-critical real-time systems
What we offer
What we offer
  • incentive compensation
  • equity grants
  • paid time off
  • group health insurance coverage
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Streaming Platform

Adyen is looking for a Software Engineer to join our Streaming Platform team. Th...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
adyen.com Logo
Adyen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of backend engineering experience with strong knowledge of distributed systems
  • Deep understanding of Java, including util.concurrent and concurrency primitives, dependency injection principles
  • Good scripting skills and ability to pick up new languages
  • Deep understanding of stream processing concepts and hands-on experience with Apache Kafka Or Apache Flink
  • Experience with highly available/fault tolerant, replicated data storage systems, large scale data processing systems is a strong plus
  • Experience with using and building on Kubernetes is a strong plus
  • Infrastructure and Platform Experience
  • Ability to work in a fast-paced, collaborative, and dynamic environment
  • Excellent communication and interpersonal skills
Job Responsibility
Job Responsibility
  • Design, develop, and deploy scalable, high-performance streaming services and platforms primarily involving Apache Kafka and Apache Flink
  • Enhance the quality, reliability, and performance of our existing streaming infrastructure
  • Collaborate with cross-functional teams, including product engineers and other platform engineering teams, to build and deliver effective and scalable solutions
  • Drive the company-wide adoption of best practices for real-time data streaming and stream processing
  • Contribute to the strategic vision and roadmap for Adyen's streaming platform
  • Provide technical guidance and mentorship to other engineers within the team
  • Provide technical support to streaming platform customers
  • Participate in on-call rotations
Read More
Arrow Right

Senior Software Engineer and Software Engineer II

OneDrive and SharePoint are rapidly growing services at the center of Microsoft'...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Experience in related to cloud scale distributed design and patterns
  • The ability to deliver informed designs and plans ahead of production and execution
  • Knowledge of others' expertise and the ability to involve multiple players (within and outside the organization) in the creation or development of novel products, processes, or research streams
Job Responsibility
Job Responsibility
  • Design and deliver systems that enable partners and ISVs to migrate from other cloud providers, improve core systems performance and efficiencies, and ensure zero customer impact throughout the change management cycle
  • Deliver systems to meet our business continuity planning goals, provide telemetry for optimizing the service and drive our response time for detecting and resolving service issues down
  • Create, implement, optimize, debug, refactor, and reuses code to establish and improve performance and maintainability, effectiveness, and return on investment (ROI)
  • Contribue to the identification of dependencies, and the development of design documents for a product area with little oversight
  • Helps to identify other teams and technologies that will be leveraged, how they will interact, and when one's system may provide support to others
  • Contributes to determining back-end dependencies associated with product, application, service, or platform functionality for product features
  • Understands downstream effects of solutions and work provided
  • Helps to identify areas of dependency and overlap with other teams or team members and drives coordination
  • Remain current in skills by investing time and effort into staying abreast of current developments that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale
  • Reviews work items to deepen knowledge of product features in partnership with appropriate stakeholders (e.g., project managers) and executes project plans, release plans, and work items
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Streaming Apps

You will be part of the Roku Video Platform Engineering team and responsible for...
Location
Location
India , Bengaluru
Salary
Salary:
285000.00 - 345000.00 USD / Year
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong problem-solving and analytical abilities
  • 5+ years of solid programming experience and passionate about writing high-quality and well-architected code
  • Expert-level knowledge of FFmpeg or Gstreamer and their related toolchains (filters, flags, debugging, custom builds)
  • Experience with hardware-based encoder/decoder libraries (NVENC, Vulkan)
  • Strong understanding of compression theory, codec internals, GOP structures, bitrate control, etc
  • Experience with container formats: MP4, TS, fragmented MP4, ISOBMFF
  • Familiarity with HLS/DASH, CMAF, adaptive bitrate design, DRM, and SCTE 35
  • A track record working with applied AI-based video enhancement and compression algorithms (Super Resolution, Denoising, Artifact Removal)
  • Hands-on experience with cloud compute (AWS Lambda/ECS/Batch, GCP, Kubernetes, or similar)
  • Ability to handle periodic on-call duty as well as out-of-band requests
Job Responsibility
Job Responsibility
  • Design, build, optimize, and maintain FFmpeg-based encoding pipelines for both VOD and Live workflows, operating at scale in cloud environments such as AWS or GCP
  • Develop, refine, and validate encoding presets for modern codecs, including H.264, HEVC, and AV1, ensuring optimal quality-to-bitrate performance
  • Implement advanced encoding strategies such as multi-pass workflows, CRF tuning, per-title optimizations, and quality-targeted encoding
  • Benchmark and evaluate video quality using VMAF and other objective metrics to drive continuous improvements in efficiency and viewing experience
  • Build and maintain adaptive streaming packaging workflows, including HLS, DASH, and CMAF, ensuring broad device compatibility and reliable playback
  • Profile and optimize system performance by identifying and eliminating bottlenecks across compute, storage, and I/O layers
  • Write, review, and improve code, assessing architectural tradeoffs to deliver secure, high-performance, and highly concurrent video infrastructure services
  • Collaborate cross-functionally with engineering, product, and platform teams to support and advance company-wide video service initiatives
What we offer
What we offer
  • health insurance
  • equity awards
  • life insurance
  • disability benefits
  • parental leave
  • wellness benefits
  • paid time off
  • global access to mental health and financial wellness support and resources
  • commuter benefits
  • retirement options (401(k)/pension)
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Streaming Infrastructure

Join us in building the future of finance. Our mission is to democratize finance...
Location
Location
United States , Bellevue
Salary
Salary:
196000.00 - 230000.00 USD / Year
robinhood.com Logo
Robinhood
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience in software engineering, including building distributed systems at scale
  • A background in tools like Kafka, Flink and Debezium
  • Proficiency in designing and implementing event-driven architectures and stream processing systems
  • A passion for platform engineering and creating great experiences for other developers
  • Strong communication and collaboration skills to work across technical teams
Job Responsibility
Job Responsibility
  • Design and operate distributed data streaming platforms that scale to billions of events per day
  • Develop secure, performant, and highly reliable systems using technologies like Kafka, Flink, and Debezium
  • Collaborate closely with product, infrastructure, data, and ML teams to ensure the platform supports diverse use cases
  • Build tools and documentation to deliver a smooth, empowering experience for internal developers
  • Mentor and support other engineers to drive architectural decisions and long-term technical strategy
What we offer
What we offer
  • Performance-driven compensation with multipliers for outsized impact, bonus programs, equity ownership, and 401(k) matching
  • 100% paid health insurance for employees with 90% coverage for dependents
  • Lifestyle wallet — a highly flexible benefits spending account for wellness, learning, and more
  • Employer-paid life & disability insurance, fertility benefits, and mental health benefits
  • Time off to recharge including company holidays, paid time off, sick time, parental leave, and more
  • Exceptional office experience with catered meals, events, and comfortable workspaces
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Streaming Infrastructure

Join us in building the future of finance. Our mission is to democratize finance...
Location
Location
United States , Bellevue
Salary
Salary:
187000.00 - 220000.00 USD / Year
robinhood.com Logo
Robinhood
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience in software engineering, including building distributed systems at scale
  • A background in tools like Kafka, Flink and Debezium
  • Proficiency in designing and implementing event-driven architectures and stream processing systems
  • A passion for platform engineering and creating great experiences for other developers
  • Strong communication and collaboration skills to work across technical teams
Job Responsibility
Job Responsibility
  • Design and operate distributed data streaming platforms that scale to billions of events per day
  • Develop secure, performant, and highly reliable systems using technologies like Kafka, Flink, and Debezium
  • Collaborate closely with product, infrastructure, data, and ML teams to ensure the platform supports diverse use cases
  • Build tools and documentation to deliver a smooth, empowering experience for internal developers
  • Mentor and support other engineers to drive architectural decisions and long-term technical strategy
What we offer
What we offer
  • Performance-driven compensation with multipliers for outsized impact, bonus programs, equity ownership, and 401(k) matching
  • 100% paid health insurance for employees with 90% coverage for dependents
  • Lifestyle wallet — a highly flexible benefits spending account for wellness, learning, and more
  • Employer-paid life & disability insurance, fertility benefits, and mental health benefits
  • Time off to recharge including company holidays, paid time off, sick time, parental leave, and more
  • Exceptional office experience with catered meals, events, and comfortable workspaces
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Platform

We’re looking for a Senior Data Platform Engineer to help design and scale the f...
Location
Location
United States , Los Angeles
Salary
Salary:
180000.00 - 220000.00 USD / Year
geniussports.com Logo
Genius Sports
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation to successful production deployment
  • A product-minded approach—you understand how our software impacts user experience and business outcomes
  • Demonstrated mentorship and leadership experience, growing engineers and fostering a culture of technical excellence
  • Excellent collaboration and communication skills, with the ability to influence across teams
  • Broad expertise across the data systems engineering landscape, with deep experience in one or more of the following areas: Hands-on experience designing and operating modern data lakehouse systems (Iceberg, BigQuery, Clickhouse, etc.)
  • Expertise in distributed data processing and streaming architectures, including Spark, Pulsar, Kafka, and Flink, with a strong understanding of batch vs. real-time trade-offs
  • Experience working with large-scale datasets, including performance tuning, cost optimization, and observability in production environments
  • Solid understanding of data modeling, schema evolution, and data quality practices in distributed data platforms
Job Responsibility
Job Responsibility
  • Design, build, and maintain the Data Platform's foundational systems and features that enable internal teams to discover, access, and act on data quickly, reliably, and securely
  • Drive the modernization of our data infrastructure, navigating technical complexity and making sound architectural tradeoffs to strengthen our foundation and increase organizational productivity
  • Serve as a technical leader for large-scale Data Platform initiatives, driving architectural decisions and shaping engineering direction in close partnership with product and cross-functional stakeholders
  • Provide technical mentorship to junior and mid-level engineers, upskilling the team and preparing them to take on greater responsibilities
  • Stay up-to-date with emerging technologies and industry trends in data systems and platform development
What we offer
What we offer
  • Competitive salary
  • Range of benefits
  • Support for employee wellbeing
  • Help you grow your skills, experience and career
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Connect Platform

As a Senior Software Engineer, you will contribute to several key initiatives fo...
Location
Location
Canada , Remote, Ontario
Salary
Salary:
144200.00 - 169400.00 CAD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3-5 years of relevant software development experience
  • Proven track record of leading the delivery of large-scale, secure, highly available, low latency, high quality systems
  • Deep hands-on technical expertise in hyper-scale distributed systems engineering
  • Experience running production services in the cloud and being part of on call rotation
  • Expertise in cloud-native technology, including networking & security
  • Experience with Java, Kubernetes, and cloud platforms is highly valued
  • Strong collaboration skills and a growth mindset are essential, given the team’s cross-functional nature and focus on mentorship and operational excellence
  • Prior experience working on AWS, GCP, or Azure and a deep understanding of cloud best practices
  • Ability to influence the team, peers, and management using effective communication and collaborative techniques
  • Proven experience in leading and mentoring technical teams
Job Responsibility
Job Responsibility
  • Work with distributed systems, cloud-native development, and secure, scalable data integration
  • Architect a complex engineering system from end to end
  • Partner across engineering and other key stakeholders to create and execute the overall roadmap for delivering a top-notch Data Streaming Platform for our customers
  • Evaluate and enhance the efficiency of our platform’s technology stack, keeping pace with industry trends and adopting state-of-the-art solutions
  • Solve complicated technical projects with high quality and provide technical guidance to the team in specialized areas
  • Enhance the stability, performance, scalability, and operational excellence across multiple critical systems
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right