CrawlJobs Logo

Staff Software Engineer (Kafka Streaming)

India, Bengaluru · Job Posted February 17, 2026
Apply Position
Job Link Share

Job Description

We are building our next-generation Data Enrichment Platform and we need a heavy hitter to help us scale. We aren't just moving data; we are building the real-time engine that powers our business. As a core member of our engineering team, you will architect high-throughput pipelines, solve complex latency challenges, and define the standards for a robust Lakehouse architecture. If you obsess over JVM internals, distributed consistency, and Exactly-Once semantics, this is the role for you.

Job Responsibility

  • Architect high-throughput pipelines
  • Solve complex latency challenges
  • Define standards for a robust Lakehouse architecture
  • Lead design of distributed streaming architectures using Kafka Streams, Spark, and Flink
  • Build roadmap for transition to Lakehouse architecture
  • Dive deep to identify system bottlenecks
  • Own stability of pipelines processing massive events per second
  • Solve for data integrity and low latency
  • Drive culture of reliability through robust monitoring (Datadog/Prometheus), observability, and automated testing frameworks
  • Proactively identify opportunities to refactor and modernize platform for efficiency and cost-effectiveness

Requirements

  • 8+ years of software engineering experience
  • At least 5 years of deep production expertise in Scala or Java (concurrency, memory management, GC tuning)
  • Deep JVM knowledge required
  • 5+ years hands-on with the Kafka ecosystem (Apache Kafka, Kafka Streams, Kafka Connect, Flink, Spark)
  • Proven track record of designing resilient systems under heavy load
  • Mastery of the AWS ecosystem (MSK, EMR, Athena, Lambda)
  • Experience with Terraform
  • Experience with Kubernetes

What we offer

  • Competitive salary
  • Insurance
  • Annual leave
  • Bonuses
  • Referral rewards

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Staff Software Engineer (Kafka Streaming)

8 matching positions

Staff Software Engineer (Kafka Streaming)

Location
Location
India , Bengaluru
Salary
Salary:
Not provided
bazaarvoice.com Logo
Bazaarvoice
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • How many years of experience do you have in Kafka Streams, Spark, and Flink?
  • How many years of experience do you have in Scala or Java?
Read More
Arrow Right

Staff Software Engineer

We’re looking for a Staff Software Engineer with a passion for solving problems ...
Location
Location
United States , San Francisco
Salary
Salary:
163500.00 - 218000.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 8+ years of professional software engineering/development experience
  • Extensive hands-on experience and expertise in object-oriented design methodology and application development using Java/J2EE, Design Patterns, Spring MVC, SQL, Web services
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
  • Agile development (Scrum, XP, or Pair Programming) experience
  • Ability to use a wide variety of open-source technologies and cloud services
Job Responsibility
Job Responsibility
  • Support development of Java microservices/Libraries while integrating with various AI platforms for Onetrust’s AI Governance product
  • It will involve the designing, development, and unit testing of applications deployed to MS Azure with cloud application architecture using Core Java, REST, and the Spring ecosystem
  • Achieve at least 80% code coverage or per the revised standards set by the team
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team’s discussions on system architecture and component design
  • Support the team to ensure all committed stories for the sprint are completed per the sprint goal
  • Work toward reducing total number of defects in the module/product to industry standards by catching and fixing issues early in development
  • Ensure critical and high priority CII’s are delivered per SLA
  • Conduct peer reviews to improve code quality
  • Help junior developers follow development testing, exploratory testing, AI testing and/or test automation
  • Help build high-performing teams by mentoring the team on new technical skills
What we offer
What we offer
  • comprehensive healthcare coverage
  • flexible PTO
  • equity RSUs
  • annual performance bonus opportunities
  • retirement account support
  • 14+ weeks of paid parental leave
  • career development opportunities
  • company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Staff Software Engineer

OneTrust’s mission is to enable innovation through the responsible use of data a...
Location
Location
United States , Atlanta
Salary
Salary:
139725.00 - 209587.50 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 8+ years of professional software engineering/development experience
  • Extensive hands-on experience and expertise in object-oriented design methodology and application development using Java/J2EE, Design Patterns, Spring MVC, SQL, Web services
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
  • Agile development (Scrum, XP, or Pair Programming) experience
  • Ability to use a wide variety of open-source technologies and cloud services
Job Responsibility
Job Responsibility
  • Support development of Java microservices/Libraries while integrating with various AI platforms for Onetrust’s AI Governance product
  • Design, develop, and unit test applications deployed to MS Azure with cloud application architecture using Core Java, REST, and the Spring ecosystem
  • Achieve at least 80% code coverage or per the revised standards set by the team
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team’s discussions on system architecture and component design
  • Support the team to ensure all committed stories for the sprint are completed per the sprint goal
  • Work toward reducing total number of defects in the module/product to industry standards
  • Ensure critical and high priority CII’s are delivered per SLA
  • Conduct peer reviews to improve code quality
  • Help junior developers follow development testing, exploratory testing, AI testing and/or test automation
  • Help build high-performing teams by mentoring the team on new technical skills
What we offer
What we offer
  • Comprehensive healthcare coverage
  • Flexible PTO
  • Equity RSUs
  • Annual performance bonus opportunities
  • Retirement account support
  • 14+ weeks of paid parental leave
  • Career development opportunities
  • Company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Staff Software Engineer (L4)

As a Staff Engineer on the Twilio Segment Data platform/ pipelines team, you’ll ...
Location
Location
India
Salary
Salary:
Not provided
stytch.com Logo
Stytch
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • Hands-on experience with high-scale messaging/streaming systems (several thousand events/sec) and processing engines ( 1M+ events/sec).
  • 8+ years of experience writing production-grade code in a modern programming language
  • Strong theoretical fundamentals and hands-on experience designing and implementing highly available and performant fault-tolerant distributed systems.
  • Experience programming in one or more of the following: Go, Java, Scala, or similar languages
  • Well-versed in concurrent programming, along with a solid grasp of Linux systems and networking concepts.
  • Experience operating large-scale, distributed systems on top of cloud infrastructure such as Amazon Web Services (AWS) or Google Cloud Platform (GCP)
  • Experience in message passing systems (e.g., Kafka, AWS Kinesis) and/or modern stream processing systems (e.g., Spark, Flink).
  • Have hands-on experience with container orchestration frameworks (e.g. Kubernetes, EKS, ECS)
  • Leverage best-in-class development productivity practices including AI tooling.
Job Responsibility
Job Responsibility
  • Design and deliver robust, high-scale routing experiences for the Data platform/ pipelines team for Twilio Segment.
  • Ship features that opt for high availability and throughput with eventual consistency
  • Collaborate with engineering and product leads, as well as teams across Twilio Segment
  • Support the reliability and security of the platform
  • Build and optimize globally available and highly scalable distributed systems
  • Be able to act as a team Tech Lead as needed
  • Mentor other engineers on the team in technical architecture and design
  • Partner with application teams to deliver end to end customer success.
What we offer
What we offer
  • Competitive pay
  • generous time off
  • ample parental and wellness leave
  • healthcare
  • retirement savings program
  • and much more.
Read More
Arrow Right

Staff Software Engineer, Search & Distributed Systems

We are looking for a Staff Software Engineer who would thrive on being accountab...
Location
Location
USA , Buffalo
Salary
Salary:
165000.00 - 260000.00 USD / Year
acvauctions.com Logo
ACV Auctions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of software engineering experience, with at least 3+ years operating at a Senior or Staff level focusing on distributed systems and high-throughput platforms.
  • Deep, authoritative knowledge of Elasticsearch internals. You have managed large-scale clusters and deeply understand mapping, analysis, query optimization, cluster state management, and split-brain mitigation.
  • Proficiency in the systems upstream and downstream of Search. You have hands-on experience with Kubernetes (EKS/GKE), API Gateway/BFF architectures, and event streams (Kafka).
  • A proven track record of implementing fault-tolerant patterns (retries, rate limiting, circuit breaking, dead letter queues) in microservice architectures.
  • Expert-level ability to instrument systems and diagnose complex performance issues using modern observability stacks (Datadog, Prometheus, Grafana, OpenTelemetry).
  • Strong communication skills with a proven ability to influence cross-functional teams, build consensus around architectural decisions (the Knoster model!), and mentor mid-level and senior engineers.
Job Responsibility
Job Responsibility
  • Architect for Scale: Design, configure, and scale our Elasticsearch clusters. You will define our global strategies for shard routing, Index Lifecycle Management (ILM), heap tuning, and data tiering to support massive auction throughput.
  • Master the Failure Modes: Anticipate and engineer away points of failure. You will design circuit breakers, implement backpressure mechanisms, and tune asymmetric timeouts to prevent retry storms between our BFFs, K8s services, and the Search layer.
  • Expert Troubleshooting & IR: Act as the ultimate technical escalation point for complex, cross-system performance degradation. You will dive deep into JVM metrics, Garbage Collection pauses, K8s network bottlenecks, and slow logs to uncover and remediate root causes.
  • Holistic System Ownership: Manage the entire data lifecycle. You will optimize the ingestion pipelines syncing our event datastreams driven by producers and consumers (Kafka) to Elasticsearch, ensuring eventual consistency and data integrity at scale.
  • Drive Engineering Excellence: Draft authoritative architectural Blueprints, SOPs, and Runbooks. You will elevate the surrounding engineering culture by coaching teams on distributed systems design, observability best practices, and incident management.
  • Modernize & Innovate: Scan the horizon for emerging technologies. You will help evaluate and integrate next-generation search capabilities (e.g., Vector Search, RAG architectures) to support our broader AI and machine learning initiatives.
What we offer
What we offer
  • Multiple medical plans including a high deductible, low cost health plan
  • Company-sponsored (paid) Short-Term Disability, Long-Term Disability, and Life Insurance
  • Comprehensive optional benefits such as Dental, Vision, Supplemental Life/AD&D, Legal/ID Protection, and Accident and Critical Illness Insurance
  • Generous paid time off options, including uncapped vacation days, the greater of 3 paid sick days or in accordance with the applicable state or local paid sick leave law, 6 paid company holidays, 2 floating holidays, parental leave, bereavement leave, jury duty leave, voting leave, and other forms of paid leave as required by applicable law or regulation
  • Employee Stock Purchase Program with additional opportunities to earn stock in the Company
  • Retirement planning through the Company's 401(k)
  • Fulltime
Read More
Arrow Right

Staff Software Engineer

The Staff Software Engineer on the Engineering team is responsible for the imple...
Location
Location
India , Pune
Salary
Salary:
Not provided
logicmonitor.com Logo
LogicMonitor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of software development experience in commercial or enterprise applications
  • 6+ years of full-time experience as a Java developer on Linux platform
  • BS or above degree in computer science or related field
  • Expertise with latest Java development framework and open-source tools
  • Extensive experience and knowledge with inner workings of JVM
  • Strong understanding of web application architectures, specifically Apache Tomcat
  • Experience in SaaS Product Development dealing with large volumes of data
  • Deep SQL / NoSQL database knowledge, including following databases: MySQL, Cassandra, and ElasticSearch
  • Extensive experience with one of the following Big Data technologies: Apache Spark, Kafka Streams, AWS Kinesis/Firehose
  • Experience designing large, complex distributed systems
Job Responsibility
Job Responsibility
  • Prioritize and plan for deliverables in an iterative development strategy, according to our 2 week scrum schedule & 1 week regression testing
  • Design, document, code, and test technical solution for new systems or enhancements to existing systems
  • Follow agile software development methodologies for implementation
  • Working with various teams in LogicMonitor to deliver software products that support LogicMonitor's business growth
  • Provides technical leadership mentoring and guidance at senior engineering levels and below
  • Trusted to represent the team to other functional teams
  • Coordination, Communication, and Collaboration between management, product, techops, support, developers
  • Envision system features and functionalities by analyzing business requirements
  • Troubleshoot and resolve product/application issues for escalated support cases
  • Collaborate with a diverse, distributed development organization
  • Fulltime
Read More
Arrow Right

Staff Software Engineer

We are seeking a highly experienced Staff Software Engineer to support the techn...
Location
Location
Germany , Stuttgart
Salary
Salary:
Not provided
blueyonder.com Logo
Blue Yonder
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience in software engineering
  • Proven ability to work directly with stakeholders to interpret needs, challenge assumptions, and define actionable technical direction
  • Broad technical skill set, with the ability to operate across multiple layers of the technology stack
  • Backend: Java (preferably Quarkus), REST, JWT
  • Frontend: Working knowledge of React
  • Cloud & DevOps: Containerization, Github Action, Kubernetes or Azure
  • Knowledge of event-driven distributed system architectures or streaming technologies (e.g., Kafka), integration patterns, software security principles, and scalable application design
  • Demonstrated capability to quickly learn new technologies, frameworks, and domain concepts
Job Responsibility
Job Responsibility
  • Partner with stakeholders to analyze requirements, ensuring clarity, feasibility, and alignment with product strategy
  • Assess proposed business needs for technical suitability, architectural impact, and long-term maintainability
  • Translate functional requirements into technical designs, architectural concepts, and implementation plans
  • Actively contribute to the codebase, including designing, implementing, reviewing, and optimizing software components
  • Provide hands-on technical guidance to engineering teams, ensuring consistent execution, adherence to standards, and high-quality delivery
  • Communicate complex technical topics in a clear and structured manner to both technical and non-technical audiences
  • Support cross-team alignment and contribute to the definition and evolution of architectural patterns and best practices
  • Mentor engineers and support talent development within the organization
  • Fulltime
Read More
Arrow Right

Staff Software Engineer

We’re not just building better tech. We’re rewriting how data moves and what the...
Location
Location
Salary
Salary:
255600.00 - 300300.00 CAD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of professional software engineering experience, including substantial time as a technical architect on complex, business critical systems
  • Deep hands-on expertise in full stack development using languages such as Go, Java, or similar, building services and APIs and modern JavaScript front ends (e.g., React)
  • Strong experience with relational databases (e.g., PostgreSQL) and comfort working with event streaming or messaging technologies such as Kafka
  • Proven track record of architecting and delivering internal or B2B applications that support complex business workflows with high reliability and usability
  • Demonstrated ability to decompose ambiguous, cross team problems into clear technical designs and milestones, and to ship high quality solutions on time for multi quarter initiatives
  • Experience improving developer productivity and operational excellence through better abstractions, tooling, automation, and thoughtful refactoring of legacy systems
  • Strong system design, data structures, and algorithms foundation, with an emphasis on pragmatic trade offs and simplicity in real world systems
  • Comfortable operating in a cloud native environment (AWS or similar), using containers, CI/CD, and modern observability tooling to run and operate services in production
  • Excellent communication and collaboration skills, with a track record of influencing stakeholders at multiple levels and mentoring other engineers
  • Growth mindset, ownership mentality, and a bias for action in pursuit of measurable impact on revenue, efficiency, and customer experience
Job Responsibility
Job Responsibility
  • Lead the architecture, design, and implementation of high impact internal web applications that support deal lifecycle, pricing and quoting, forecasting, and planning workflows
  • Own complex, cross team technical initiatives from problem framing through design, implementation, rollout, and long term evolution
  • Identify and drive high leverage technical investments that improve reliability, performance, developer velocity, and user experience across multiple applications and services
  • Design and evolve microservices, APIs, and data models that integrate with systems such as Salesforce, billing, data platforms, and analytics, ensuring robust contracts and clear boundaries
  • Partner closely with Product Managers and business stakeholders to translate ambiguous business problems into clear technical strategies, roadmaps, and deliverables over multi quarter horizons
  • Provide technical leadership and mentoring for senior and mid level engineers, raising the bar on design quality, code quality, observability, and operational excellence across the team
  • Champion engineering best practices including testing, performance engineering, incident readiness, and secure coding, and ensure they are consistently applied in your area of ownership
  • Collaborate with peer teams to define cohesive end to end solutions and shared platforms rather than point integrations
  • Contribute to and help refine the technical strategy, architecture principles, and career standards for the Commit Estimator and broader Application & AI Engineering domains
  • Contribute to modernize the existing application and platform for scalability, availability, speed of delivering software and enabling AI capabilities for End Users
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right