Job Description:
We’re not just building better tech. We’re rewriting how data moves and what the world can do with it. With Confluent, data doesn’t sit still. Our platform puts information in motion, streaming in near real-time so companies can react faster, build smarter, and deliver experiences as dynamic as the world around them. It takes a certain kind of person to join this team. Those who ask hard questions, give honest feedback, and show up for each other. No egos, no solo acts. Just smart, curious humans pushing toward something bigger, together. One Confluent. One Team. One Data Streaming Platform. Our team is responsible for managing the metadata that makes Kafka a reliable, fault-tolerant, and high-performance distributed streaming platform. This includes coordinating the election of leaders, monitoring broker availability, persisting and distributing metadata, coordinating cluster-wide actions, and more. In this role, you will be working on building a highly available, reliable, secure, scalable, and multi-tenant metadata layer. You will be instrumental in driving the technical solutions end-to-end, working closely with the team and key stakeholders to design, architect, and develop top-notch solutions. The team recently completed a major initiative to implement its own consensus protocol based on the Raft protocol. This new protocol, named Kraft, has allowed the team to remove the dependency on Zookeeper which allows for more scalable and robust metadata management as well as a more simple deployment model for Kafka.
