Senior Kafka Platform Engineer, HSBC

HSBC

Not provided

Save Job

This role is responsible for the management and operational excellence of the Kafka clusters running in a Kubernetes environment.

Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control Center
Provide expertise and hands on experience working on Kafka connect using schema registry in a very high volume
Provide administration and operations of the Kafka platform - provisioning, access lists Kerberos and SSL configurations
Provide expertise and hands on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms
Provide expertise and hands on experience on custom connectors using the Kafka core concepts and API
Create topics, setup redundancy clusters, deploy monitoring tools, and configure appropriate alerts and create stubs for producers, consumers, and consumer groups for helping onboard applications from different languages/platforms
As a Kafka SRE you will conduct root cause analysis of production incidents, document for reference and put into place proactive measures to enhance system reliability
Automate routine tasks using scripts or automation tools and perform data related benchmarking, performance analysis and tuning
Conduct root cause analysis of production incidents, documenting for reference and initiating proactive measures to enhance system reliability

Must be able to communicate on technical levels with Engineers and stakeholders
Strong problem solving and analytical skills
Thorough understanding of the Kafka Architecture
Familiar with cluster maintenance processes and implementing changes and recommended fixes to Kafka clusters and topics to protect production
Experience operating in an infrastructure as code and automation first principles environment
Key Technologies Messaging technologies –Apache Kafka, Confluent Kafka
DevOps toolsets – GitHub, JIRA, Confluence, Jenkins
Automation – Ansible, Puppet or similar
Monitoring –Observability tools such as DataDog, NewRelic, Prometheus, Grafana

What we offer:

Employment Type:

Fulltime

Work Type:

Hybrid work

Job Link Share: