CrawlJobs Logo

Kafka Administration

thirdeyedata.ai Logo

Thirdeye Data

Location Icon

Location:
United States

Category Icon
Category:
IT - Administration

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Responsibility:

  • Install, configure, and maintain Confluent Kafka clusters in an on-premises environment
  • Manage Kafka brokers, Zookeeper, Connect, Kafka Streams, and related services
  • Monitor and tune the performance of Kafka clusters to meet operational SLAs
  • Implement and manage Kafka security including SSL/TLS, ACLs, role-based access control (RBAC)
  • Ensure that Kafka infrastructure complies with the organization’s security policies and best practices
  • Set up monitoring and alerting for Kafka clusters using tools like Prometheus, Grafana, or Confluent Control Center
  • Analyze logs and metrics to proactively detect and resolve issues
  • Regularly perform maintenance and upgrades for Kafka components (brokers, Zookeeper, etc.)
  • Handle Kafka backup and disaster recovery procedures
  • Provide operational support and incident management for Kafka-related issues
  • Work closely with developers and data engineers to resolve application-level issues
  • Maintain accurate documentation of Kafka architecture, configuration, and operational procedures
  • Create runbooks for various Kafka administrative tasks

Requirements:

  • 3-5 years of hands-on experience managing Confluent Kafka clusters in production environments, preferably on-premises
  • Solid understanding of distributed systems, high availability, and failover mechanisms
  • Experience with Kafka Cluster Linking and cross-cluster replication

Nice to have:

  • Develop automation scripts and frameworks to streamline Kafka operations, such as provisioning, configuration, scaling, and monitoring using tools like Ansible, Terraform, or custom Python scripts
  • Automate Kafka cluster deployments, upgrades, and patch management
  • Implement auto-scaling, failover, and disaster recovery solutions through automation
  • Knowledge of CI/CD pipelines and infrastructure-as-code (IaC) concepts for Kafka deployments

Additional Information:

Job Posted:
December 26, 2025

Employment Type:
Fulltime
Work Type:
Remote work
Icon
Thirdeye Data - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Kafka Administration

DevOps Engineer – Kafka Service

We are looking for a highly skilled DevOps Engineer to take ownership of the Kaf...
Location
Location
Luxembourg , Leudelange
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in DevOps, Site Reliability Engineering (SRE), or Kafka administration
  • Strong hands-on experience with Apache Kafka (setup, tuning, and troubleshooting)
  • Proficiency in scripting (Python, Bash) and automation tools (Terraform, Ansible)
  • Experience with cloud environments (AWS, Azure, or GCP) and Kubernetes-based Kafka deployments
  • Familiarity with Kafka Connect, KSQL, Schema Registry, Zookeeper
  • Knowledge of logging and monitoring tools (Dynatrace, ELK, Splunk)
  • Understanding of networking, security, and access control for Kafka clusters
  • Experience with CI/CD tools (Jenkins, GitLab, ArgoCD)
  • Ability to analyze logs, debug issues, and propose proactive improvements
  • Excellent problem-solving and communication skills
Job Responsibility
Job Responsibility
  • Kafka Administration & Operations: Deploy, configure, monitor, and maintain Kafka clusters in a high-availability production environment
  • Performance Optimization: Tune Kafka configurations, partitions, replication, and producers/consumers to ensure efficient message streaming
  • Infrastructure as Code (IaC): Automate Kafka infrastructure deployment and management using Terraform, Ansible, or similar tools
  • Monitoring & Incident Management: Implement robust monitoring solutions (e.g., Dynatrace) and troubleshoot performance bottlenecks, latency issues, and failures
  • Security & Compliance: Ensure secure data transmission, access control, and compliance with security best practices (SSL/TLS, RBAC, Kerberos)
  • CI/CD & Automation: Integrate Kafka with CI/CD pipelines and automate deployment processes to improve efficiency and reliability
  • Capacity Planning & Scalability: Analyze workloads and plan for horizontal scaling, resource optimization, and failover strategies
What we offer
What we offer
  • Work among high-level professionals at the forefront of corporate software solutions and innovation at Europe’s Leading Digital Service Provider
  • Fulltime
Read More
Arrow Right

Kafka Technical Lead

We are looking for an experienced Confluent Kafka Administrator/Developer to ass...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Confluent
  • Kafka
  • Node/Java/.NET - >=3 Years experience
  • strong experience with Confluent Kafka administration
  • strong experience with developing low latency data streaming solutions
  • experience as a backend developer with Java, .NET or Node.js
Job Responsibility
Job Responsibility
  • Managing and supporting our Kafka ecosystem
  • Supporting L2 activities and ensuring reliability and performance via monitoring
  • Working with development teams to implement data streaming use-cases
  • Awareness of compliance risks
  • Commitment to act with integrity and adherence to policies governing business activities
  • Compliance to protect Airbus reputation and brand
Read More
Arrow Right

Bigdata Support Lead Engineer

The Lead Data Analytics analyst is responsible for managing, maintaining, and op...
Location
Location
India , Bengaluru; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of total IT experience
  • 5+ years of experience in supporting Hadoop (Cloudera)/big data technologies
  • 5+ years of experience in public cloud infrastructure (AWS or GCP)
  • Experience with Kubernetes and cloud-native technologies
  • Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)
  • Advanced knowledge of the Hadoop ecosystem and Big Data technologies
  • Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
  • Knowledge of troubleshooting techniques for Hive, Spark, YARN, Kafka, and HDFS
  • Advanced Linux system administration and scripting skills (Shell, Python)
  • Experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark with Java or Scala or Python
Job Responsibility
Job Responsibility
  • Lead day to day operation and support for Cloudera Hadoop ecosystem components (HDFS, YARN, Hive, Impala, Spark, HBase, etc)
  • Troubleshoot issues related to data ingestion, job failures, performance degradation and service unavailability
  • Monitor cluster health using Cloudera Manager and respond to alerts, logs, and metrics
  • Collaborate with engineering teams to analyze root causes and implement preventive measures
  • Collaborate patching, service restarts, failovers and rolling restarts for cluster maintenance
  • Assist in user onboarding, access control and issues in accessing the cluster services
  • Contribute to documentation for knowledge base
  • Work on data recovery, replication, and backup support tasks
  • Responsible for moving all legacy workloads to cloud platform
  • Ability to research and assess open-source technologies, public cloud tech stack (AWS/GCP) components to recommend and integrate into the design and implementation
  • Fulltime
Read More
Arrow Right

Senior Kafka Platform Engineer

This role is responsible for the management and operational excellence of the Ka...
Location
Location
Poland
Salary
Salary:
Not provided
https://www.hsbc.com Logo
HSBC
Expiration Date
January 30, 2026
Flip Icon
Requirements
Requirements
  • Must be able to communicate on technical levels with Engineers and stakeholders
  • Strong problem solving and analytical skills
  • Thorough understanding of the Kafka Architecture
  • Familiar with cluster maintenance processes and implementing changes and recommended fixes to Kafka clusters and topics to protect production
  • Experience operating in an infrastructure as code and automation first principles environment
  • Key Technologies Messaging technologies –Apache Kafka, Confluent Kafka
  • DevOps toolsets – GitHub, JIRA, Confluence, Jenkins
  • Automation – Ansible, Puppet or similar
  • Monitoring –Observability tools such as DataDog, NewRelic, Prometheus, Grafana
Job Responsibility
Job Responsibility
  • Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control Center
  • Provide expertise and hands on experience working on Kafka connect using schema registry in a very high volume
  • Provide administration and operations of the Kafka platform - provisioning, access lists Kerberos and SSL configurations
  • Provide expertise and hands on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms
  • Provide expertise and hands on experience on custom connectors using the Kafka core concepts and API
  • Create topics, setup redundancy clusters, deploy monitoring tools, and configure appropriate alerts and create stubs for producers, consumers, and consumer groups for helping onboard applications from different languages/platforms
  • As a Kafka SRE you will conduct root cause analysis of production incidents, document for reference and put into place proactive measures to enhance system reliability
  • Automate routine tasks using scripts or automation tools and perform data related benchmarking, performance analysis and tuning
  • Conduct root cause analysis of production incidents, documenting for reference and initiating proactive measures to enhance system reliability
What we offer
What we offer
  • Competitive salary
  • Annual performance-based bonus
  • Additional bonuses for recognition awards
  • Multisport card
  • Private medical care
  • Life insurance
  • One-time reimbursement of home office set-up (up to 800 PLN)
  • Corporate parties & events
  • CSR initiatives
  • Nursery discounts
  • Fulltime
Read More
Arrow Right

Software Engineer

TapHere! is looking for a self-starting, team-oriented Software Engineer to join...
Location
Location
United States , Chantilly
Salary
Salary:
Not provided
taphere.com Logo
TapHere! Technology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • TS/SCI clearance
  • Bachelor’s degree in computer science, Computer Engineering, Software Engineering, Information Systems, or a related discipline and minimum 2 years of prior relevant experience
  • Active Security+ or other IAT level 2/3 certificate
  • Experience with Agile Software Development Process and Methodologies
  • Experience Java software development life cycle
  • Experience with cloud technologies such as Amazon Web Services (AWS) or GovCloud
  • Experience with PostgreSQL or similar Relational Database Management System (RDBMS)
  • Mid/Senior Linux administration experience
  • DevOps Automation experience
  • Development experience with Microservices, Kafka (or any other Java based message broker) and Kubernetes
Job Responsibility
Job Responsibility
  • Work well under pressure and have the ability to work within timelines on capabilities and technologies with a wide range of maturity levels
Read More
Arrow Right

Kafka Engineer

This role is integral within our client's team, where you will be tasked with ad...
Location
Location
United States , Santa Clara
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 10 years of detail-oriented experience as a Software Engineer
  • Strong problem-solving abilities and analytical skills
  • Solid understanding of software engineering principles and methodologies
  • Exceptional communication skills, both written and verbal
  • Strong ability to learn new technologies quickly and apply them in problem-solving
  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • Prior experience in managing a team or leading a project will be considered an advantage
  • Proactive approach, with the ability to handle multiple projects simultaneously and meet deadlines
  • Familiarity with other programming languages or technologies is a plus
Job Responsibility
Job Responsibility
  • Administering and maintaining various aspects of Confluent Kafka clusters including multi DC brokers, connectors, C3, KSQL DB, Rest Proxy, and Schema registry
  • Configuring and managing Kafka topics, RBAC, connectors, KSQL, and schema registry while adhering to security, availability, scalability, and DR standards
  • Supporting Java, Node.js, and Python based Kafka clients and microservices
  • Performing basic administration tasks of Apache Nifi (OSS)
  • Understanding user data flow requirements and designing and developing Kafka based solutions using Confluent Kafka, Connectors KSQL, and Nifi
  • Providing low-code data flow alternatives
  • Utilizing experience with data, cloud (AWS), and Queues Connectors in both design and configuration tasks
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Eligibility to enroll in company 401(k) plan
  • Fulltime
Read More
Arrow Right

Support Engineer

We’re a global team of over 400 people, working together to push the boundaries ...
Location
Location
United States , Austin
Salary
Salary:
Not provided
aiven.io Logo
Aiven Deutschland GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-7 years of experience working as Support Engineer/Testing/Specialist at a SaaS or software company
  • Experience with open-source databases and technologies such as PostgreSQL, MySQL, Redis, and/or other technologies like Kafka, OpenSearch, Cassandra, and Grafana
  • Strong Linux and Networking skills as an administrator or Support Engineer
  • Excellent communication skills, with the ability to connect with users, adjust the tone and deliver personalized support
  • Critical thinking that prioritizes client needs and perspectives
  • Strong written and verbal communication skills, with the ability to clearly articulate root cause analysis to diverse stakeholders
  • Knowledge of distributed systems, and the ability to read and write SQL
  • Previous use of Zendesk, Slack, ServiceCloud, Google, Jira, Zendesk, Intercom, and/or Github
  • Experience in public clouds (AWS, Google, Azure) across compute, storage, networking, and security
  • A take charge attitude, technically curious, detail-driven, yet goal-oriented and focused on delivering results
Job Responsibility
Job Responsibility
  • Deliver exceptional customer service within SLAs
  • Develop deep expertise in our Aiven Platform and Aiven Services
  • Apply your experience with open-source databases and technologies
  • Troubleshoot complex issues, especially in Linux environments, public clouds (AWS, Google or Azure) and in the areas of compute, storage - block and object, networking, and security groups
  • Identify trends in customer feedback, report and suggest improvements
  • Help evolve and develop our support processes and tooling
  • Create and refine Runbooks and Playbooks from previously encountered issues, streamlining future resolution processes and fostering knowledge sharing
  • Research and report product malfunctions in order to expedite the resolution process ensuring optimal customer outcomes
  • Collaborate with cross-functional teams, including Documentation, Product, Sales, and Engineering
  • Engage with customers and teams via various channels, working collaboratively via ticketing system, email, chat and occasionally by phone or remote sessions to diagnose and resolve customer issues
What we offer
What we offer
  • Participate in Aiven’s equity plan
  • Hybrid work policy
  • Get the equipment you need to set yourself up for success
  • Real employer support (use one of our learning platforms, annual learning budget, and more)
  • Holistic wellbeing support through our global Employee Assistance Program
  • Extensive Occupational Health Care, Dental Care, as well as sports, culture, massage, commute and lunch benefits
  • Finnish Language lessons
  • Monthly office breakfast
  • Statutory accident insurance
  • Fulltime
Read More
Arrow Right

Applications Development Technology Lead Analyst

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10 + years of relevant experience in Apps Development or systems analysis role
  • Excellent knowledge in Java (JDK 1.8 or more)
  • Excellent knowledge experience with Java Microservices and NOSQL/PLSQL Basics
  • Java performance tuning, Threads, Collections
  • Kafka and MQ middleware
  • Spring, Spring Boot or other web frameworks
  • Any Application server administration
  • DevOps Tools – GIT, Teamcity, uDeploy
  • Code Quality and Analysis tools
  • Flink, Ignite Caching
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right
Welcome to CrawlJobs.com –
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Poland Jobs Ireland Jobs Germany Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2025 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy