CrawlJobs Logo

DevOps Engineer – Kafka Service

Luxembourg, Leudelange · Job Posted June 18, 2025
Apply Position
Job Link Share

Job Description

We are looking for a highly skilled DevOps Engineer to take ownership of the Kafka service within our IT ecosystem. The ideal candidate will be responsible for implementing, and maintaining Kafka infrastructure to ensure high availability, scalability, and performance. This role requires deep expertise in Apache Kafka, strong automation skills, and experience managing distributed data streaming platforms in a complex enterprise environment.

Job Responsibility

  • Kafka Administration & Operations: Deploy, configure, monitor, and maintain Kafka clusters in a high-availability production environment
  • Performance Optimization: Tune Kafka configurations, partitions, replication, and producers/consumers to ensure efficient message streaming
  • Infrastructure as Code (IaC): Automate Kafka infrastructure deployment and management using Terraform, Ansible, or similar tools
  • Monitoring & Incident Management: Implement robust monitoring solutions (e.g., Dynatrace) and troubleshoot performance bottlenecks, latency issues, and failures
  • Security & Compliance: Ensure secure data transmission, access control, and compliance with security best practices (SSL/TLS, RBAC, Kerberos)
  • CI/CD & Automation: Integrate Kafka with CI/CD pipelines and automate deployment processes to improve efficiency and reliability
  • Capacity Planning & Scalability: Analyze workloads and plan for horizontal scaling, resource optimization, and failover strategies

Requirements

  • 5+ years of experience in DevOps, Site Reliability Engineering (SRE), or Kafka administration
  • Strong hands-on experience with Apache Kafka (setup, tuning, and troubleshooting)
  • Proficiency in scripting (Python, Bash) and automation tools (Terraform, Ansible)
  • Experience with cloud environments (AWS, Azure, or GCP) and Kubernetes-based Kafka deployments
  • Familiarity with Kafka Connect, KSQL, Schema Registry, Zookeeper
  • Knowledge of logging and monitoring tools (Dynatrace, ELK, Splunk)
  • Understanding of networking, security, and access control for Kafka clusters
  • Experience with CI/CD tools (Jenkins, GitLab, ArgoCD)
  • Ability to analyze logs, debug issues, and propose proactive improvements
  • Excellent problem-solving and communication skills
  • An ITIL qualification is an asset

Nice to have

An ITIL qualification

What we offer

Work among high-level professionals at the forefront of corporate software solutions and innovation at Europe’s Leading Digital Service Provider

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

DevOps Engineer – Kafka Service

8 matching positions

Sr Staff/Principal Devops Engineer

Balbix is looking for a DevOps Sr Staff/Principal Engineer to join our growing t...
Location
Location
India , Delhi
Salary
Salary:
Not provided
balbix.com Logo
Balbix
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or a related field
  • 10+ years of experience in DevOps for Sr Staff or 12-15 years for Principal
  • 4+ years of experience setting up and managing infrastructure in AWS for a product development organization
  • Ability to independently architect, design, document, and implement complex platforms and complex DevOps systems
  • Solid understanding of AWS infrastructure and services such as load balancers (ALB/ELB), IAM, KMS, Networking, EC2, CloudWatch, CloudTrail, CloudFormation, Lambda, etc.
  • 4+ years of experience building infrastructure using Terraform
  • 3+ years of solid experience with Kubernetes and Helm
  • Expert-level programming experience with Python for scripting and automation
  • Excellent knowledge of working on configuration management systems such as Ansible
  • Hands-on experience with CI/CD code management and deployment technologies like GitLab, Jenkins, or similar
Job Responsibility
Job Responsibility
  • Lead the development of critical DevOps projects, set technical direction, and influence the organization's technical strategy
  • Solve complex problems, mentor senior engineers, and collaborate with cross-functional teams to deliver high-impact DevOps solutions
  • Design and develop IaC components for Balbix solutions and internal engineering tools running in AWS
  • Build and deploy a state-of-the-art security SaaS platform using the latest CI/CD techniques, ensuring it is fully automated, repeatable, and secure
  • Secure infrastructure using best practices (e.g., TLS, bastion hosts, certificate management, authentication and authorization, network segmentation)
  • Design and develop a scalable, cost-efficient deployment infrastructure on Kubernetes
  • Design and implement consistent observability systems for Balbix solutions
  • Participate in on-call rotation
  • Fulltime
Read More
Arrow Right

Senior DevOps Engineer - ElasticSearch Admin

You will be part of a high-performing team, leading and executing to enable grow...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
auto1.com Logo
AUTO1 Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience administrating Elasticsearch clusters (5+ Data nodes)
  • Knowledge of planning and executing data retention and life cycle management, Index and Datastream mappings, as well as ML and transform jobs
  • Hands-on experience in operations of sizing, monitoring, and management, for Kafka, Logstash, Beats, Kibana, and Elastic Agent
  • Experience with queuing systems and data streams in production (SQS, ActiveMQ, Kinesis, Kafka or similar)
  • Familiarity with programming languages such as: PHP and/or Python and/or Java
  • 4+ years of experience in administering/developing/DevOps in a Linux/Unix environment
  • AWS Expert
  • Experience in creating CI/CD pipelines preferably using Jenkins
  • Experience with docker orchestration engines (ECS, Kubernetes, swarm, UCP, etc)
  • Significant experience with Docker, Terraform, or CloudFormation
Job Responsibility
Job Responsibility
  • Maintenance, support, and ongoing performance enhancements on multiple Elastic instances
  • Performing system upgrades, troubleshooting, and resolving infrastructure and system issues, as well as log ingestion and communication issues
  • Design and develop scalable, robust, and high-performance data pipelines and data storage solutions
  • Develop and maintain observability frameworks using tools like Kibana, Grafana, or similar
  • Work with cross-functional teams to define observability and search requirements
  • Scale, script and maintain our development and production platform foundation with AWS and GCP
  • Stay updated on the newest tools and (cloud) services
  • Perform database backups, migrations, and upgrades as needed
  • Discuss and evangelize for new technologies and best practices amongst and outside of your team
What we offer
What we offer
  • Relocation support to Germany which includes visa assistance, apartment search and help with costs
  • Educational budget for your personal growth
  • Above-average corporate pension plan
  • Work from home up to 5 days a week
  • Truly international and diverse working environment with more than 90 different nationalities
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

Principal Software Engineer (Golang | Distributed Systems) to join a high-growth...
Location
Location
United Kingdom , London
Salary
Salary:
170000.00 GBP / Year
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years’ backend engineering experience, ideally at Staff / Principal / Tech Lead level
  • Expert-level proficiency with Golang in production
  • Proven track record designing distributed systems and event-driven architectures (Kafka, RabbitMQ, WebSockets)
  • Deep understanding of PostgreSQL, Redis, and high-performance data systems
  • Strong DevOps mindset – CI/CD, infrastructure as code, observability (Grafana, Prometheus, OpenTelemetry)
  • Exceptional communicator, able to influence architecture and direction across teams
Job Responsibility
Job Responsibility
  • Architect and scale high-throughput, event-driven systems built in Go
  • Lead the evolution of real-time APIs and data platforms handling billions of requests
  • Stay deeply hands-on with Golang while influencing design and long-term technical strategy
  • Drive improvements in observability, testing, and performance across all services
  • Mentor senior engineers and play a key role in shaping engineering culture
What we offer
What we offer
  • 25% bonus
  • excellent benefits
  • Fulltime
Read More
Arrow Right

Software Engineer

TapHere! is looking for a self-starting, team-oriented Software Engineer to join...
Location
Location
United States , Chantilly
Salary
Salary:
Not provided
taphere.com Logo
TapHere! Technology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • TS/SCI clearance
  • Bachelor’s degree in computer science, Computer Engineering, Software Engineering, Information Systems, or a related discipline and minimum 2 years of prior relevant experience
  • Active Security+ or other IAT level 2/3 certificate
  • Experience with Agile Software Development Process and Methodologies
  • Experience Java software development life cycle
  • Experience with cloud technologies such as Amazon Web Services (AWS) or GovCloud
  • Experience with PostgreSQL or similar Relational Database Management System (RDBMS)
  • Mid/Senior Linux administration experience
  • DevOps Automation experience
  • Development experience with Microservices, Kafka (or any other Java based message broker) and Kubernetes
Job Responsibility
Job Responsibility
  • Work well under pressure and have the ability to work within timelines on capabilities and technologies with a wide range of maturity levels
Read More
Arrow Right

Software Engineer

We have an immediate opening for a Software Developer to join our engineering gr...
Location
Location
Canada , Longueuil
Salary
Salary:
Not provided
aviyatech.com Logo
aviya
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s/Master’s degree in Software Engineering, or Computer Science
  • Minimum of 2-3 years’ experience in design, development and support of production-tier software application services and micro-services
  • Scrum/Agile software development and project life cycle experience
  • Experience with Azure Dev Ops, GitHub tools for software configuration management systems and version control processes
  • Strong programming skills in Java, Python
  • Strong knowledge of software development process and Object-Oriented Programming skills (Java, Python)
  • Knowledge of Message Queue Systems, especially Apache Kafka and Kafka Streams
  • AWS serverless knowledge to participate in the migration to Cloud based infrastructure
  • Proficient in MS Office, especially in Excel
  • Good oral and written communication skills in English is mandatory
Job Responsibility
Job Responsibility
  • Design and update software applications to accommodate new design proposals
  • Continuously monitor production system performance KPIs and investigate in-service open issues
  • Design and update software to implement issues/enhancements into the applications for continuous improvements
  • Create and update class diagrams and design specification documents for new developments
  • Responsible for verification procedures and unit testing in support of CI/CD
  • Collaborate with the IT department for DevOps activities, applications troubleshooting
Read More
Arrow Right

Director of Engineering

We are seeking a highly experienced and strategic Director of Engineering to tak...
Location
Location
India , Chennai
Salary
Salary:
Not provided
arrcus.com Logo
Arrcus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/MS/PhD in Computer Engineering/Computer Science or equivalent degree
  • Excellent communication, presentation, and interpersonal skills
  • 5+ years of experience leading and managing distributed engineering teams involved in creating complex software products
  • 10+ years of relevant experience in managing very senior technical talent in some of the following areas: Networking protocols such as OSPF, BGP, ISIS, MPLS, BFD, MLAG, EVPN, VxLAN, SR-MPLS, SRv6, L3VPN
  • Test Harness like Robot framework, Jinja2
  • Familiarity network merchant silicon chipsets and whitebox platforms
  • Software development of Network Data Path (Linux, virtual and ASIC)
  • Virtualization technologies like SR-IOV, Intel DPDK, FD.io, NSX, OVS
  • High Availability, ISSU, Linux networking
  • Debian Build/Packaging, Linux Kernel, Kernel Networking Stack
Job Responsibility
Job Responsibility
  • Work with customer and product teams to understand and prioritise new requirements
  • Develop a holistic understanding of individual employee skill sets and drive resource allocation for customer requirements
  • Help drive the recruiting process both in terms of attracting new talent as well as defining and streamlining the recruitment process
  • Continuous Process Improvement: Solicit feedback, drive discussion and implement process and workflow improvements
  • Provide technical guidance and mitigation for engineering projects
  • Build 1:1 rapport with engineers, help identify and fulfil personal aspirations by aligning with larger team goals
  • Strong ability to plan, execute and deliver multiple projects across worldwide sites
  • Experience with rapidly growing engineering organizations in all aspects of people, resources, tools, and more
What we offer
What we offer
  • Generous compensation packages including equity
  • Medical Insurance
  • Parental Leave
  • Fulltime
Read More
Arrow Right

Staff Software Engineer

Lead the way, not just the code. This Staff Engineer role is your chance to leve...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
newstore.com Logo
NewStore
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 13+ years of experience
  • proven track record of delivering complex software solutions in fast-paced environments
  • expert in at least one technical area critical to the platform (e.g., database optimization, service frameworks, Kafka, container orchestration)
  • deep understanding of modern software development methodologies (TDD, Pair Programming, Continuous Deployment)
  • strong architectural mindset
  • excellent communication skills
  • natural leader who can inspire and motivate a team
Job Responsibility
Job Responsibility
  • Define the technical vision
  • deliver impactful solutions
  • be a hands-on leader
  • break down silos
  • leadership by example
  • mentorship and knowledge sharing
  • focus on developer experience
  • DevOps mindset
What we offer
What we offer
  • Generous PTO and R&R
  • professional growth with a dedicated personal development budget
  • flexible work options
  • balanced work-life with life-friendly working hours
  • financial rewards with employee stock options and a quarterly bonus
  • Fulltime
Read More
Arrow Right

Site Reliability Engineer - Core

We are looking for a Site Reliability Engineer to join our Core team to encourag...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
blockchain.com Logo
Blockchain
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with containerization and service orchestration, including best practices and security
  • Strong knowledge of at least one programming language
  • Linux, including an understanding of resource allocation, network and/or internals
  • Experience working with cloud solutions (GCP or AWS)
  • Deep understanding and demonstrable experience with modern monitoring tools such as Prometheus, Datadog, Grafana, Telegraf
  • Experience with infrastructure as code tools
  • Solid background with configuration management tools
  • Experience with using GitOps and CI to make changes, preferably Github Actions
  • Experience with messaging systems such as Kafka
  • Experience with database management
Job Responsibility
Job Responsibility
  • Play a critical role in evolving our infrastructure as we develop solutions to complex technical problems involving reliability, latency, bandwidth and most importantly security
  • Be an integral part of improving observability, monitoring and alerting throughout the platform
  • Help co-ordinate work across different areas of the company to ensure the most efficient path of execution
  • Centralize wherever possible common streams of work that are currently duplicated across developer teams
  • Focus heavily on writing tooling to replace manual, repetitive work in a scalable way
  • Work in a fast paced, and dynamic environment complementing our existing high calibre team
What we offer
What we offer
  • Full-time salary based on experience and meaningful equity in an industry-leading company
  • Hybrid model working from home & awesome office location in the heart of London
  • Unlimited vacation policy
  • work hard and take time when you need it
  • Work from Anywhere Policy: You can work remotely from anywhere in the world for up to 20 days per year
  • Apple equipment
  • The opportunity to be a key player and build your career at a rapidly expanding, global technology company in an emerging field
  • Flexible work culture
  • Fulltime
Read More
Arrow Right