CrawlJobs Logo
Beacon Hill Logo Beacon Hill · IT - Software Development

Kafka Engineer

United States, Philadelphia 78000.00 - 150000.00 USD / Year · Job Posted May 10, 2026
Apply Position
Job Link Share

Job Description

The Kafka Engineer will be responsible for designing, building, and supporting real-time data streaming solutions using Apache Kafka. This role is highly hands-on and will work closely with application developers and architects to implement scalable, high-performance streaming architectures. The engineer will play a key role in enabling real-time use cases across the organization and ensuring Kafka platforms are stable, optimized, and production-ready.

Job Responsibility

  • designing, building, and supporting real-time data streaming solutions using Apache Kafka
  • working closely with application developers and architects to implement scalable, high-performance streaming architectures
  • enabling real-time use cases across the organization
  • ensuring Kafka platforms are stable, optimized, and production-ready

Requirements

  • Strong hands-on experience with Apache Kafka (Confluent experience acceptable
  • Apache preferred)
  • Experience implementing Kafka from scratch in both on-prem and cloud environments (Azure preferred)
  • Proven experience building real-time data streaming solutions, including event-driven and CDC-based architectures
  • 3+ years of hands-on Kafka development and implementation experience
  • Strong SQL skills with hands-on experience in query tuning, debugging, and performance optimization
  • 3+ years of hands-on development experience with web technologies
  • Strong experience building REST APIs using .NET and modern front-end frameworks such as Angular or React
Beacon Hill - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Kafka Engineer

8 matching positions

Senior Java Engineer (Kafka, Kubernetes, SpringBoot) – Banking

My client is looking for a Senior Java Engineer to join a contract basis. They n...
Location
Location
United Kingdom , London
Salary
Salary:
600.00 - 700.00 EUR / Day
welovesalt.com Logo
Salt
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong systems development experience at all stages of systems development covering design, development, testing, live implementation and post implementation support
  • Strong hands-on Object-Oriented Design skills
  • Strong core Java programming skills
  • Experience of developing services/micro-services in Java
  • Experience of developing containerised services using Docker and Kubernetes
  • Hands-on SpringBoot skills
  • Experience of developing and deploying on Unix or Linux
  • Hands-on experience of using the Kafka ecosystem
  • Experience of profiling and performance tuning
  • Experience of Behaviour-Driven and Test-Driven development principles and skills
Job Responsibility
Job Responsibility
  • Working as part of an Agile development team to deliver the migration of the legacy application to new event-based and service-oriented architecture solution, working in collaboration with the Solution Architect, Technical Lead, Application architects and other stakeholders
  • Lead delivery of a coherent end-to-end IT solution that meets both functional and non-functional requirements
  • Ensuring that the IT solution complies with the Enterprise engineering and architecture standards
  • Ensuring end-to-end consistency of solution delivery across platforms and teams by, for instance, organising walkthroughs of the solution with delivery teams
  • Ensuring that the solution meets guidelines and standards for design and development
  • Undertaking hands-on development and coaching staff in the new technologies used
  • The successful candidate will be expected to support the development of more junior colleagues
  • Fulltime
Read More
Arrow Right

Qa Automation Engineer (Kafka)

Take your career to the next level with Amaris Consulting as a QA Integration En...
Location
Location
Spain , Valencia, Barcelona, Madrid
Salary
Salary:
Not provided
amaris.com Logo
Amaris Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Between 4 - 7 years of experience as a QA Engineer
  • Solid experience with CI/CD pipelines and manual/automated testing (mandatory)
  • Hands-on experience with Kafka / event-driven architectures
  • Strong knowledge of JUnit and Mockito in real projects
  • Experience with API testing tools such as Postman, Bruno or similar
  • Proven E2E testing experience in integration contexts
  • Experience with Confluent / Kafka streaming platforms
  • Background in Java-based testing environments
  • Understanding of data mapping and transformation logic
  • English proficiency for daily work in an international environment (mandatory)
Job Responsibility
Job Responsibility
  • Design, execute and automate test cases for event-driven integrations
  • Validate event flows across layers (Producer → Canonical → Consumer) to ensure data consistency and reliability
  • Test event processing pipelines in close collaboration with producer and consumer owners
  • Validate API integrations and connectors between multiple systems and platforms
  • Work closely with development, architecture and business teams to ensure Go-Live readiness and high-quality deliveries
  • Contribute to continuous improvement of testing frameworks, standards and best practices in an event-driven environment
What we offer
What we offer
  • Tailored career path and salary evaluation
  • Tech Academy catalog, Udemy E-learning Platform, Languages Sessions, webinars, and workshops
  • Annual personal budget and company-paid certifications
  • Flexible policies, remote work options, social benefits like transit and restaurant tickets, kindergarten support, and private health insurance
  • WeCare program
Read More
Arrow Right

Senior Infrastructure Kafka Engineer

We are seeking a Senior Infrastructure - Kafka Engineer to join a high-performin...
Location
Location
United States , Phoenix
Salary
Salary:
Not provided
technologent.com Logo
Technologent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in infrastructure engineering with a strong focus on: Kafka administration across on-prem and cloud environments
  • Kafka ecosystem components including brokers, topics, consumer groups, replication, and failover
  • Messaging systems such as MQ
  • SQL and NoSQL database integration
  • Proven experience designing, deploying, and scaling Kafka clusters and connector infrastructure in production and DR environments
  • Hands-on experience building real-time data pipelines using Kafka producers and streaming consumers such as Spark Streaming
  • Strong proficiency with at least one major cloud platform: AWS, GCP, or Azure
  • Experience with event-driven architectures, containerization, and DevOps practices
  • Experience with observability and monitoring tools such as Splunk, Datadog, and Grafana
  • Solid understanding of networking, Linux/Windows operating systems, and core diagnostic tools
Job Responsibility
Job Responsibility
  • Administer, configure, and troubleshoot Kafka clusters across on-prem and cloud environments, including broker and cluster configuration, partitioning, and performance tuning
  • Design and implement scalable, highly available Kafka infrastructure, including disaster recovery and multi-environment strategies
  • Integrate Kafka with upstream and downstream systems using Kafka Connect and related connectors, including MQ, MongoDB, Oracle, SQL Server, PostgreSQL, and MySQL
  • Build and support real-time data pipelines using Kafka producers and streaming consumers such as Spark Streaming and Kafka Streams
  • Automate infrastructure provisioning and configuration across environments using Terraform and modern DevOps practices
  • Deploy and manage Kafka components and clients in production and disaster recovery environments, ensuring resilience and recoverability
  • Lead a small team of engineers and technicians in monitoring, diagnosis, and remediation of infrastructure issues
  • Implement and maintain comprehensive monitoring, logging, and alerting using tools such as Splunk, Datadog, and Grafana
  • Perform proactive health checks and capacity planning to identify and resolve issues before they impact service
  • Serve as a primary point of contact for daily operations, major incidents, and escalations related to Kafka and associated infrastructure
  • Fulltime
Read More
Arrow Right

Data Engineer (Kafka)

Altamira is seeking a Data Engineer to design, build, and operate high-performan...
Location
Location
United States , Dayton, OH
Salary
Salary:
Not provided
altamiracorp.com Logo
Altamira Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Active TS/SCI clearance
  • Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience)
  • Experience in data engineering, distributed systems, or backend engineering roles
  • Hands-on experience with Apache Kafka in production environments
  • Experience building and supporting real-time data pipelines
  • Strong proficiency in Java, Python, Scala, or similar programming languages
  • Experience working in AWS or hybrid cloud environments
  • Strong Linux systems administration and troubleshooting skills
  • Ability to work effectively in secure, mission-focused environments
Job Responsibility
Job Responsibility
  • Design, deploy, and operate Apache Kafka clusters in classified and hybrid environments
  • Build and maintain reliable, scalable, and secure data streaming pipelines
  • Develop and optimize producers, consumers, and stream processing applications
  • Configure and manage topics, partitions, replication, and retention policies
  • Monitor, tune, and troubleshoot Kafka performance, availability, and latency
  • Integrate streaming platforms with databases, storage systems, and analytics tools
  • Implement data governance, retention, and access control policies
  • Automate deployment and management of streaming infrastructure
  • Collaborate with platform, infrastructure, and application teams to support data requirements
  • Support system accreditation, compliance, and security requirements
  • Fulltime
Read More
Arrow Right

Staff Software Engineer (Kafka Streaming)

Location
Location
India , Bengaluru
Salary
Salary:
Not provided
bazaarvoice.com Logo
Bazaarvoice
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • How many years of experience do you have in Kafka Streams, Spark, and Flink?
  • How many years of experience do you have in Scala or Java?
Read More
Arrow Right

Staff Software Engineer (Kafka Streaming)

We are building our next-generation Data Enrichment Platform and we need a heavy...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
bazaarvoice.com Logo
Bazaarvoice
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of software engineering experience
  • At least 5 years of deep production expertise in Scala or Java (concurrency, memory management, GC tuning)
  • Deep JVM knowledge required
  • 5+ years hands-on with the Kafka ecosystem (Apache Kafka, Kafka Streams, Kafka Connect, Flink, Spark)
  • Proven track record of designing resilient systems under heavy load
  • Mastery of the AWS ecosystem (MSK, EMR, Athena, Lambda)
  • Experience with Terraform
  • Experience with Kubernetes
Job Responsibility
Job Responsibility
  • Architect high-throughput pipelines
  • Solve complex latency challenges
  • Define standards for a robust Lakehouse architecture
  • Lead design of distributed streaming architectures using Kafka Streams, Spark, and Flink
  • Build roadmap for transition to Lakehouse architecture
  • Dive deep to identify system bottlenecks
  • Own stability of pipelines processing massive events per second
  • Solve for data integrity and low latency
  • Drive culture of reliability through robust monitoring (Datadog/Prometheus), observability, and automated testing frameworks
  • Proactively identify opportunities to refactor and modernize platform for efficiency and cost-effectiveness
What we offer
What we offer
  • Competitive salary
  • Insurance
  • Annual leave
  • Bonuses
  • Referral rewards
  • Fulltime
Read More
Arrow Right

DevOps Engineer – Kafka Service

We are looking for a highly skilled DevOps Engineer to take ownership of the Kaf...
Location
Location
Luxembourg , Leudelange
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in DevOps, Site Reliability Engineering (SRE), or Kafka administration
  • Strong hands-on experience with Apache Kafka (setup, tuning, and troubleshooting)
  • Proficiency in scripting (Python, Bash) and automation tools (Terraform, Ansible)
  • Experience with cloud environments (AWS, Azure, or GCP) and Kubernetes-based Kafka deployments
  • Familiarity with Kafka Connect, KSQL, Schema Registry, Zookeeper
  • Knowledge of logging and monitoring tools (Dynatrace, ELK, Splunk)
  • Understanding of networking, security, and access control for Kafka clusters
  • Experience with CI/CD tools (Jenkins, GitLab, ArgoCD)
  • Ability to analyze logs, debug issues, and propose proactive improvements
  • Excellent problem-solving and communication skills
Job Responsibility
Job Responsibility
  • Kafka Administration & Operations: Deploy, configure, monitor, and maintain Kafka clusters in a high-availability production environment
  • Performance Optimization: Tune Kafka configurations, partitions, replication, and producers/consumers to ensure efficient message streaming
  • Infrastructure as Code (IaC): Automate Kafka infrastructure deployment and management using Terraform, Ansible, or similar tools
  • Monitoring & Incident Management: Implement robust monitoring solutions (e.g., Dynatrace) and troubleshoot performance bottlenecks, latency issues, and failures
  • Security & Compliance: Ensure secure data transmission, access control, and compliance with security best practices (SSL/TLS, RBAC, Kerberos)
  • CI/CD & Automation: Integrate Kafka with CI/CD pipelines and automate deployment processes to improve efficiency and reliability
  • Capacity Planning & Scalability: Analyze workloads and plan for horizontal scaling, resource optimization, and failover strategies
What we offer
What we offer
  • Work among high-level professionals at the forefront of corporate software solutions and innovation at Europe’s Leading Digital Service Provider
  • Fulltime
Read More
Arrow Right

Senior Staff/Principal Engineer, Kafka

At Cloudera, we empower people to transform complex data into clear and actionab...
Location
Location
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/MS in Computer Science or a related field, and/or 8+ years of relevant work experience
  • Experience in designing scalable, robust distributed software systems and products
  • Strong Java skills and proficiency across the Java ecosystem
  • Strong understanding of software design and architecture principles
  • Experience with delivery pipeline tools, CI/CD solutions, and automated testing
  • Experience with containerization orchestration technologies: Kubernetes, Docker
  • Strong track record of complex software development projects, featuring technical leadership and cross-team collaboration
  • Self-driven and motivated, with a strong sense of ownership and craftsmanship
  • Strong written and verbal English and communication skills
  • This role is not eligible for immigration sponsorship
Job Responsibility
Job Responsibility
  • Provide technical leadership for the development of Apache Kafka and the Cloudera products built on this technology
  • Design, implement, and release new features and enhancements for the Cloudera Streaming Analytics product suite, supporting both on-premise and cloud deployments
  • Contribute to a cross-functional software development team, covering all aspects of software product delivery to ensure high-quality, secure, and maintainable software
  • Informally manage technical projects, priorities, and resources, and plan work for other team members to ensure effective project delivery
  • Collaborate with partner engineering teams to coordinate delivery of projects that span across multiple teams
  • Collaborate with product management and engineering leadership to build and execute a roadmap for high-quality products that effectively meet customer needs
  • Provide support to our field team and customers, facilitating product adoption and smooth implementation of use cases
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right