CrawlJobs Logo

Confluent Kafka Developer

https://www.soprasteria.com Logo

Sopra Steria

Location Icon

Location:
India , Bengaluru

Category Icon

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

Not provided

Job Description:

We are looking for a Confluent Kafka Developer to manage and support our Kafka ecosystem. This role involves supporting L2 activities, ensuring reliability and performance through monitoring, and collaborating with development teams to implement low latency data streaming use cases. Requires experience with Confluent Kafka administration and backend development skills in Java, .NET or Node.js.

Job Responsibility:

  • Managing and supporting our Kafka ecosystem
  • Supporting L2 activities
  • Ensuring reliability and performance via monitoring
  • Implementing data streaming use-cases with development teams
  • Adhering to internal compliance policies and procedures
  • Acting with integrity and ensuring sustainable growth

Requirements:

  • Confluent
  • Kafka - Developer (70% in development) and 30% in admin is a plus
  • Node/Java/.NET - >=3 Years experience
  • 4-6 Years experience with BE/B.Tech

Nice to have:

  • Experience with Java, .NET or Node.js
  • Strong collaboration with the Kafka team in ASA and suppliers
What we offer:
  • Inclusive and respectful work environment
  • Open to people with disabilities

Additional Information:

Job Posted:
April 26, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:
PREMIUM
More languages and countries
+ Unlock 31694 hidden job offers
Languages
English Čeština Deutsch Ελληνικά Español Français +15
Countries
United States United Kingdom India Canada Australia +
See plans
Plans from $2.99 / month

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Confluent Kafka Developer

Kafka Technical Lead

We are looking for an experienced Confluent Kafka Administrator/Developer to ass...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Confluent
  • Kafka
  • Node/Java/.NET - >=3 Years experience
  • strong experience with Confluent Kafka administration
  • strong experience with developing low latency data streaming solutions
  • experience as a backend developer with Java, .NET or Node.js
Job Responsibility
Job Responsibility
  • Managing and supporting our Kafka ecosystem
  • Supporting L2 activities and ensuring reliability and performance via monitoring
  • Working with development teams to implement data streaming use-cases
  • Awareness of compliance risks
  • Commitment to act with integrity and adherence to policies governing business activities
  • Compliance to protect Airbus reputation and brand
Read More
Arrow Right

Kafka Engineer

This role is integral within our client's team, where you will be tasked with ad...
Location
Location
United States , Santa Clara
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 10 years of detail-oriented experience as a Software Engineer
  • Strong problem-solving abilities and analytical skills
  • Solid understanding of software engineering principles and methodologies
  • Exceptional communication skills, both written and verbal
  • Strong ability to learn new technologies quickly and apply them in problem-solving
  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • Prior experience in managing a team or leading a project will be considered an advantage
  • Proactive approach, with the ability to handle multiple projects simultaneously and meet deadlines
  • Familiarity with other programming languages or technologies is a plus
Job Responsibility
Job Responsibility
  • Administering and maintaining various aspects of Confluent Kafka clusters including multi DC brokers, connectors, C3, KSQL DB, Rest Proxy, and Schema registry
  • Configuring and managing Kafka topics, RBAC, connectors, KSQL, and schema registry while adhering to security, availability, scalability, and DR standards
  • Supporting Java, Node.js, and Python based Kafka clients and microservices
  • Performing basic administration tasks of Apache Nifi (OSS)
  • Understanding user data flow requirements and designing and developing Kafka based solutions using Confluent Kafka, Connectors KSQL, and Nifi
  • Providing low-code data flow alternatives
  • Utilizing experience with data, cloud (AWS), and Queues Connectors in both design and configuration tasks
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Eligibility to enroll in company 401(k) plan
  • Fulltime
Read More
Arrow Right

Backend Software Developer

We are seeking a highly skilled developer with backend expertise, particularly i...
Location
Location
United States , Grand Rapids
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5 to 10 years of relevant experience in backend development, preferably using .NET and C#
  • hands-on experience with Microsoft Azure (Function Apps, Durable Functions, Logic Apps, Service Bus, Cosmos DB, Storage Accounts)
  • hands-on experience with Confluent Kafka
  • hands-on experience with CI/CD best practices
  • hands-on experience with unit test case development
Job Responsibility
Job Responsibility
  • Follow the company’s software development lifecycle to design, code, configure, test, debug, and document systems and application programs
  • assist in preparing technical design specifications based on functional requirements and analysis documents
  • review functional requirements, analysis, and design documents, providing constructive feedback
  • collaborate with other developers to ensure quality, consistency, and maintainability of code
  • participate in architecture design discussions and code reviews
  • develop and maintain system and operational-level documentation
  • work within the SAFe Agile framework
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • eligibility to enroll in the company 401(k) plan
  • access to top jobs
  • competitive compensation
  • free online training
Read More
Arrow Right

Applications Development Sr Programmer Analyst

Integration Services within Common Platform Engineering is responsible for devel...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working in Financial Services or a large complex and/or global environment
  • Experience of the following technologies: Kafka Ecosystem (Confluent distribution preferred)
  • Kubernetes and Openshift
  • Java
  • React
  • Familiarity with SRE practices
  • Consistently demonstrates clear and concise written and verbal communication
Job Responsibility
Job Responsibility
  • Designing and developing workflow solutions to integrate Kafka with our data governance and control platforms
  • Understanding the existing onboarding flow and working to streamline and simplify the process
  • Design and develop developer facing tooling to manage topics and connectors
  • Help to deliver the SRE requirements for this stack
  • Fulltime
Read More
Arrow Right

Kafka Administrator

We have a 6 month contract to hire for a highly analytical Senior Kafka Administ...
Location
Location
United States , Buffalo
Salary
Salary:
Not provided
zeektek.com Logo
Zeektek
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • 4-6+ years of experience
  • Kafka Administration
  • AWS Experience
  • CFK (Confluent for Kubernetes)
  • Apache Kafka administration
  • Confluent Cloud/ Platform administration
  • Event Driven Architecture, Event Streaming (Kafka preferred), NoSQL DB (Mongo Preferred), DevOps, CI/CD
Job Responsibility
Job Responsibility
  • Administer Kafka platforms on-prem and in cloud
  • Develop new services/ enhancements
  • Coach junior team members
  • Provide client support
  • Incident management
  • Solution engineering
  • Develop Proofs-of-Concept
  • Code reviews
What we offer
What we offer
  • Weekly Direct Deposit
  • 401K Matching
  • Competitive medical, dental and vision insurance
  • Consistent communication throughout your project
  • ZeekTek Referral Program
  • Fulltime
Read More
Arrow Right

Data Operations Engineer

BA Markets wants to professionalise and streamline its activities with regards t...
Location
Location
Poland , Katowice
Salary
Salary:
Not provided
vattenfall.com Logo
Vattenfall
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Interest in understanding what the user needs with several years of hands-on experience as software developer with an interest in the responsibilities of a data engineer or vice versa
  • A proactive, communicative team player
  • Fluent in English
  • Deep understanding of Kafka architecture (brokers, topics, partitions, replication), and experience with Kafka Streams, Kafka Connect, and schema registry (e.g., Confluent)
  • Proficiency in designing and managing Kafka clusters (including monitoring and scaling)
  • Hands-on Experience building and maintaining real-time ETL pipelines
  • Familiarity with stream processing frameworks like: Apache Flink or Apache Spark Streaming
  • Strong skills in: Python and Java and at least basic Scala and at least solid SQL experience
  • Has build several CI/CD pipelines (e.g., Jenkins, GitLab CI, GitHub Actions)
  • And used infrastructure as Code (IaC) tools like Terraform or Ansible
Job Responsibility
Job Responsibility
  • Stream deployment and stream architecture, developments and deployments
  • Automate workflows and orchestrate data pipelines
  • Implement CI/CD routines
  • Implement and monitor “system health” with observability tools and data quality checks
  • Support the development of Client Libraries so other applications can integrate streams in own application and services
  • Perform Python development
  • Perform “glue code” development that 95% of use cases can apply
What we offer
What we offer
  • Good remuneration
  • Challenging and international work environment
  • Possibility to work with some of the best in the field
  • Working in interdisciplinary teams
  • Support from committed colleagues
  • Attractive employment conditions
  • Opportunities for personal and professional development
  • Fulltime
Read More
Arrow Right

Software Engineer–Confluent Kafka on AWS

Join us as a Software Engineer–Confluent Kafka on AWS at Barclays, where you'll ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Design, deploy, and operate production‑grade Confluent Kafka platforms, including Kafka brokers, Schema Registry, Kafka Connect, ksqlDB, and REST Proxy, ensuring high availability, scalability, and secure data streaming across domains
  • Engineer and manage cloud‑native workloads on Amazon EKS, including cluster configuration, workload deployment, upgrades, scaling, and operational support in line with Barclays engineering and security standards
  • Apply deep working knowledge of Kubernetes primitives and patterns, including StatefulSets, operators, persistent volumes, services, ingress, and Kubernetes networking, to support stateful and distributed platforms
  • Build and maintain Infrastructure as Code (IaC) using Terraform and AWS CloudFormation, enabling repeatable, auditable, and compliant provisioning of cloud and platform resources
  • Demonstrate strong understanding of AWS core services (such as EC2, VPC, IAM, S3, EKS, CloudWatch, Route53), and apply cloud‑native design principles to achieve scalability, resilience, and cost efficiency
  • Implement and support containerisation standards using Docker, container registries such as Amazon ECR, and container security practices aligned with enterprise and regulatory expectations
  • Contribute to the design and operation of multi‑region architectures, supporting active‑active or active‑passive deployment models to meet availability, resilience, and disaster recovery objectives
  • Develop and maintain automation and operational tooling using Python, Bash, or Go, supporting platform automation, diagnostics, CI/CD integration, and operational efficiency
  • Design, develop, and operate event‑driven architectures (EDA) using industry‑standard messaging and streaming platforms, ensuring high throughput, low latency, and resilience
  • Provide deep expertise in stream processing concepts including event ordering, partitioning, replay, schema evolution, and exactly‑once/at‑least‑once semantics
Job Responsibility
Job Responsibility
  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
Read More
Arrow Right

Data Engineer - Streaming (WkStream 2 - Kafka)

The Data Engineer - Streaming role involves designing and implementing PySpark S...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Apache Kafka – Producer & Consumer: 4+ years of hands-on experience with Apache Kafka, including both producer and consumer development in PySpark, Java, or Scala
  • Deep understanding of Kafka internals: topics, partitions, consumer groups, offsets, rebalancing, and exactly-once delivery semantics
  • Experience with Confluent Kafka: schema registry, Avro/JSON serialisation, and Confluent Cloud or on-prem cluster configuration
  • Proven ability to build ingestion pipelines without relying on unsupported or third-party sink connectors — using only native Kafka consumer APIs and Spark integration
  • Familiarity with Kafka Connect architecture to evaluate trade-offs and articulate why application-level ingestion is preferred in constrained environments
  • PySpark Structured Streaming: Strong practical experience with PySpark Structured Streaming: Kafka source, file source, foreachBatch, output modes (append/update/complete), and checkpoint management
  • Experience tuning streaming micro-batch trigger intervals, watermarking, and late data handling for production workloads
  • Hands-on experience writing streaming data directly to Apache Iceberg tables using the Iceberg Spark runtime
  • Ability to implement robust error handling: dead-letter queues, parse error isolation, and recovery from checkpoint failures
  • Data Engineering & Iceberg: Working knowledge of Apache Iceberg: catalog configuration, schema definition, append writes, and partition strategy for event and log data
Job Responsibility
Job Responsibility
  • Design and implement a PySpark Structured Streaming application that reads from Confluent Kafka topics, parses JSON and Avro payloads, applies schema mappings, and writes atomically to Iceberg tables using the Iceberg Spark runtime and foreachBatch micro-batch pattern
  • Ensure all functionality relies exclusively on public Apache-supported APIs — Apache Spark, Apache Kafka, and Apache Iceberg — with no unsupported Confluent connectors or proprietary sinks
  • Configure Kafka source parameters: bootstrap servers, consumer group IDs, offset management (startingOffsets, failOnDataLoss), checkpoint paths, and trigger intervals
  • Implement PII detection and Protegrity tokenization hooks within the ingestion pipeline before data lands in the Iceberg Bronze layer
  • Write comprehensive unit and integration tests: row count validation, schema conformance checks, Kafka offset commit verification, and data comparison against the source topic
  • Support PNC UAT — walk PNC engineers through the code, demonstrate no unsupported connectors are used, and address review findings
  • Fulltime
Read More
Arrow Right