CrawlJobs Logo

Software Engineer – Confluent Kafka Management

barclays.co.uk Logo

Barclays

Location Icon

Location:
India , Bengaluru

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

Join us as a Software Engineer – Confluent Kafka Management at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unapparelled customer experiences. The ideal candidate will have deep expertise in cloud-native technologies, distributed streaming platforms, Kubernetes orchestration, and multi-region architecture patterns.

Job Responsibility:

  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
  • To advise and influence decision making, contribute to policy development and take responsibility for operational effectiveness. Collaborate closely with other functions/ business divisions
  • Lead a team performing complex tasks, using well developed professional knowledge and skills to deliver on work that impacts the whole business function. Set objectives and coach employees in pursuit of those objectives, appraisal of performance relative to objectives and determination of reward outcomes
  • If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others
  • OR for an individual contributor, they will lead collaborative assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will identify new directions for assignments and/ or projects, identifying a combination of cross functional methodologies or practices to meet required outcomes
  • Consult on complex issues
  • providing advice to People Leaders to support the resolution of escalated issues
  • Identify ways to mitigate risk and developing new policies/procedures in support of the control and governance agenda
  • Take ownership for managing risk and strengthening controls in relation to the work done
  • Perform work that is closely related to that of other areas, which requires understanding of how areas coordinate and contribute to the achievement of the objectives of the organisation sub-function
  • Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategy
  • Engage in complex analysis of data from multiple sources of information, internal and external sources such as procedures and practises (in other areas, teams, companies, etc).to solve problems creatively and effectively
  • Communicate complex information. 'Complex' information could include sensitive information or information that is difficult to communicate because of its content or its audience
  • Influence or convince stakeholders to achieve outcomes

Requirements:

  • Design, develop, and operate event‑driven architectures (EDA) using industry‑standard messaging and streaming platforms, ensuring high throughput, low latency, and resilience
  • Provide deep expertise in stream processing concepts including event ordering, partitioning, replay, schema evolution, and exactly‑once/at‑least‑once semantics
  • Act as a technical authority for streaming and EDA design decisions across delivery teams
  • Demonstrated, hands‑on expertise with Confluent Kafka ecosystem including topics, partitions, producers/consumers, schema registry, connectors, and operational best practices
  • Drive platform stability, performance tuning, capacity planning, and incident management for Kafka‑centric systems in line with BUK Service First and SRE principles
  • Lead the design, deployment, and operation of containerised applications on Amazon EKS, ensuring secure, scalable, and highly available Kubernetes clusters
  • Drive Ansible‑led automation strategies across cloud and streaming platforms, enabling repeatable, policy‑driven configuration, operational resilience, and DevOps efficiency while aligning with BUK security, risk, and compliance standards
  • Demonstrate advanced Kubernetes expertise, including operators, StatefulSets, persistent volumes, services, ingress controllers, and cluster networking, supporting stateful and stateless workloads
  • Establish best practices for cluster lifecycle management, upgrades, observability, and cost optimization across environments
  • Architect and operate cloud‑native solutions with deep hands‑on expertise across AWS core services
  • Ensure all solutions comply with Barclays security, risk, and regulatory standards, embedding security‑by‑design and least‑privilege access models
  • Own and evolve Infrastructure as Code (IaC) practices using Terraform and CloudFormation, enabling repeatable, auditable, and scalable cloud provisioning
  • Drive automation of environment builds, platform configuration, and operational runbooks to reduce manual intervention and improve reliability
  • Design and implement multi‑region AWS architectures, including active‑active and active‑passive deployments, with clear failover, disaster recovery, and data consistency strategies
  • Apply DORA metrics (deployment frequency, lead time for change, change failure rate, MTTR) to drive delivery predictability and engineering health
  • Champion engineering discipline, automation, and data‑driven decision making across delivery cycles
  • Strong familiarity with modern developer tooling including GitLab, DevSecOps pipelines, and secure CI/CD practices
  • Hands‑on experience with: Docker Desktop for local containerized development, IntelliJ IDEA or equivalent enterprise IDEs and Secure source control, branching strategies, and automated quality gates
  • Drive a test‑first, quality‑driven engineering culture with hands‑on experience in: Contract Testing (PACT) for consumer‑provider assurance, Unit Testing (JUnit) and integration testing, Performance & load testing (JMeter), Mutation testing to validate test effectiveness
  • Ensure test coverage and automation are embedded into CI/CD pipelines, not treated as post‑delivery activities
  • Working knowledge of AWS services relevant to event‑driven and streaming workloads
  • Experience deploying and operating workloads on Kubernetes (K8s), including container orchestration and scaling concepts
  • Demonstrate strong awareness and practical adoption of AI‑assisted engineering practices with AI coding assistants (e.g., Claude Code, GitLab Duo, Copilot or equivalent) to support code generation, refactoring, documentation, and test creation, while retaining engineering judgement and accountability
  • Operate as a senior Individual Contributor (ICE) with end‑to‑end ownership of complex platform components, requiring minimal supervision and demonstrating strong engineering accountability
  • Work effectively within Agile/Scrum delivery models, using Jira for backlog management, delivery tracking, and sprint execution
  • Apply strong analytical and troubleshooting skills to diagnose and resolve complex issues in distributed, event‑driven systems
  • Demonstrate excellent verbal and written communication, producing clear architecture designs, decision records, and technical documentation
  • Collaborate closely with cross‑functional teams (engineering, DevOps, security, architecture) to deliver integrated, enterprise‑ready solutions
  • Exhibit strong ownership, self‑drive, and innovation mindset, staying current with cloud‑native technologies and modern engineering best practices
What we offer:
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness access to wellness rooms, gyms and mental health support
  • A place where you can belong
  • Collaborative Areas
  • More than work

Additional Information:

Job Posted:
April 16, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer – Confluent Kafka Management

Kafka Engineer

This role is integral within our client's team, where you will be tasked with ad...
Location
Location
United States , Santa Clara
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 10 years of detail-oriented experience as a Software Engineer
  • Strong problem-solving abilities and analytical skills
  • Solid understanding of software engineering principles and methodologies
  • Exceptional communication skills, both written and verbal
  • Strong ability to learn new technologies quickly and apply them in problem-solving
  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • Prior experience in managing a team or leading a project will be considered an advantage
  • Proactive approach, with the ability to handle multiple projects simultaneously and meet deadlines
  • Familiarity with other programming languages or technologies is a plus
Job Responsibility
Job Responsibility
  • Administering and maintaining various aspects of Confluent Kafka clusters including multi DC brokers, connectors, C3, KSQL DB, Rest Proxy, and Schema registry
  • Configuring and managing Kafka topics, RBAC, connectors, KSQL, and schema registry while adhering to security, availability, scalability, and DR standards
  • Supporting Java, Node.js, and Python based Kafka clients and microservices
  • Performing basic administration tasks of Apache Nifi (OSS)
  • Understanding user data flow requirements and designing and developing Kafka based solutions using Confluent Kafka, Connectors KSQL, and Nifi
  • Providing low-code data flow alternatives
  • Utilizing experience with data, cloud (AWS), and Queues Connectors in both design and configuration tasks
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Eligibility to enroll in company 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Operations Engineer

BA Markets wants to professionalise and streamline its activities with regards t...
Location
Location
Poland , Katowice
Salary
Salary:
Not provided
vattenfall.com Logo
Vattenfall
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Interest in understanding what the user needs with several years of hands-on experience as software developer with an interest in the responsibilities of a data engineer or vice versa
  • A proactive, communicative team player
  • Fluent in English
  • Deep understanding of Kafka architecture (brokers, topics, partitions, replication), and experience with Kafka Streams, Kafka Connect, and schema registry (e.g., Confluent)
  • Proficiency in designing and managing Kafka clusters (including monitoring and scaling)
  • Hands-on Experience building and maintaining real-time ETL pipelines
  • Familiarity with stream processing frameworks like: Apache Flink or Apache Spark Streaming
  • Strong skills in: Python and Java and at least basic Scala and at least solid SQL experience
  • Has build several CI/CD pipelines (e.g., Jenkins, GitLab CI, GitHub Actions)
  • And used infrastructure as Code (IaC) tools like Terraform or Ansible
Job Responsibility
Job Responsibility
  • Stream deployment and stream architecture, developments and deployments
  • Automate workflows and orchestrate data pipelines
  • Implement CI/CD routines
  • Implement and monitor “system health” with observability tools and data quality checks
  • Support the development of Client Libraries so other applications can integrate streams in own application and services
  • Perform Python development
  • Perform “glue code” development that 95% of use cases can apply
What we offer
What we offer
  • Good remuneration
  • Challenging and international work environment
  • Possibility to work with some of the best in the field
  • Working in interdisciplinary teams
  • Support from committed colleagues
  • Attractive employment conditions
  • Opportunities for personal and professional development
  • Fulltime
Read More
Arrow Right
New

Software Engineer–Confluent Kafka on AWS

Join us as a Software Engineer–Confluent Kafka on AWS at Barclays, where you'll ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Design, deploy, and operate production‑grade Confluent Kafka platforms, including Kafka brokers, Schema Registry, Kafka Connect, ksqlDB, and REST Proxy, ensuring high availability, scalability, and secure data streaming across domains
  • Engineer and manage cloud‑native workloads on Amazon EKS, including cluster configuration, workload deployment, upgrades, scaling, and operational support in line with Barclays engineering and security standards
  • Apply deep working knowledge of Kubernetes primitives and patterns, including StatefulSets, operators, persistent volumes, services, ingress, and Kubernetes networking, to support stateful and distributed platforms
  • Build and maintain Infrastructure as Code (IaC) using Terraform and AWS CloudFormation, enabling repeatable, auditable, and compliant provisioning of cloud and platform resources
  • Demonstrate strong understanding of AWS core services (such as EC2, VPC, IAM, S3, EKS, CloudWatch, Route53), and apply cloud‑native design principles to achieve scalability, resilience, and cost efficiency
  • Implement and support containerisation standards using Docker, container registries such as Amazon ECR, and container security practices aligned with enterprise and regulatory expectations
  • Contribute to the design and operation of multi‑region architectures, supporting active‑active or active‑passive deployment models to meet availability, resilience, and disaster recovery objectives
  • Develop and maintain automation and operational tooling using Python, Bash, or Go, supporting platform automation, diagnostics, CI/CD integration, and operational efficiency
  • Design, develop, and operate event‑driven architectures (EDA) using industry‑standard messaging and streaming platforms, ensuring high throughput, low latency, and resilience
  • Provide deep expertise in stream processing concepts including event ordering, partitioning, replay, schema evolution, and exactly‑once/at‑least‑once semantics
Job Responsibility
Job Responsibility
  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
Read More
Arrow Right

Director of Engineering II, Kafka Connect

We are building Kafka Connect charter which is core for scalable and reliable st...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of second-level engineering management experience leading productive, high-functioning teams
  • Maintain a high hiring bar while recruiting, motivating engineers, coaching/mentoring, and managing performance
  • Experience with running large stateful data systems in the cloud
  • Strong fundamentals in distributed systems design and development
  • A great track record of shipping features and hitting deadlines consistently
  • Sense of urgency, an aggressive mindset towards achieving results, and excellent prioritisation skills
  • Able to anticipate future technical needs for the product and craft plans to realize them, guided by our customers
  • Ability to influence the team, peers, and upper management using effective communication and collaborative techniques
  • Focus on building and maintaining a culture of collaboration within the team
Job Responsibility
Job Responsibility
  • Lead a highly productive, global team of software engineers and engineering leaders
  • Drive the long-term direction and strategy of Confluent Kafka connectors, while partnering with internal stakeholders to drive the team’s mission forward
  • Create competitive advantages for Kafka connectors by driving technical innovation
  • Drive improvements in the Kafka connectors to make them more usable and powerful for customers, and make them easier to adopt and scale
  • Work closely with peer engineering leaders to prioritise improvements in all these areas - from a culture of continuous improvement to prioritising large and high-impact initiatives that will fundamentally change Kafka connectors
  • Continue a strong growth trajectory by hiring top tier engineers, and establish quality standards, design principles, and operational maturity for the team
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
Read More
Arrow Right

NGIP Platform Manager

We’re looking for a NGIP Platform Manager to join our diverse, talented and inno...
Location
Location
Australia , Richmond
Salary
Salary:
Not provided
auspost.com.au Logo
Australia Post
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Technical experience implementing and supporting Event Streaming platforms in large, complex, enterprise environments undergoing significant transformation
  • Demonstrated leadership within Confluent/Kafka software
  • Strong experience managing strategic vendor relationships, including Confluent, system integrators, and managed service providers
  • Experience working within regulated or highly governed environments with strong risk, security, and compliance obligations
  • Background leading engineering teams and previous experiences as a hands-on platform/product engineer or architect
  • In-depth knowledge of Event Streaming current and emerging technologies, including but not limited too Confluent Cloud, Confluent Platform, and core components such as Apache Kafka, Schema Registry, Kafka Connect, and ksqlDB
  • Understanding of commercial models for Event Streaming software, cloud subscriptions, and managed services, including usage-based pricing, subscription licensing, and long-term contractual implications such as SLAs, compliance, and data residency
  • Implementation experience of industry best practice for event streaming platform resilience, availability, disaster recovery, and security in mission-critical environments
Job Responsibility
Job Responsibility
  • Accountable for the Australia Post NextGen Integration Platform (NGIP) utilising the vendor supplied Confluent software, ensuring the platform is optimised and operational to underpin our future strategy
  • Responsible for overseeing the strategic planning, implementation, and management of NGIP within the organisation
  • Ensures the platform's stability, scalability, and security while driving innovation and efficiency
  • Collaborate with various departments to align the NGIP solution with business objectives, enhance customer engagement, and support the organisation's transformation initiatives
  • Managing technology professionals, including engineers, and will work across the full software development lifecycle
  • Accountable for both technology change and the run of NGIP, supporting the organisation, including business continuity, compliance, and security obligations
  • Provide enterprise leadership for NGIP as a foundational enabler of Customer Experience and Corporate Transformation outcomes
  • Provides Subject Matter Expertise and thought leadership to the broader Technology organisation regarding Integration & the NextGen Integration Platform
  • Set and enforce the target-state NGIP technical and security direction, ensuring consistency across programs, portfolios, and business units
  • Establish NGIP as secure, resilient, and scalable enterprise services capable of supporting Australia Post’s most critical business operations
  • Fulltime
Read More
Arrow Right
New

Software Engineer – Confluent Kafka on IBM Z-Linux

Join us as a Software Engineer – Confluent Kafka on IBM Z-Linux at Barclays, whe...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Design, build, configure, and operate enterprise‑grade event streaming platforms using Confluent Kafka, including brokers, ZooKeeper / KRaft mode, Schema Registry, and Kafka Connect, ensuring high availability, resilience, performance, and compliance with Barclays UK standards
  • Owning end‑to‑end delivery and operational excellence of Kafka‑centric and infrastructure platforms, with strong engineering accountability
  • Provide deep technical expertise on Linux on IBM Z platforms, including z/OS and zLinux, with a solid understanding of mainframe architecture, system integration patterns, and hybrid platform interoperability within regulated enterprise environments
  • Lead and implement advanced automation using Ansible, including the design and maintenance of playbooks, roles, custom modules, inventories, and Ansible Vault, to enable repeatable, secure, and scalable infrastructure operations
  • Develop and maintain automation and operational tooling using Python, Bash, and Shell scripting, driving efficiency, consistency, and reduction of manual operational effort across platform and infrastructure services
  • Ensure platform health, observability, and proactive issue detection through effective use of monitoring and observability tooling, such as Confluent Control Center, Prometheus, Grafana, and Esaas, with a strong focus on availability, performance, and service resilience
  • Apply Infrastructure‑as‑Code (IaC) and GitOps principles, leveraging GitLab for source control, CI/CD automation, change governance, and auditability, ensuring all platform changes are traceable, repeatable, and compliant with internal control requirements
  • Collaborate closely with application, security, and operations teams to ensure platforms are secure by design, operationally robust, and aligned with Barclays UK risk, resilience, and regulatory obligations
  • Contribute to continuous improvement of engineering standards, automation patterns, and operational run‑books, sharing knowledge and best practices across the wider engineering community
  • Strong hands‑on coding capability with a consistent focus on clean code, testability, performance, and maintainability
Job Responsibility
Job Responsibility
  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness access to wellness rooms, gyms and mental health support
  • A place where you can belong
  • Collaborative Areas
  • More than work
  • Fulltime
Read More
Arrow Right
New

Senior Engineering Manager - Metrics Platform

We’re not just building better tech. We’re rewriting how data moves and what the...
Location
Location
India
Salary
Salary:
Not provided
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 14+ years of overall experience in software development and engineering
  • 4+ years of engineering management experience, leading productive, high-performing teams
  • Experience operating large-scale distributed systems in production environments (preferably cloud-native)
  • Demonstrated ability to hire and retain top engineering talent, provide impactful coaching, and drive high-performance results
  • Proven track record of shipping features consistently and meeting aggressive deadlines with a high degree of urgency
  • Exceptional prioritization skills with the ability to balance short-term execution with a long-term strategic vision for technical evolution
  • Exceptional communication and collaboration skills, with a focus on building a positive, inclusive team culture aligned with organizational goals
  • Solid fundamentals in distributed systems design, replication protocols, and high-availability production operations
  • Deep familiarity with Kafka or similar high-scale event streaming platforms (Pulsar, Flink, etc.) in cloud environments
  • Experience operating complex architectures across large public clouds (AWS, GCP, Azure) or private cloud-native infrastructures
Job Responsibility
Job Responsibility
  • Define and execute the multi-year technical roadmap for the Metrics Platform, including Data infrastructure cluster evolution, data retention strategies, and query optimization
  • Build, mentor, and grow a world-class engineering team
  • Partner with Product Management to define and prioritize the Metrics API roadmap based on customer needs and business impact
  • Align with Confluent's broader observability strategy across Cloud and Platform offerings
  • Establish metrics and KPIs to measure system performance, system reliability, and customer satisfaction
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
Read More
Arrow Right

Staff Product Manager, Kafka Connect

We’re not just building better tech. We’re rewriting how data moves and what the...
Location
Location
Salary
Salary:
206000.00 - 242000.00 USD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience as a software product manager, ideally for an Enterprise technical product
  • Empathy for our enterprise customers, and a passion for solving their problems with the software, sometimes being hands-on
  • Ability to craft a product strategy and roadmap in concert with customers, engineering, design, and go-to-market teams
  • Excellent communication skills, including the ability to distill technical concepts to a non-technical audience
  • Strong technical competency, especially with distributed data systems, public and private clouds, and stream processing
  • Bachelor's, Master’s, or Ph.D. in Computer Science or related technical field
Job Responsibility
Job Responsibility
  • Contribute to the mission of building the world’s best data streaming platform
  • Help drive Confluent Connect’s Enterprise feature portfolio
  • Be responsible for enabling seamless, enterprise-grade integration between Kafka and common external systems
  • Support on-premise deployments and managed services in Confluent Cloud
  • Use or introduce AI/ML capabilities for the features you are building or enhancing
  • Work with the field on many GTM initiatives and be the focal point for customer success
  • Be responsible for the success of a major product initiative, from initial conception and customer development to growth strategy
  • Become the trusted resource for your product, making sure that the engineering, design, sales, and marketing have what they need to make the right trade-offs, build the right product, and grow it successfully in the market
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right