CrawlJobs Logo
Barclays Logo Barclays · IT - Software Development

Software Engineer – Confluent Kafka Management

India, Bengaluru · Job Posted April 16, 2026
Apply Position
Job Link Share

Job Description

Join us as a Software Engineer – Confluent Kafka Management at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unapparelled customer experiences. The ideal candidate will have deep expertise in cloud-native technologies, distributed streaming platforms, Kubernetes orchestration, and multi-region architecture patterns.

Job Responsibility

  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
  • To advise and influence decision making, contribute to policy development and take responsibility for operational effectiveness. Collaborate closely with other functions/ business divisions
  • Lead a team performing complex tasks, using well developed professional knowledge and skills to deliver on work that impacts the whole business function. Set objectives and coach employees in pursuit of those objectives, appraisal of performance relative to objectives and determination of reward outcomes
  • If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others
  • OR for an individual contributor, they will lead collaborative assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will identify new directions for assignments and/ or projects, identifying a combination of cross functional methodologies or practices to meet required outcomes
  • Consult on complex issues
  • providing advice to People Leaders to support the resolution of escalated issues
  • Identify ways to mitigate risk and developing new policies/procedures in support of the control and governance agenda
  • Take ownership for managing risk and strengthening controls in relation to the work done
  • Perform work that is closely related to that of other areas, which requires understanding of how areas coordinate and contribute to the achievement of the objectives of the organisation sub-function
  • Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategy
  • Engage in complex analysis of data from multiple sources of information, internal and external sources such as procedures and practises (in other areas, teams, companies, etc).to solve problems creatively and effectively
  • Communicate complex information. 'Complex' information could include sensitive information or information that is difficult to communicate because of its content or its audience
  • Influence or convince stakeholders to achieve outcomes

Requirements

  • Design, develop, and operate event‑driven architectures (EDA) using industry‑standard messaging and streaming platforms, ensuring high throughput, low latency, and resilience
  • Provide deep expertise in stream processing concepts including event ordering, partitioning, replay, schema evolution, and exactly‑once/at‑least‑once semantics
  • Act as a technical authority for streaming and EDA design decisions across delivery teams
  • Demonstrated, hands‑on expertise with Confluent Kafka ecosystem including topics, partitions, producers/consumers, schema registry, connectors, and operational best practices
  • Drive platform stability, performance tuning, capacity planning, and incident management for Kafka‑centric systems in line with BUK Service First and SRE principles
  • Lead the design, deployment, and operation of containerised applications on Amazon EKS, ensuring secure, scalable, and highly available Kubernetes clusters
  • Drive Ansible‑led automation strategies across cloud and streaming platforms, enabling repeatable, policy‑driven configuration, operational resilience, and DevOps efficiency while aligning with BUK security, risk, and compliance standards
  • Demonstrate advanced Kubernetes expertise, including operators, StatefulSets, persistent volumes, services, ingress controllers, and cluster networking, supporting stateful and stateless workloads
  • Establish best practices for cluster lifecycle management, upgrades, observability, and cost optimization across environments
  • Architect and operate cloud‑native solutions with deep hands‑on expertise across AWS core services
  • Ensure all solutions comply with Barclays security, risk, and regulatory standards, embedding security‑by‑design and least‑privilege access models
  • Own and evolve Infrastructure as Code (IaC) practices using Terraform and CloudFormation, enabling repeatable, auditable, and scalable cloud provisioning
  • Drive automation of environment builds, platform configuration, and operational runbooks to reduce manual intervention and improve reliability
  • Design and implement multi‑region AWS architectures, including active‑active and active‑passive deployments, with clear failover, disaster recovery, and data consistency strategies
  • Apply DORA metrics (deployment frequency, lead time for change, change failure rate, MTTR) to drive delivery predictability and engineering health
  • Champion engineering discipline, automation, and data‑driven decision making across delivery cycles
  • Strong familiarity with modern developer tooling including GitLab, DevSecOps pipelines, and secure CI/CD practices
  • Hands‑on experience with: Docker Desktop for local containerized development, IntelliJ IDEA or equivalent enterprise IDEs and Secure source control, branching strategies, and automated quality gates
  • Drive a test‑first, quality‑driven engineering culture with hands‑on experience in: Contract Testing (PACT) for consumer‑provider assurance, Unit Testing (JUnit) and integration testing, Performance & load testing (JMeter), Mutation testing to validate test effectiveness
  • Ensure test coverage and automation are embedded into CI/CD pipelines, not treated as post‑delivery activities
  • Working knowledge of AWS services relevant to event‑driven and streaming workloads
  • Experience deploying and operating workloads on Kubernetes (K8s), including container orchestration and scaling concepts
  • Demonstrate strong awareness and practical adoption of AI‑assisted engineering practices with AI coding assistants (e.g., Claude Code, GitLab Duo, Copilot or equivalent) to support code generation, refactoring, documentation, and test creation, while retaining engineering judgement and accountability
  • Operate as a senior Individual Contributor (ICE) with end‑to‑end ownership of complex platform components, requiring minimal supervision and demonstrating strong engineering accountability
  • Work effectively within Agile/Scrum delivery models, using Jira for backlog management, delivery tracking, and sprint execution
  • Apply strong analytical and troubleshooting skills to diagnose and resolve complex issues in distributed, event‑driven systems
  • Demonstrate excellent verbal and written communication, producing clear architecture designs, decision records, and technical documentation
  • Collaborate closely with cross‑functional teams (engineering, DevOps, security, architecture) to deliver integrated, enterprise‑ready solutions
  • Exhibit strong ownership, self‑drive, and innovation mindset, staying current with cloud‑native technologies and modern engineering best practices

What we offer

  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness access to wellness rooms, gyms and mental health support
  • A place where you can belong
  • Collaborative Areas
  • More than work
Barclays - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer – Confluent Kafka Management

8 matching positions

Data Operations Engineer

BA Markets wants to professionalise and streamline its activities with regards t...
Location
Location
Poland , Katowice
Salary
Salary:
Not provided
vattenfall.com Logo
Vattenfall
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Interest in understanding what the user needs with several years of hands-on experience as software developer with an interest in the responsibilities of a data engineer or vice versa
  • A proactive, communicative team player
  • Fluent in English
  • Deep understanding of Kafka architecture (brokers, topics, partitions, replication), and experience with Kafka Streams, Kafka Connect, and schema registry (e.g., Confluent)
  • Proficiency in designing and managing Kafka clusters (including monitoring and scaling)
  • Hands-on Experience building and maintaining real-time ETL pipelines
  • Familiarity with stream processing frameworks like: Apache Flink or Apache Spark Streaming
  • Strong skills in: Python and Java and at least basic Scala and at least solid SQL experience
  • Has build several CI/CD pipelines (e.g., Jenkins, GitLab CI, GitHub Actions)
  • And used infrastructure as Code (IaC) tools like Terraform or Ansible
Job Responsibility
Job Responsibility
  • Stream deployment and stream architecture, developments and deployments
  • Automate workflows and orchestrate data pipelines
  • Implement CI/CD routines
  • Implement and monitor “system health” with observability tools and data quality checks
  • Support the development of Client Libraries so other applications can integrate streams in own application and services
  • Perform Python development
  • Perform “glue code” development that 95% of use cases can apply
What we offer
What we offer
  • Good remuneration
  • Challenging and international work environment
  • Possibility to work with some of the best in the field
  • Working in interdisciplinary teams
  • Support from committed colleagues
  • Attractive employment conditions
  • Opportunities for personal and professional development
  • Fulltime
Read More
Arrow Right

Software Engineer–Confluent Kafka on AWS

Join us as a Software Engineer–Confluent Kafka on AWS at Barclays, where you'll ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Design, deploy, and operate production‑grade Confluent Kafka platforms, including Kafka brokers, Schema Registry, Kafka Connect, ksqlDB, and REST Proxy, ensuring high availability, scalability, and secure data streaming across domains
  • Engineer and manage cloud‑native workloads on Amazon EKS, including cluster configuration, workload deployment, upgrades, scaling, and operational support in line with Barclays engineering and security standards
  • Apply deep working knowledge of Kubernetes primitives and patterns, including StatefulSets, operators, persistent volumes, services, ingress, and Kubernetes networking, to support stateful and distributed platforms
  • Build and maintain Infrastructure as Code (IaC) using Terraform and AWS CloudFormation, enabling repeatable, auditable, and compliant provisioning of cloud and platform resources
  • Demonstrate strong understanding of AWS core services (such as EC2, VPC, IAM, S3, EKS, CloudWatch, Route53), and apply cloud‑native design principles to achieve scalability, resilience, and cost efficiency
  • Implement and support containerisation standards using Docker, container registries such as Amazon ECR, and container security practices aligned with enterprise and regulatory expectations
  • Contribute to the design and operation of multi‑region architectures, supporting active‑active or active‑passive deployment models to meet availability, resilience, and disaster recovery objectives
  • Develop and maintain automation and operational tooling using Python, Bash, or Go, supporting platform automation, diagnostics, CI/CD integration, and operational efficiency
  • Design, develop, and operate event‑driven architectures (EDA) using industry‑standard messaging and streaming platforms, ensuring high throughput, low latency, and resilience
  • Provide deep expertise in stream processing concepts including event ordering, partitioning, replay, schema evolution, and exactly‑once/at‑least‑once semantics
Job Responsibility
Job Responsibility
  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
Read More
Arrow Right

Director of Engineering II, Kafka Connect

We are building Kafka Connect charter which is core for scalable and reliable st...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of second-level engineering management experience leading productive, high-functioning teams
  • Maintain a high hiring bar while recruiting, motivating engineers, coaching/mentoring, and managing performance
  • Experience with running large stateful data systems in the cloud
  • Strong fundamentals in distributed systems design and development
  • A great track record of shipping features and hitting deadlines consistently
  • Sense of urgency, an aggressive mindset towards achieving results, and excellent prioritisation skills
  • Able to anticipate future technical needs for the product and craft plans to realize them, guided by our customers
  • Ability to influence the team, peers, and upper management using effective communication and collaborative techniques
  • Focus on building and maintaining a culture of collaboration within the team
Job Responsibility
Job Responsibility
  • Lead a highly productive, global team of software engineers and engineering leaders
  • Drive the long-term direction and strategy of Confluent Kafka connectors, while partnering with internal stakeholders to drive the team’s mission forward
  • Create competitive advantages for Kafka connectors by driving technical innovation
  • Drive improvements in the Kafka connectors to make them more usable and powerful for customers, and make them easier to adopt and scale
  • Work closely with peer engineering leaders to prioritise improvements in all these areas - from a culture of continuous improvement to prioritising large and high-impact initiatives that will fundamentally change Kafka connectors
  • Continue a strong growth trajectory by hiring top tier engineers, and establish quality standards, design principles, and operational maturity for the team
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
Read More
Arrow Right

Software Engineer – Confluent Kafka on IBM Z-Linux

Join us as a Software Engineer – Confluent Kafka on IBM Z-Linux at Barclays, whe...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Design, build, configure, and operate enterprise‑grade event streaming platforms using Confluent Kafka, including brokers, ZooKeeper / KRaft mode, Schema Registry, and Kafka Connect, ensuring high availability, resilience, performance, and compliance with Barclays UK standards
  • Owning end‑to‑end delivery and operational excellence of Kafka‑centric and infrastructure platforms, with strong engineering accountability
  • Provide deep technical expertise on Linux on IBM Z platforms, including z/OS and zLinux, with a solid understanding of mainframe architecture, system integration patterns, and hybrid platform interoperability within regulated enterprise environments
  • Lead and implement advanced automation using Ansible, including the design and maintenance of playbooks, roles, custom modules, inventories, and Ansible Vault, to enable repeatable, secure, and scalable infrastructure operations
  • Develop and maintain automation and operational tooling using Python, Bash, and Shell scripting, driving efficiency, consistency, and reduction of manual operational effort across platform and infrastructure services
  • Ensure platform health, observability, and proactive issue detection through effective use of monitoring and observability tooling, such as Confluent Control Center, Prometheus, Grafana, and Esaas, with a strong focus on availability, performance, and service resilience
  • Apply Infrastructure‑as‑Code (IaC) and GitOps principles, leveraging GitLab for source control, CI/CD automation, change governance, and auditability, ensuring all platform changes are traceable, repeatable, and compliant with internal control requirements
  • Collaborate closely with application, security, and operations teams to ensure platforms are secure by design, operationally robust, and aligned with Barclays UK risk, resilience, and regulatory obligations
  • Contribute to continuous improvement of engineering standards, automation patterns, and operational run‑books, sharing knowledge and best practices across the wider engineering community
  • Strong hands‑on coding capability with a consistent focus on clean code, testability, performance, and maintainability
Job Responsibility
Job Responsibility
  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness access to wellness rooms, gyms and mental health support
  • A place where you can belong
  • Collaborative Areas
  • More than work
  • Fulltime
Read More
Arrow Right

Senior Engineering Manager - Metrics Platform

We’re not just building better tech. We’re rewriting how data moves and what the...
Location
Location
India
Salary
Salary:
Not provided
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 14+ years of overall experience in software development and engineering
  • 4+ years of engineering management experience, leading productive, high-performing teams
  • Experience operating large-scale distributed systems in production environments (preferably cloud-native)
  • Demonstrated ability to hire and retain top engineering talent, provide impactful coaching, and drive high-performance results
  • Proven track record of shipping features consistently and meeting aggressive deadlines with a high degree of urgency
  • Exceptional prioritization skills with the ability to balance short-term execution with a long-term strategic vision for technical evolution
  • Exceptional communication and collaboration skills, with a focus on building a positive, inclusive team culture aligned with organizational goals
  • Solid fundamentals in distributed systems design, replication protocols, and high-availability production operations
  • Deep familiarity with Kafka or similar high-scale event streaming platforms (Pulsar, Flink, etc.) in cloud environments
  • Experience operating complex architectures across large public clouds (AWS, GCP, Azure) or private cloud-native infrastructures
Job Responsibility
Job Responsibility
  • Define and execute the multi-year technical roadmap for the Metrics Platform, including Data infrastructure cluster evolution, data retention strategies, and query optimization
  • Build, mentor, and grow a world-class engineering team
  • Partner with Product Management to define and prioritize the Metrics API roadmap based on customer needs and business impact
  • Align with Confluent's broader observability strategy across Cloud and Platform offerings
  • Establish metrics and KPIs to measure system performance, system reliability, and customer satisfaction
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
Read More
Arrow Right

Staff Product Manager, Kafka Connect

We’re not just building better tech. We’re rewriting how data moves and what the...
Location
Location
Salary
Salary:
206000.00 - 242000.00 USD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience as a software product manager, ideally for an Enterprise technical product
  • Empathy for our enterprise customers, and a passion for solving their problems with the software, sometimes being hands-on
  • Ability to craft a product strategy and roadmap in concert with customers, engineering, design, and go-to-market teams
  • Excellent communication skills, including the ability to distill technical concepts to a non-technical audience
  • Strong technical competency, especially with distributed data systems, public and private clouds, and stream processing
  • Bachelor's, Master’s, or Ph.D. in Computer Science or related technical field
Job Responsibility
Job Responsibility
  • Contribute to the mission of building the world’s best data streaming platform
  • Help drive Confluent Connect’s Enterprise feature portfolio
  • Be responsible for enabling seamless, enterprise-grade integration between Kafka and common external systems
  • Support on-premise deployments and managed services in Confluent Cloud
  • Use or introduce AI/ML capabilities for the features you are building or enhancing
  • Work with the field on many GTM initiatives and be the focal point for customer success
  • Be responsible for the success of a major product initiative, from initial conception and customer development to growth strategy
  • Become the trusted resource for your product, making sure that the engineering, design, sales, and marketing have what they need to make the right trade-offs, build the right product, and grow it successfully in the market
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right

Senior Software Engineer II

We’re not just building better tech. We’re rewriting how data moves and what the...
Location
Location
India
Salary
Salary:
Not provided
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 8 years of relevant experience
  • Experience in architecting, designing, and developing highly scalable and performant backend services
  • Proficiency in a major programming language e.g.Go,Java, C / C++, etc.
  • Experience of working on Kubernetes, Public Clouds - AWS, GCP, & Azure
  • Familiarity with Kafka, Streaming, SaaS platform development
  • Deep knowledge of designing distributed systems in the Cloud
  • Experience in running production services in Public Clouds, with a drive towards quality, accuracy, and operational excellence
  • Strong problem-solving and analytical/critical thinking skills with attention to details
  • A strategic engineer who constantly thinks of operational improvements of the service to meet availability and performance SLA
  • Comfortable with troubleshooting technical issues across services and multi-level technical stacks that includes microservices, containers, and virtualization
Job Responsibility
Job Responsibility
  • Build accurate, reliable, scalable, and functionally rich systems in the cloud to support usage-based billing and pricing in the cloud that powers Confluent’s revenue across all products and global markets
  • Work on business-critical flows from ideation to completion by closely collaborating with Product Managers, different engineering and business teams
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
Read More
Arrow Right

Staff Software Engineer I - Internal Access Management

We are seeking a Staff Software Engineer to lead the technical vision, architect...
Location
Location
Salary
Salary:
225100.00 - 264500.00 CAD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of engineering experience
  • 4+ years in security, IAM, or distributed systems
  • Deep expertise in Kubernetes, workload identity, cloud IAM (AWS, GCP, Azure), and zero-trust architectures
  • Strong understanding of authentication technologies: IAM, OAuth2, OIDC, policy engines, and modern zero-trust principles
  • Proven track record leading multi-team technical initiatives at a Staff or Senior Staff level
  • Strong knowledge of distributed systems, cloud infrastructure, container orchestration, and service mesh
  • Excellent communication and stakeholder-influence skills across engineering and security domains
Job Responsibility
Job Responsibility
  • Define and drive the long-term architecture and roadmap for Internal Access Management across Kubernetes and multi-cloud environments
  • Architect and implement least privilege, just-in-time access, and zero-trust models across Confluent services
  • Build and evolve scalable access-authorization workflows and lifecycle management systems using technologies such as SPIFFE/SPIRE, OPA, cloud IAM policies, workload identity, and internal enforcement engines
  • Strengthen security boundaries through threat modeling, defense-in-depth practices, and comprehensive access-auditing capabilities
  • Partner with cross-functional teams—including Platform, Kafka, Observability, Developer Productivity, Release Engineering, and SRE—to drive adoption of secure identity and access patterns
  • Mentor senior engineers, elevate engineering standards, and influence architectural decisions across the organization
  • Communicate complex technical decisions clearly and align stakeholders across engineering and security
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right