CrawlJobs Logo

Software Engineer–Confluent Kafka on AWS

India, Bengaluru · Job Posted April 16, 2026
Apply Position
Job Link Share

Job Description

Join us as a Software Engineer–Confluent Kafka on AWS at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unapparelled customer experiences. The ideal candidate will have expertise in cloud-native technologies, distributed streaming platforms, Kubernetes orchestration, and multi-region architecture patterns.

Job Responsibility

  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability

Requirements

  • Design, deploy, and operate production‑grade Confluent Kafka platforms, including Kafka brokers, Schema Registry, Kafka Connect, ksqlDB, and REST Proxy, ensuring high availability, scalability, and secure data streaming across domains
  • Engineer and manage cloud‑native workloads on Amazon EKS, including cluster configuration, workload deployment, upgrades, scaling, and operational support in line with Barclays engineering and security standards
  • Apply deep working knowledge of Kubernetes primitives and patterns, including StatefulSets, operators, persistent volumes, services, ingress, and Kubernetes networking, to support stateful and distributed platforms
  • Build and maintain Infrastructure as Code (IaC) using Terraform and AWS CloudFormation, enabling repeatable, auditable, and compliant provisioning of cloud and platform resources
  • Demonstrate strong understanding of AWS core services (such as EC2, VPC, IAM, S3, EKS, CloudWatch, Route53), and apply cloud‑native design principles to achieve scalability, resilience, and cost efficiency
  • Implement and support containerisation standards using Docker, container registries such as Amazon ECR, and container security practices aligned with enterprise and regulatory expectations
  • Contribute to the design and operation of multi‑region architectures, supporting active‑active or active‑passive deployment models to meet availability, resilience, and disaster recovery objectives
  • Develop and maintain automation and operational tooling using Python, Bash, or Go, supporting platform automation, diagnostics, CI/CD integration, and operational efficiency
  • Design, develop, and operate event‑driven architectures (EDA) using industry‑standard messaging and streaming platforms, ensuring high throughput, low latency, and resilience
  • Provide deep expertise in stream processing concepts including event ordering, partitioning, replay, schema evolution, and exactly‑once/at‑least‑once semantics
  • Demonstrated, hands‑on expertise with Confluent Kafka ecosystem including topics, partitions, producers/consumers, schema registry, connectors, and operational best practices
  • Build and maintain stream‑processing applications using Kafka Streams, applying stateful and stateless processing patterns to support real‑time business events and data enrichment use‑cases
  • Strong hands‑on coding capability with a consistent focus on clean code, testability, performance, and maintainability
  • Contribute directly to production‑grade codebases and review peer code to enforce Barclays engineering standards and quality gates
  • Deliver software using Agile methodologies, actively participating in sprint planning, reviews, retrospectives, and continuous improvement
  • Champion engineering discipline, automation, and data‑driven decision making across delivery cycles
  • Strong familiarity with modern developer tooling including GitLab, DevSecOps pipelines, and secure CI/CD practices
  • Hands‑on experience with: Docker Desktop for local containerized development, IntelliJ IDEA or equivalent enterprise IDEs and Secure source control, branching strategies, and automated quality gates
  • Drive a test‑first, quality‑driven engineering culture with hands‑on experience in: Contract Testing (PACT) for consumer‑provider assurance, Unit Testing (JUnit) and integration testing, Performance & load testing (JMeter), Mutation testing to validate test effectiveness
  • Ensure test coverage and automation are embedded into CI/CD pipelines, not treated as post‑delivery activities
  • Experience deploying and operating workloads on Kubernetes (K8s), including container orchestration and scaling concepts
  • Demonstrate strong awareness and practical adoption of AI‑assisted engineering practices with AI coding assistants (e.g., Claude Code, GitLab Duo, Copilot or equivalent) to support code generation, refactoring, documentation, and test creation, while retaining engineering judgement and accountability
  • Act as a individual contributor engineer (ICE), owning end‑to‑end delivery, stability, and operational resilience of platform and infrastructure components with minimal supervision and strong engineering accountability
  • Work effectively within Agile/Scrum delivery models, using Jira for backlog management, delivery tracking, and sprint execution
  • Apply strong analytical and troubleshooting skills to diagnose and resolve complex issues in distributed, event‑driven systems
  • Demonstrate excellent verbal and written communication, producing clear architecture designs, decision records, and technical documentation
  • Collaborate closely with cross‑functional teams (engineering, DevOps, security, architecture) to deliver integrated, enterprise‑ready solutions
  • Exhibit strong ownership, self‑drive, and innovation mindset, staying current with cloud‑native technologies and modern engineering best practices

What we offer

  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer–Confluent Kafka on AWS

8 matching positions

Software Engineer – Confluent Kafka on IBM Z-Linux

Join us as a Software Engineer – Confluent Kafka on IBM Z-Linux at Barclays, whe...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Design, build, configure, and operate enterprise‑grade event streaming platforms using Confluent Kafka, including brokers, ZooKeeper / KRaft mode, Schema Registry, and Kafka Connect, ensuring high availability, resilience, performance, and compliance with Barclays UK standards
  • Owning end‑to‑end delivery and operational excellence of Kafka‑centric and infrastructure platforms, with strong engineering accountability
  • Provide deep technical expertise on Linux on IBM Z platforms, including z/OS and zLinux, with a solid understanding of mainframe architecture, system integration patterns, and hybrid platform interoperability within regulated enterprise environments
  • Lead and implement advanced automation using Ansible, including the design and maintenance of playbooks, roles, custom modules, inventories, and Ansible Vault, to enable repeatable, secure, and scalable infrastructure operations
  • Develop and maintain automation and operational tooling using Python, Bash, and Shell scripting, driving efficiency, consistency, and reduction of manual operational effort across platform and infrastructure services
  • Ensure platform health, observability, and proactive issue detection through effective use of monitoring and observability tooling, such as Confluent Control Center, Prometheus, Grafana, and Esaas, with a strong focus on availability, performance, and service resilience
  • Apply Infrastructure‑as‑Code (IaC) and GitOps principles, leveraging GitLab for source control, CI/CD automation, change governance, and auditability, ensuring all platform changes are traceable, repeatable, and compliant with internal control requirements
  • Collaborate closely with application, security, and operations teams to ensure platforms are secure by design, operationally robust, and aligned with Barclays UK risk, resilience, and regulatory obligations
  • Contribute to continuous improvement of engineering standards, automation patterns, and operational run‑books, sharing knowledge and best practices across the wider engineering community
  • Strong hands‑on coding capability with a consistent focus on clean code, testability, performance, and maintainability
Job Responsibility
Job Responsibility
  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness access to wellness rooms, gyms and mental health support
  • A place where you can belong
  • Collaborative Areas
  • More than work
  • Fulltime
Read More
Arrow Right

Software Engineer – Confluent Kafka Management

Join us as a Software Engineer – Confluent Kafka Management at Barclays, where y...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Design, develop, and operate event‑driven architectures (EDA) using industry‑standard messaging and streaming platforms, ensuring high throughput, low latency, and resilience
  • Provide deep expertise in stream processing concepts including event ordering, partitioning, replay, schema evolution, and exactly‑once/at‑least‑once semantics
  • Act as a technical authority for streaming and EDA design decisions across delivery teams
  • Demonstrated, hands‑on expertise with Confluent Kafka ecosystem including topics, partitions, producers/consumers, schema registry, connectors, and operational best practices
  • Drive platform stability, performance tuning, capacity planning, and incident management for Kafka‑centric systems in line with BUK Service First and SRE principles
  • Lead the design, deployment, and operation of containerised applications on Amazon EKS, ensuring secure, scalable, and highly available Kubernetes clusters
  • Drive Ansible‑led automation strategies across cloud and streaming platforms, enabling repeatable, policy‑driven configuration, operational resilience, and DevOps efficiency while aligning with BUK security, risk, and compliance standards
  • Demonstrate advanced Kubernetes expertise, including operators, StatefulSets, persistent volumes, services, ingress controllers, and cluster networking, supporting stateful and stateless workloads
  • Establish best practices for cluster lifecycle management, upgrades, observability, and cost optimization across environments
  • Architect and operate cloud‑native solutions with deep hands‑on expertise across AWS core services
Job Responsibility
Job Responsibility
  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
  • To advise and influence decision making, contribute to policy development and take responsibility for operational effectiveness. Collaborate closely with other functions/ business divisions
  • Lead a team performing complex tasks, using well developed professional knowledge and skills to deliver on work that impacts the whole business function. Set objectives and coach employees in pursuit of those objectives, appraisal of performance relative to objectives and determination of reward outcomes
  • If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others
  • OR for an individual contributor, they will lead collaborative assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will identify new directions for assignments and/ or projects, identifying a combination of cross functional methodologies or practices to meet required outcomes
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness access to wellness rooms, gyms and mental health support
  • A place where you can belong
  • Collaborative Areas
  • More than work
  • Fulltime
Read More
Arrow Right

Software engineer

We are looking for a highly skilled and motivated Software Engineer to strengthe...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
amcsgroup.com Logo
AMCS Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in software engineering, with expertise in building platforms, infrastructure or foundation systems
  • Proficiency in one or more programming languages (e.g. Go, Python, TypeScript, C#, Java)
  • Deep experience with cloud platforms (Azure, AWS or GCP)
  • Experience with event streaming
  • Strong background in Infrastructure as Code (Terraform)
  • Expertise with CI/CD systems (Azure DevOps)
  • Experience with containers and orchestration (Docker, Kubernetes)
  • Solid knowledge of distributed systems, networks and system design
  • Experience with deploying and automating Confluent Kafka infrastructure (self-managed or cloud) using IaC and modern DevOps practices, with a good understanding of partitioning, replication and stream processing patterns
  • Experience with observability tools (OpenTelemetry, Grafana, Datadog, etc.)
Job Responsibility
Job Responsibility
  • Platform architecture and development: design, build and maintain scalable platform services, tools and automation to support product engineering teams
  • Develop high-quality, reusable frameworks and infrastructure components
  • Contribute to and influence platform architecture, technology choices and long-term roadmap
  • Cloud infrastructure & reliability: build and maintain cloud-native infrastructure using IaC (e.g. Terraform, Bicep)
  • Implement highly reliable, resilient and secure systems according to SecOps and DevOps best practices
  • Drive improvements in observability (metrics, logging, tracing) and system reliability
  • Developer experience & support: develop internal tools, automation and workflows that improve engineering productivity
  • Collaborate with engineering teams to understand friction points and remove barriers
  • Champion best practices in CI/CD, event streaming, test automation and deployment strategies
  • Security & compliance: integrate security controls and guardrails into platform capabilities
  • Fulltime
Read More
Arrow Right

Staff Software Engineer I – Control Plane Core Infrastructure

Location
Location
Canada
Salary
Salary:
225100.00 - 264500.00 CAD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Typically 6+ years of software engineering experience, with a strong track record of delivering complex backend or distributed systems to production
  • Deep hands‑on experience with at least some of: Distributed systems design (consistency models, failure modes, data modeling, scalability)
  • Cloud platforms (AWS, GCP, or Azure) and cloud‑native architectures
  • Kubernetes or similar orchestration platforms
  • Proficiency in one or more of Go, Java or Scala, and comfort working across services, infrastructure, and automation
  • Able to define end‑to‑end designs, break them into milestones, de‑risk early, and land them on time with high quality
  • Operationally rigorous: you think in terms of SLOs, failure modes, observability, and incident response
  • you design for safe change and graceful degradation
  • Great communicator: you write clear design docs, explain trade‑offs crisply, and can lead technical discussions with diverse stakeholders (engineers, PMs, leadership)
  • Leader without authority: you’ve successfully led cross‑team projects, influenced technical direction beyond your immediate code, and helped others level up
Job Responsibility
Job Responsibility
  • Own end‑to‑end architecture and delivery of complex control‑plane systems (APIs, controllers, orchestration workflows, data models) that support Confluent Cloud products
  • Lead open‑ended technical initiatives: take ambiguous problems, clarify requirements, define the approach, and drive execution across teams and services
  • Raise the bar on reliability and operations by building resilient systems with strong observability, clear SLOs, runbooks, and safe rollout/rollback patterns
  • Collaborate across orgs (Cloud Platform, Kafka, Compute, Security, Traffic, SRE and others) to align on designs, trade‑offs, and long‑term platform direction
  • Mentor and unblock engineers at multiple levels
  • provide high‑quality design and code reviews, and help grow the broader engineering team
  • Continuously improve developer experience for our control‑plane stack (tooling, automation, CI/CD, test strategy) to remove toil and increase velocity
  • Influence technical strategy in your domain: identify high‑impact opportunities, propose roadmaps, and help prioritize work aligned with business goals
  • Contribute to engineering culture via documentation, design reviews, and knowledge sharing (internal talks, wikis, or external content where appropriate)
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

We’re not just building better tech. We’re rewriting how data moves and what the...
Location
Location
United Kingdom
Salary
Salary:
Not provided
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS, MS, or PhD in computer science or a related field, or equivalent work experience
  • 4+ years of relevant cloud infrastructure/cloud networking experience
  • Strong fundamentals in distributed systems design and development
  • Experience building and operating large-scale systems
  • Solid understanding of basic systems operations (disk, network, operating systems, etc)
  • A self-starter with the ability to work effectively in teams
  • Proficiency in Go, Python, C++, or other statically typed languages
  • Experience/knowledge with public clouds (AWS, Azure or GCP)
Job Responsibility
Job Responsibility
  • Design, implement and maintain Golang infrastructure services (typically implemented as Kubernetes operators) to deliver the Confluent cloud foundations to the wider engineering organization
  • As a Confluent Cloud Infrastructure Software Engineer, you will be working alongside the rest of the Confluent engineers to build our PaaS product
  • You, and the rest of the team, will be responsible for the availability, performance, monitoring, emergency response, and capacity planning of the Confluent cloud
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right

Senior Software Engineer II

We’re not just building better tech. We’re rewriting how data moves and what the...
Location
Location
United Kingdom
Salary
Salary:
Not provided
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS, MS, or PhD in computer science or a related field, or equivalent work experience
  • 6+ years of relevant cloud infrastructure/cloud networking experience
  • Strong fundamentals in distributed systems design and development
  • Experience building and operating large-scale systems
  • Solid understanding of basic systems operations (disk, network, operating systems, etc)
  • A self-starter with the ability to work effectively in teams
  • Proficiency in Go, Python, C++, or other statically typed languages
  • Experience/knowledge with public clouds (AWS, Azure or GCP)
Job Responsibility
Job Responsibility
  • Design, implement and maintain Golang infrastructure services (typically implemented as Kubernetes operators) to deliver the Confluent cloud foundations to the wider engineering organization
  • Terraform, Datadog, Prometheus and a strong command of Linux, public cloud and networking should come as standard - though Golang software engineering will be your primary focus
  • As a Confluent Cloud Infrastructure Software Engineer, you will be working alongside the rest of the Confluent engineers to build our PaaS product
  • You, and the rest of the team, will be responsible for the availability, performance, monitoring, emergency response, and capacity planning of the Confluent cloud
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
Read More
Arrow Right

Senior Software Engineer - GM Motorsports

GM’s Motorsports IT team will analyze, define, and deliver the next generation o...
Location
Location
United States , Austin, Texas; Concord, North Carolina
Salary
Salary:
Not provided
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 7 years of professional software development experience
  • Excellent technical knowledge of Python and web frameworks (e.g., Flask, Django)
  • Experience with front end frameworks like Angular/React
  • Experience with event streaming and message brokers (e.g., Kafka, Event Hubs Confluent)
  • Experience with cloud infrastructure (e.g., AWS, Azure, or GCP)
  • Experience deploying, maintaining, supporting containerized applications (Docker, Kubernetes)
  • Experience with SQL and NoSQL database technologies (Postgres, MongoDB, Redis)
  • Proven ability to write maintainable, testable and reusable code
  • Self-starter mindset with the ability to quickly learn and adapt to existing software ecosystems
  • Experience with Agile development methodologies
Job Responsibility
Job Responsibility
  • Build web applications using Python, AngularJS, and SQL and other modern technologies to support race day operations
  • Update existing software and/or develop new software solutions to address a specific need or solve a particular business problem
  • Write high-quality code using systematic, repeatable development practices
  • Diagnose and resolve software issues related to code quality, security vulnerabilities, frameworks and usability
  • Collaborate closely with peers to align code with established design patterns while continuously developing your own technical skills
  • Integrate new applications seamlessly with our existing systems and infrastructure
  • Automate unit and end-to-end testing to ensure software quality, reliability, and ease of maintenance
  • Mentor and guide fellow software developers to elevate the team's overall capability
  • Optimize system performance, assess usability, document processes, and uphold rigorous technical standards
  • Manage build and release automation to ensure smooth, continuous delivery
What we offer
What we offer
  • This job may be eligible for relocation benefits
  • Fulltime
Read More
Arrow Right

Sr AppDev Engineer - Go - Java - SpringBoot - Kafka - NoSQL Database

We have a 6 month contract to hire opportunity for a senior-level Application De...
Location
Location
Salary
Salary:
Not provided
zeektek.com Logo
Zeektek
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree
  • 4-6+ years experience
  • Senior-level individual contributor supporting enterprise contract management and event-driven integrations
  • Expected to operate independently and own complex integrations with minimal ramp-up
  • Hands-on Kafka production support experience
  • Experience integrating with enterprise SaaS or contract management platforms (Icertis or similar preferred)
  • Experience working in cloud environments (AWS and/or Azure) supporting integrations and deployments
  • Strong experience with data integration across multiple storage platforms
  • Ability to independently assess integration risks and recommend solutions
  • Strong cross-team communication skills with both technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Support backend integrations with enterprise contract management platforms (including Icertis or similar CLM systems)
  • Design, manage, and troubleshoot Kafka-based event integrations
  • Coordinate with Kafka and platform teams on topic configuration, promotion, and cloud migration
  • Support Confluent Cloud Kafka topics and mirroring strategies
  • Assist with production support, release validation, and incident troubleshooting
  • Work with enterprise data storage systems for integration, access, and troubleshooting
  • Develops or prototypes software modules at various levels of complexity, including but not limited to: service interfaces, process flows, service messages, SOA components, business logic, UI/UX, or data access logic
  • Designs, develops, tests, and deploys software solutions and process flows complying with standards, guidelines, and best practices
  • Identifies, assesses, and formulates architectural impacts and solutions from business requirements
  • Collaborates to ensure application designs utilize appropriate patterns and standards
What we offer
What we offer
  • Weekly Direct Deposit
  • 401K Matching
  • Competitive medical, dental and vision insurance
  • Consistent communication throughout your project
  • ZeekTek Referral Program
  • Fulltime
Read More
Arrow Right