CrawlJobs Logo
Barclays Logo Barclays · IT - Software Development

Kafka Streaming Architect

United States, New York Employment contract 170000.00 - 230000.00 USD / Year · Job Posted June 10, 2026
Apply Position
Job Link Share

Job Description

Embark on a transformative journey as a Kafka Streaming Architect. At Barclays, our vision is clear –to redefine the future of banking and help craft innovative solutions. In this role, you will work in shaping the real time data backbone that powers mission critical business capabilities, advanced analytics, and next-generation AI driven innovation. This is a unique opportunity to work at the forefront of streaming architecture, influence enterprise-scale transformation, and leave a lasting mark on a platform that is central to Barclays’ future success.

Job Responsibility

  • Design, develop, and implement solutions to complex business problems
  • Design and development of solutions as products that can evolve, meeting business requirements that align with modern software engineering practices and automated delivery tooling
  • Targeted design activities that apply an appropriate workload placement strategy and maximise the benefit of cloud capabilities such as elasticity, serverless, containerisation etc.
  • Best practice designs incorporating security principles that meet the Bank’s resiliency expectations
  • Solutions that appropriately balance risks and controls to deliver the agreed business and technology value
  • Adoption of standardised solutions where they fit
  • Fault finding and performance issues support to operational support teams
  • Solution design impact assessment in terms of risk, capacity and cost impact
  • Development of the requisite architecture inputs required to comply with the banks governance processes

Requirements

  • Demonstrated ability designing and delivering Kafka-based streaming applications in complex enterprise environments
  • Established coding experience in Java and Python for building high-performance, scalable solutions
  • Deep experience building real-time data pipelines using Kafka Streams, Flink, or similar streaming technologies
  • Considerable understanding of high-throughput, low-latency distributed systems and platform resilience
  • Demonstrated ability to collaborate with architects, engineers, and business stakeholders to deliver strategic outcomes

Nice to have

  • Experience with NoSQL and modern data platforms such as MongoDB or ClickHouse
  • Exposure to AI/ML system design and data-driven solution development
  • Ample foundation in enterprise software engineering, including Spring Boot and middleware-based architectures
  • Familiarity with Agile / Scrum delivery models in fast-paced engineering teams
  • Excellent communication and presentation skills, with the ability to influence technical direction

What we offer

  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
Barclays - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Kafka Streaming Architect

8 matching positions

Liquid Finance Streaming Architect

Embark on a transformative journey as a Liquid Finance Streaming Architect. At B...
Location
Location
United States , New York
Salary
Salary:
120000.00 - 175000.00 USD / Year
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Building Kafka producer/consumer applications and with Kafka Streams API, Flink, or similar streaming frameworks
  • Enterprise Java developer such as Spring Boot and middleware
  • Building real-time data pipelines, including ETL and data distribution
  • Relational databases (MS SQL)
  • Large-scale, high‑volume data systems
Job Responsibility
Job Responsibility
  • Design and development of solutions as products that can evolve, meeting business requirements that align with modern software engineering practices and automated delivery tooling
  • Targeted design activities that apply an appropriate workload placement strategy and maximise the benefit of cloud capabilities
  • Best practice designs incorporating security principles
  • Solutions that appropriately balance risks and controls to deliver the agreed business and technology value
  • Adoption of standardised solutions where they fit
  • Fault finding and performance issues support to operational support teams
  • Solution design impact assessment in terms of risk, capacity and cost impact
  • Development of the requisite architecture inputs required to comply with the banks governance processes
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right

Kafka Architect

Arch JD: Kafka Architect Exp: 9 to 15 Years Location: Mumbai/Pune/Hyd/Bangalore/...
Location
Location
India , Mumbai
Salary
Salary:
3500000.00 INR / Year
overturerede.in Logo
Overture Rede
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands on experience in architecting and designing highly scalable streaming applications by using Kafka (AWS MSK or Confluent)
  • Hands on experience in building cloud native applications in AWS services (S3, ECS, Lambdas, EC2, CloudWatch, Glue catalogs)
  • Strong knowledge in Java and Spring Boot micro services architecture
  • Strong and hands on knowledge on creating and using apache-parquet files in S3
  • Java hands on experience in transforming the schema formats XML to JSON (or) JSON to JSON
  • Strong knowledge in application monitoring (Elasticsearch, Logstash, and Kibana)
  • Ability to use CICD pipeline
  • Work Experience 5+ years
  • BGV: Mandatory, candidate must have UAN account number
  • Fulltime
Read More
Arrow Right

Staff Software Engineer (Kafka Streaming)

We are building our next-generation Data Enrichment Platform and we need a heavy...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
bazaarvoice.com Logo
Bazaarvoice
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of software engineering experience
  • At least 5 years of deep production expertise in Scala or Java (concurrency, memory management, GC tuning)
  • Deep JVM knowledge required
  • 5+ years hands-on with the Kafka ecosystem (Apache Kafka, Kafka Streams, Kafka Connect, Flink, Spark)
  • Proven track record of designing resilient systems under heavy load
  • Mastery of the AWS ecosystem (MSK, EMR, Athena, Lambda)
  • Experience with Terraform
  • Experience with Kubernetes
Job Responsibility
Job Responsibility
  • Architect high-throughput pipelines
  • Solve complex latency challenges
  • Define standards for a robust Lakehouse architecture
  • Lead design of distributed streaming architectures using Kafka Streams, Spark, and Flink
  • Build roadmap for transition to Lakehouse architecture
  • Dive deep to identify system bottlenecks
  • Own stability of pipelines processing massive events per second
  • Solve for data integrity and low latency
  • Drive culture of reliability through robust monitoring (Datadog/Prometheus), observability, and automated testing frameworks
  • Proactively identify opportunities to refactor and modernize platform for efficiency and cost-effectiveness
What we offer
What we offer
  • Competitive salary
  • Insurance
  • Annual leave
  • Bonuses
  • Referral rewards
  • Fulltime
Read More
Arrow Right

Kafka Architect

At Intellibus, we engineer cutting-edge platforms that power the financial tradi...
Location
Location
United States , Reston
Salary
Salary:
Not provided
intellibus.com Logo
Intellibus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or a related field preferred (or equivalent experience)
  • 10+ years of Java development experience
  • 7+ years of Kafka experience in a production environment
  • Proven experience in high-performance, low-latency systems
  • Experience with AWS, Kubernetes (EKS), Terraform
  • Strong knowledge of Unix/Linux environments
  • Financial Services / FinTech experience preferred
  • Excellent communication and leadership skills
Job Responsibility
Job Responsibility
  • Design, build, and optimize Kafka infrastructure to handle millions of messages per second
  • Architect event-driven microservices leveraging Kafka Streams and kSQL
  • Develop Java-based streaming applications using Kafka, Spring Boot, and Flink
  • Implement multi-region Kafka deployments on AWS with automated failover
  • Tune Kafka producers, consumers, and brokers for low-latency, high-throughput workloads
  • Design schema evolution strategies using Apache Avro and Schema Registry
  • Implement Kafka security best practices (SSL, SASL, ACLs, RBAC)
  • Set up Kafka Connect with connectors for databases, object storage, and messaging queues
  • Optimize Zookeeper and Kafka cluster configurations for resilience and scalability
  • Use Terraform and Kubernetes to automate Kafka cluster deployments
Read More
Arrow Right
New

Senior Data Engineer

About this role: Wells Fargo is seeking a Senior Data Engineer. In this role, ...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
June 12, 2026
Flip Icon
Requirements
Requirements
  • 4+ years of Data Engineering experience
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • 6-10 years of professional experience in data engineering or related roles
  • Proven experience handling large-scale, high-volume data systems
  • Apache Spark (Core, SQL, DataFrames/Datasets)
  • ETL tools – Preferably Informatica
  • Databases: Oracle
  • Streaming Technologies: Apache Kafka and Apache Flink
  • Cloud Storage: Amazon S3
  • NoSQL: Working knowledge of MongoDB
Job Responsibility
Job Responsibility
  • Lead moderately complex initiatives within Technology and contribute to large scale data processing framework initiatives related to enterprise strategy deliverables
  • Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting
  • Review and analyze moderately complex business, operational or technical challenges that require an in-depth evaluation of variable factors
  • Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis
  • Resolve moderately complex issues and lead teams to meet data engineering deliverables while leveraging solid understanding of data information policies, procedures and compliance requirements
  • Collaborate and consult with colleagues and managers to resolve data engineering issues and achieve strategic goals
  • Design, develop, and maintain scalable and reliable data pipelines using Apache Spark for batch and near-real-time processing
  • Build, enhance, and support ETL workflows, preferably using Informatica, ensuring data quality, performance, and reliability
  • Develop and maintain integrations with Oracle databases, including data modeling, performance tuning, and query optimization
  • Implement and manage streaming data pipelines using Apache Kafka and Apache Flink for real-time data ingestion and processing
  • Fulltime
!
Read More
Arrow Right
New

Data Modeler

We are looking for a Data Modeler to support a healthcare organization in Morris...
Location
Location
United States , Morristown
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience designing data models across relational, dimensional, and NoSQL environments
  • Strong working knowledge of ETL processes and data pipeline concepts
  • Proficiency with Python for data-focused development and automation tasks
  • Experience using Apache Spark in large-scale data processing environments
  • Familiarity with Apache Hadoop and distributed data ecosystems
  • Working knowledge of Apache Kafka for streaming or event-driven data architectures
  • Ability to document metadata, lineage, and business definitions in a clear and organized manner
  • Strong collaboration skills with the ability to work effectively across engineering, architecture, and analytics teams
Job Responsibility
Job Responsibility
  • Create and refine conceptual, logical, and physical data structures for relational databases, dimensional warehouses, and NoSQL platforms
  • Produce and update entity relationship diagrams, data movement documentation, and related artifacts that align with enterprise data practices
  • Work alongside data engineers and solution architects to ensure models support efficient data ingestion, transformation, and downstream reporting needs
  • Convert business objectives and functional use cases into well-structured database designs that promote performance, flexibility, and long-term growth
  • Lead model evaluations, uphold data modeling standards, and offer mentorship and technical direction to less experienced team members
  • Maintain data dictionaries, metadata records, and lineage documentation to improve transparency and usability across the data estate
  • Partner with analytics and reporting stakeholders to develop star and snowflake schema designs for warehouse and data mart solutions
  • Address data integrity concerns, duplication risks, and quality issues by applying disciplined modeling techniques and sound design principles
  • Contribute to governance efforts by supporting data standardization and cataloging activities across the organization
  • Participate in Agile delivery cycles, providing modeling deliverables and documentation in iterative sprint-based workstreams
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Senior Developer / Solutions Architect

Are you a Senior Developer / Solutions Architect? Are you equally adept and prov...
Location
Location
Canada , Victoria
Salary
Salary:
73.91 - 80.07 USD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
August 04, 2026
Flip Icon
Requirements
Requirements
  • OpenShift container platform and Docker-based delivery
  • .NET (version 8/10) and Angular application development
  • Java / Quarkus at production depth
  • Custom Java extensibility (e.g., Keycloak SPIs or equivalent)
  • API management platforms (e.g., Red Hat 3scale or equivalent)
  • Azure DevOps Server 2020 (on-premises, classic pipelines)
Job Responsibility
Job Responsibility
  • Lead the design and implementation of end-to-end solution architectures, delivering production-grade code and maintaining ownership from architecture through implementation
  • Deliver incremental, production-ready solutions, collaborating across development and operations teams to ensure systems are observable, supportable, and aligned with enterprise standards
  • Design and implement services, APIs, and event-driven solutions, enabling scalable, resilient integration across legacy and modern platforms
  • Develop and optimize integration and data pipelines, including REST/SOAP services, Kafka-based streaming, and CDC architectures aligned to schema and contract management practices
  • Build and extend platform capabilities through custom development, including Java-based extensions (e.g., Keycloak SPIs, Debezium connectors) where off-the-shelf solutions are insufficient
  • Configure and optimize platform, API management, and security components, including OpenShift, API gateways, identity (OIDC/OAuth2), and TLS-secured communications
What we offer
What we offer
  • Competitive Market Rates
  • Work primarily remote
  • Long-term contract with the potential for extensions
Read More
Arrow Right
New

Technical Lead – AI/ML

Technical Lead – AI/ML to lead the design and delivery of enterprise-grade agent...
Location
Location
United States , Atlanta
Salary
Salary:
Not provided
acuverconsulting.com Logo
Acuver Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–12 years in software/AI engineering, including 2+ years leading teams or owning technical delivery as a hands-on lead
  • Demonstrated domain exposure in commerce/retail, e-commerce, fulfillment, logistics, or supply chain
  • Track record shipping AI/ML systems to production in enterprise or client-services settings
  • Strong communication and presence
  • Proven, hands-on experience designing and shipping enterprise-grade agentic AI systems to production
  • Deep expertise with agent frameworks (LangGraph, LangChain, LlamaIndex, AutoGen, CrewAI, or equivalent)
  • Expert LLM integration: function/tool calling, structured outputs, retrieval-augmented generation (RAG), agent memory, and knowledge retrieval
  • Production hardening of agentic systems: agent evaluation and regression testing, guardrails and safety, observability/tracing, prompt and context management, and cost/latency optimization
  • Model Context Protocol (MCP): designing and deploying MCP servers for tool and resource integration
  • Human-in-the-loop and approval workflows for high-stakes autonomous actions in enterprise environments
Job Responsibility
Job Responsibility
  • Own end-to-end technical design and delivery of enterprise-grade agentic AI systems — from architecture through production, reliability, and handover
  • Lead a small engineering pod: set technical direction, run design and code reviews, mentor engineers, and remain hands-on writing production code yourself
  • Translate ambiguous business problems in commerce, fulfillment, and supply chain into well-scoped agentic workflows with clear success metrics and guardrails
  • Architect multi-agent pipelines with tool/function calling, retrieval (RAG), memory, orchestration, evaluation, and human-in-the-loop controls
  • Establish engineering standards for agent evaluation, observability, safety, cost, and latency, and drive them across the pod
  • Partner directly with client stakeholders and SMEs — leading discovery, shaping solution architecture, and presenting trade-offs to technical and executive audiences
  • Build and deploy Model Context Protocol (MCP) servers and reusable tools/integrations that let agents act safely across enterprise systems (OMS, WMS, CRM, data and commerce platforms)
  • Make pragmatic build-vs-buy and framework decisions and collaborate cross-functionally on requirements, sprint planning, and delivery
  • Lead the optimization phase: design optimization-based decisioning for inventory planning and warehouse slotting, integrating solvers and forecasts into agentic workflows
  • Fulltime
Read More
Arrow Right