CrawlJobs Logo

Kafka Architect

India, Mumbai 3500000.00 INR / Year · Job Posted March 01, 2026
Apply Position
Job Link Share

Job Description

Arch JD: Kafka Architect Exp: 9 to 15 Years Location: Mumbai/Pune/Hyd/Bangalore/Gurugram (Hybrid) BGV: Mandatory, candidate must have UAN account number

Requirements

  • Hands on experience in architecting and designing highly scalable streaming applications by using Kafka (AWS MSK or Confluent)
  • Hands on experience in building cloud native applications in AWS services (S3, ECS, Lambdas, EC2, CloudWatch, Glue catalogs)
  • Strong knowledge in Java and Spring Boot micro services architecture
  • Strong and hands on knowledge on creating and using apache-parquet files in S3
  • Java hands on experience in transforming the schema formats XML to JSON (or) JSON to JSON
  • Strong knowledge in application monitoring (Elasticsearch, Logstash, and Kibana)
  • Ability to use CICD pipeline
  • Work Experience 5+ years
  • BGV: Mandatory, candidate must have UAN account number

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Kafka Architect

8 matching positions

Kafka Streaming Architect

Embark on a transformative journey as a Kafka Streaming Architect. At Barclays, ...
Location
Location
United States , New York
Salary
Salary:
170000.00 - 230000.00 USD / Year
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Demonstrated ability designing and delivering Kafka-based streaming applications in complex enterprise environments
  • Established coding experience in Java and Python for building high-performance, scalable solutions
  • Deep experience building real-time data pipelines using Kafka Streams, Flink, or similar streaming technologies
  • Considerable understanding of high-throughput, low-latency distributed systems and platform resilience
  • Demonstrated ability to collaborate with architects, engineers, and business stakeholders to deliver strategic outcomes
Job Responsibility
Job Responsibility
  • Design, develop, and implement solutions to complex business problems
  • Design and development of solutions as products that can evolve, meeting business requirements that align with modern software engineering practices and automated delivery tooling
  • Targeted design activities that apply an appropriate workload placement strategy and maximise the benefit of cloud capabilities such as elasticity, serverless, containerisation etc.
  • Best practice designs incorporating security principles that meet the Bank’s resiliency expectations
  • Solutions that appropriately balance risks and controls to deliver the agreed business and technology value
  • Adoption of standardised solutions where they fit
  • Fault finding and performance issues support to operational support teams
  • Solution design impact assessment in terms of risk, capacity and cost impact
  • Development of the requisite architecture inputs required to comply with the banks governance processes
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right

Integration Solution Architect (MuleSoft, Kafka, AWS)

Location
Location
United Kingdom , Manchester
Salary
Salary:
600.00 - 900.00 GBP / Day
morson.com Logo
Morson Talent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Enterprise integration platforms
  • Creation, adoption and/or development of enterprise data models
  • MuleSoft
  • Kafka
  • AWS
Job Responsibility
Job Responsibility
  • Scalable, resilient and secure integration solutions aligned to the organisation's target architecture
Read More
Arrow Right

Principal Architects, Systems

Principal Architects, Systems located in Bothell, WA will own solution design fo...
Location
Location
United States , Bothell
Salary
Salary:
161138.00 - 217700.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree in Applied Computer Science, Computer Application or related, or its foreign equivalent, and 5 years of relevant work experience
  • Bachelor’s degree in Applied Computer Science, Computer Applications or related, or its foreign equivalent, and 7 years of relevant work experience
  • At least 18 years of age
  • Legally authorized to work in the United States
  • Guiding and developing applications/microservices using technologies such as SpringBoot, AWS, Apigee, SQL, Python, Java Script, HTML, Docker, Kubernetes, Apache Kafka, Bitbucket, GitLab, Maven, Apache Tomcat, and Oracle/SQL Server
  • Designing the architecture of overall B2B and B2C applications, handling the team technically to deliver the solution using various technologies like JAVA/J2EE, Angular, SQL, IBM WCS, JMS, and other web technologies
  • Designing, developing, and debugging the complex and multi-tiered applications on the following operating systems: Windows, Unix, and Linux OS
  • Utilizing Web, SOAP, REST, and XML services to conduct Enterprise integration, and building eCommerce applications using store front and extended sites model of commerce
  • Designing and implementing various subsystems of IBM WCS such as Catalog Management Subsystem, Member Subsystem (User, Account, Organization), and Order Management
  • Customizing and implementing application caching system and IBM DynaCache, Apache Java caching system and Micro Services for B2B Stores on IBM WCS Platform for better performance of application
Job Responsibility
Job Responsibility
  • Work toward practical solutions considering all teams, initiatives, and long-term outlook by implementing decisions improving quality, efficiency to achieve revenue, profitability and strategic goals for the organization
  • Connect business strategies to technology domains for delivery, maximising well-defined structure of T-Mobile business processes, products and capabilities
  • Lead overall end-to-end solution design, ensure quality, consistency, and alignment of designs to TMUS standards and IT strategy
  • Lead large initiatives and apply IT standards to develop solution architecture, drive technical strategy and architectural tradeoff discussions
  • Demonstrate comprehensive understanding of how people, processes, and technology interact to perform the fundamental activities of the business in both current and future state and model these interactions to guide technology strategy to better achieve business outcomes
  • Works multi-functionally to understand the linkage between T-Mobile's business goals, business architecture, and requirements frameworks
  • Compile, deliver, and promote end-to-end technology roadmaps that guide the evolution of infrastructure, products, and services by applying depth and breadth of expertise in multiple related subject areas
  • Mentor team members on standard processes in area of expertise
  • Grasp and communicate big-picture enterprise-wide issues to team
  • Compile, develop, and deliver architectural guardrails
What we offer
What we offer
  • Annual stock grant
  • Employee stock purchase plan
  • 401(k)
  • Access to free, year-round money coaches
  • Medical, dental and vision insurance
  • Flexible spending account
  • Paid time off and up to 12 paid holidays
  • Paid parental and family leave
  • Family building benefits
  • Back-up care
  • Fulltime
Read More
Arrow Right

Staff Cloud Platform Engineer

The Staff Cloud Platform Engineer is a senior technical leader at the heart of B...
Location
Location
United States , Los Angeles
Salary
Salary:
180000.00 - 226000.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-10+ years of experience in any combination of engineering, platform, or SRE roles
  • Expert, deep proficiency in at least one of: Rust, C#, Python, Go, Java, or equivalent for platform engineering and SaaS development
  • Understanding of container-targeted application development, such as with Docker, Swarm, Kubernetes, or App Engine
  • Understands and leverages cutting-edge AI tools, such as Claude, Gemini, ChatGPT, and Cursor, to enhance development productivity and efficiency of delivery
  • while effectively curating code quality
  • Hands-on experience with GCP (preferred) and/or AWS in production at scale
  • strong understanding of core services including BigQuery, Pub/Sub, Cloud Storage, VPC networking, and IAM
  • Experience working with stateful databases and key-value datastores, such as PostgreSQL, Microsoft SQL, MySQL, MariaDB, MongoDB, Redis, and ValKey
  • Demonstrated ability to drive architectural decisions, lead platform-level initiatives, and influence cross-functional engineering teams
  • Thinks and executes like a technically minded product owner: is able to extract meaningful prioritization and delivery milestones from top-down leadership decisions and org initiatives
Job Responsibility
Job Responsibility
  • Serve as technical lead and subject matter expert for engineering platform service architecture, driving design and delivery of scalable, resilient, cloud-native infrastructure
  • Architect and develop Kubernetes-native systems, including serverless architecture utilizing stateless services and serverless driven Knative sequences
  • Design and operate event-driven systems, utilizing platforms like Kafka and Pub/Sub, and bring an understanding of how to build for eventually consistent, efficient services
  • Champion a security-first approach across all platform design: network topology, firewall policy, container hardening, logging, monitoring, availability, and resiliency
  • Establish and maintain observability through custom sensors, dashboards, and alerting to ensure health, performance, and SLO compliance
  • Own and evolve the team’s CI/CD strategy, ensuring the right mix of operational efficiency and toolchain security
  • Collaborate with and influence partner engineering teams, product, and IT teams on architecture decisions, IaC principles, and platform standards
  • Mentor engineers across the team
  • define and uphold documentation, operational runbooks, and engineering standards
  • Provide technical leadership for major cross-functional initiatives and serve as an escalation point for complex issues
What we offer
What we offer
  • short-term and long-term incentive programs
  • robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right

Senior Applications Developer : Ab Initio, Bigdata - Python, Pyspark

We are seeking a highly skilled and experienced Senior Developer (C12) to join o...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8 + years of experience in Applications Development, Systems Analysis, or equivalent senior engineering roles
  • Extensive hands‑on experience delivering enterprise‑scale, database‑driven platforms in a regulated environment
  • Expert-level proficiency in Python programming, including object-oriented design, data structures, algorithms, and extensive experience with various Python libraries (e.g., Pandas, NumPy, Flask/Django for web development, asyncio for async programming)
  • Deep expertise in developing, optimizing, and deploying PySpark applications for large-scale data processing, ETL, and real-time analytics on distributed systems (e.g., Spark SQL, Spark Streaming, DataFrames)
  • Strong understanding of Apache Spark architecture, Hadoop ecosystem, and experience with distributed computing concepts. Familiarity with big data storage formats (e.g., Parquet, ORC)
  • Hands-on experience with at least one major cloud provider (AWS, Azure, or GCP), specifically with their compute, storage, and data services (e.g., S3, ADLS, EMR, Databricks, Azure Synapse)
  • Solid experience with both relational databases (e.g., PostgreSQL, Oracle, SQL Server, MySQL) and NoSQL databases (e.g., MongoDB). Strong SQL writing and optimization skills
  • Experience in designing, developing, and consuming RESTful APIs using Python frameworks (e.g., Flask, FastAPI, Django REST Framework)
  • Strong understanding and practical experience with CI/CD tools (e.g., Jenkins, GitLab CI, Azure DevOps) and containerization technologies (Docker, Kubernetes)
  • Expert-level proficiency with Git
Job Responsibility
Job Responsibility
  • Design, develop, and implement robust, scalable, and high-performance data pipelines and applications using Abinitio, Python, PySpark, and Big Data technologies
  • Work autonomously to analyze requirements, propose technical solutions, and deliver high-quality code and data products, ensuring alignment with architectural standards and business objectives
  • Utilize expertise in various Big Data platforms (e.g., Hadoop, Hive, Kafka, Spark) to process, transform, and manage large datasets efficiently
  • Write complex SQL queries, stored procedures, and optimize database performance for large-scale data warehousing and analytics solutions
  • Develop and enhance ETL (Extract, Transform, Load) processes, ensuring data quality, integrity, and timely delivery
  • Proactively research, evaluate, and integrate new and emerging technologies, frameworks, and tools to improve development processes and solution capabilities
  • Ensure adherence to coding standards, conduct thorough code reviews, and implement best practices for software development, data governance, and security
  • Diagnose and resolve complex technical issues related to data pipelines, performance bottlenecks, and system integrations in a fast-paced environment
  • Collaborate effectively with cross-functional teams including architects, data scientists, business analysts, and QA engineers. Provide technical guidance and mentorship to junior team members
  • Leverage KYC domain knowledge to develop data solutions that support client due diligence (CDD), and other financial crime compliance initiatives, understanding the nuances of regulatory data requirements
  • Fulltime
Read More
Arrow Right

Technical Database Architect

The Technical Database architect is a senior-level position responsible for brid...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 11+ years of experience as a Technical Database Analyst or similar role within the Financial Services industry, preferably in regulatory reporting (e.g., Basel, CCAR, FR 2052a) and liquidity risk
  • Advanced proficiency in SQL for complex data querying, analysis, and optimization across large datasets
  • Strong experience with relational databases (e.g., Oracle, SQL Server, DB2) and data warehousing concepts (e.g., dimensional modeling, star/snowflake schemas)
  • Demonstrated expertise with Big Data technologies including Hadoop, Spark (PySpark/Scala Spark), Kafka, and cloud-based data platforms (e.g., AWS S3, Databricks)
  • Demonstrated experience with data modeling tools and techniques
  • Proficiency in data visualization tools (e.g., Tableau, Power BI, QlikView) and strong Excel skills for data manipulation and presentation
  • Experience with scripting languages for data analysis (e.g., Python, R) is highly desirable
  • Experience with data preparation for AI/ML models and understanding of core AI/ML concepts and workflows is highly desirable
  • Comprehensive knowledge of data analysis principles, methodologies, and data governance frameworks
  • Experience across all phases of the Software Development Life Cycle (SDLC), with a focus on data-centric projects
Job Responsibility
Job Responsibility
  • Consult with business clients to determine system functional specifications and partner with multiple management teams and other units to meet organizational objectives
  • Define, document, and validate detailed data requirements, data flows, and data lineage for new or enhanced systems and applications
  • Provide technical input during the development and implementation phases, including formulating and defining systems scope, data objectives, and necessary data architecture enhancements for complex, high-impact projects
  • Design and develop robust data models (conceptual, logical, physical) to support reporting, analytics, and business processes
  • Prepare and curate data for AI/ML model development, working closely with AI engineers to ensure data quality, feature engineering, and model validation
  • Utilize advanced SQL for data extraction, manipulation, and analysis from various relational databases, data warehouses, and Big Data platforms
  • Develop and maintain data visualization dashboards and reports using tools such as Tableau, Power BI, or QlikView, translating complex data into understandable business insights
  • Lead the analysis of complex data sets to identify trends, patterns, and anomalies relevant to regulatory reporting, liquidity risk, and other critical financial functions
  • Identify and communicate data-related risks and impacts and propose risk mitigation options, considering business implications of the application of technology to the current business environment
  • Evaluate new data technologies, analytical tools, and evolving business requirements, and recommend appropriate systems alternatives and/or enhancements to current systems by analyzing business processes, systems and industry standards
  • Fulltime
Read More
Arrow Right
New

Application Development Manager, Trading Platforms, Vice President

Job Overview
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Java Core backend development
  • Python
  • Microservices Architecture
  • Event-Driven & Messaging Systems
  • High Availability & Fault Tolerance
  • Databases Oracle (SQL) and MongoDB (NoSQL)
  • GenAI Tooling
  • Data Engineering
  • Cloud-Native Engineering (AWS, Kubernetes, Docker)
  • CI/CD Pipelines
Job Responsibility
Job Responsibility
  • Architect, design, develop, and maintain robust, scalable, and high-performance applications supporting MTF
  • Lead the design of distributed, fault-tolerant, real-time systems capable of handling high-volume, low-latency trade processing across global markets
  • Champion the use of AI-assisted coding tools to accelerate developer productivity, reduce toil, and improve code quality
  • Ensure code is clean, maintainable, and testable by adhering to SOLID principles, design patterns, and platform engineering standards
  • Actively contribute to hands-on coding, code reviews, and refactoring
  • Own the technical design of key platform components, producing clear architecture documentation and decision records
  • Champion Test-Driven Development (TDD) and high unit test coverage
  • Introduce AI-powered code review tooling
  • Apply predictive quality analytics to identify high-risk code changes
  • Drive the adoption of automated testing frameworks
  • Fulltime
Read More
Arrow Right
New

Solution Architect - Guidewire

The Guidewire Solution Architect is part of the Architecture practice within the...
Location
Location
United Kingdom , Cardiff
Salary
Salary:
Not provided
admiralgroup.co.uk Logo
Admiral Group Plc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience architecting solutions using Guidewire PolicyCenter and BillingCenter
  • Proven experience designing end-to-end enterprise solutions within Guidewire ecosystems, balancing business requirements, platform capabilities and architecture standards
  • Experience supporting Guidewire upgrades, migrations and platform modernisation programmes
  • Strong understanding of Guidewire platform architecture and associated design principles
  • Experience with Guidewire configuration concepts, including Product Configuration, Product Designer, Business Rules, Workflows, Data Model Extensions, Screen Configuration, User Experience Design, Rating and Underwriting concepts
  • Experience defining architecture and design approaches for Guidewire customisation, extension and configuration while promoting adoption of out-of-the-box platform capabilities
  • Experience designing and reviewing integrations between Guidewire platforms and enterprise applications
  • Strong understanding of Guidewire integration capabilities, including REST APIs, web services, messaging frameworks, batch interfaces and event-driven integrations
  • Experience designing solutions involving Guidewire platforms, Digital Channels, Customer Portals and Enterprise Services
  • Strong understanding of API architecture, integration patterns, messaging architectures and service-oriented design principles
Job Responsibility
Job Responsibility
  • Provide technical leadership and architecture support for value streams, working with Lead Solution Architects to own solutions from ideation through to delivery and ensure business value is realised through successful implementation
  • Define end-to-end solution architectures spanning Guidewire platforms, Digital Channels, Integration Platforms, Enterprise Services and supporting technology ecosystems
  • Provide architectural leadership for Guidewire PolicyCenter, BillingCenter and digital customer-facing solutions
  • Define solution approaches for Guidewire product configuration, integration design, platform extensions, customer journeys and digital capabilities
  • Lead architecture workshops with business and technical stakeholders to understand requirements, assess impacts, evaluate solution options and drive architectural decisions
  • Lead and contribute to governance forums, ensuring solutions adhere to established architecture principles, standards and patterns, and identifying and managing divergence where required
  • Define integration strategies between Guidewire platforms and enterprise applications using APIs, messaging, event-driven architectures and enterprise integration patterns
  • Support strategic initiatives, platform modernisation programmes and technology transformation activities across the insurance landscape
  • Produce high-quality architecture artefacts, including Solution Outlines, High Level Designs, Architecture Decision Records, Option Papers, conceptual and logical architecture designs, integration designs, technical risk assessments and roadmaps
  • Ensure architectural decisions, assumptions, dependencies, risks, principles and non-functional requirements are documented and communicated effectively across stakeholders
What we offer
What we offer
  • Up to £3,600 of free shares each year after one year of service
  • 33 days holiday (including bank holidays) when you join us, increasing the longer you stay with us, up to a maximum of 38 days (including bank holidays)
  • Option to buy or sell up to an additional five days of annual leave
  • Fulltime
Read More
Arrow Right