CrawlJobs Logo

Kafka Platform Engineer

United States, Irving Iselin Employment contract 37.02 - 69.71 USD / Hour · Job Posted June 15, 2026
Apply Position
Job Link Share

Job Description

Wells Fargo is seeking a seeking a motivated Platform Engineer with foundational experience in Kafka and OpenShift (OCP) to support the design, deployment, and operation of enterprise event streaming platforms. The ideal candidate is eager to learn distributed systems, automation, and cloud-native technologies, and can collaborate effectively within engineering teams to deliver reliable and scalable Kafka solutions.

Job Responsibility

  • Assist in building, deploying, and maintaining Confluent Kafka platforms on OpenShift (OCP) under guidance from senior engineers
  • Support the deployment and operation of Kafka components including brokers, KRaft controllers, Schema Registry, and Kafka Connect
  • Participate in platform upgrade and improvement activities, including patching, configuration updates, and performance tuning
  • Work with senior engineers to evaluate and integrate Kafka ecosystem tools and OCP-native capabilities
  • Contribute to automation efforts, including CI/CD pipelines and Infrastructure-as-Code templates for Kafka deployments
  • Assist in implementing high availability and resiliency patterns, including replication, failover configurations, and cluster linking
  • Follow established platform governance and standards, including naming conventions, topic management, and security best practices
  • Participate in incident response and troubleshooting, helping identify root causes and document resolutions
  • Learn and apply best practices for Kafka architecture and OCP deployment models, including networking, storage, and resource allocation
  • Support operational processes and controls, ensuring alignment with enterprise policies and procedures
  • Assist in monitoring and improving platform performance, capacity, and resource utilization
  • Collaborate with application teams to support Kafka onboarding and basic integration use cases
  • Work closely with internal teams (OCP, networking, security) and vendors to resolve issues and improve platform stability

Requirements

  • 2+ years of Technology Infrastructure Engineering and Solutions experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • Good understanding of Apache Kafka concepts, including topics, partitions, producers, and consumers
  • Exposure to container platforms such as Kubernetes or OpenShift (OCP)
  • Familiarity with Linux systems, networking basics, and distributed system fundamentals
  • Basic knowledge of automation or scripting, such as Shell, Python, or similar tools
  • Understanding of CI/CD concepts and DevOps practices
  • Awareness of security fundamentals, including authentication, authorization, and encryption basics
  • Strong problem-solving skills with the ability to troubleshoot issues with guidance
  • Good communication and collaboration skills, with the ability to work in a team environment

Nice to have

  • Exposure to Confluent Platform or Kafka operator-based deployments
  • Familiarity with OpenShift/Kubernetes concepts such as pods, services, routes, and namespaces
  • Basic understanding of monitoring and observability tools (metrics, logs, alerts)
  • Exposure to event-driven architecture or streaming data pipelines
  • Experience with Git, CI/CD tools, or automation frameworks
  • Interest in learning large-scale distributed systems and cloud-native architectures

What we offer

  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Scholarships for dependent children
  • Adoption reimbursement

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Kafka Platform Engineer

8 matching positions

Platform Engineer, Agent Collaboration Platform

Platform engineering at Hebbia is about excellent, scalable enablement. You are ...
Location
Location
United States , New York City; San Francisco
Salary
Salary:
160000.00 - 300000.00 USD / Year
hebbia.ai Logo
Hebbia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field
  • 5+ years software development experience at a venture-backed startup or top technology firm, with a focus on distributed systems and platform engineering
  • Proficiency in building backend and distributed systems using technologies such as Python, Java, or Go
  • Deep understanding of scalable system design, performance optimization, and resilience engineering
  • Extensive experience with cloud platforms (e.g., AWS)
  • Working experience with one or more of the following: Kafka, ElasticSearch, PostgreSQL, and/or Redis
  • Knowledge of workflow orchestration and execution platforms like Airflow, Temporal or Prefect
  • Proven experience enabling observability patterns
  • Ability to analyze complex problems, propose innovative solutions, and effectively communicate technical concepts
  • Proven experience in leading software development projects and collaborating with cross-functional teams
Job Responsibility
Job Responsibility
  • Own critical system components: Take complex requirements and turn them into robust, scaled solutions that solve real customer needs
  • Unlock O(1) universal indexing: Build and iterate on our high-scale document build system that enables constant time latency for indexing any content in the world, regardless of data volume
  • Drive performance optimization: Architect and implement performance-tuning solutions to ensure our systems operate efficiently at scale, minimizing latency and maximizing throughput across millions of documents
  • Mentor and guide: Provide technical leadership, mentorship, and guidance to junior engineers, fostering a culture of learning and growth
What we offer
What we offer
  • PTO: Unlimited
  • Insurance: Medical + Dental + Vision + 401K
  • Eats: Catered lunch daily + doordash dinner credit if you ever need to stay late
  • Parental leave policy: 3 months non-birthing parent, 4 months for birthing parent
  • Fertility benefits: $15k lifetime benefit
  • New hire equity grant: competitive equity package with unmatched upside potential
  • Fulltime
Read More
Arrow Right
New

Data Platform Engineer (Python / Golang)

You will work on a live, high-load fleet management platform that connects tens ...
Location
Location
Poland; Ukraine
Salary
Salary:
Not provided
Intellias
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years Python backend in production
  • 2+ years as a lead or principal on a data-heavy platform
  • Typed Python at depth: Pydantic, mypy/pyright, clean code and OOP principles
  • sets standards the team follows
  • AWS data services in production (must-have): Lambda, Kinesis, DynamoDB, S3, Athena/Presto or Redshift, SQS/SNS — owned and operated end-to-end, not just used
  • Event-driven architecture ownership — designs streaming pipelines, DLQ strategies, retry/idempotency patterns
  • makes the calls others follow
  • Data engineering at principal depth: ETL/ELT, schema validation, data contracts, data lake/warehouse architecture
  • defines patterns the team reuses
  • SQL at depth — PostgreSQL and analytical engines (Athena, Redshift)
Job Responsibility
Job Responsibility
  • Own data platform architecture across platform — streaming pipelines, partner integrations, and core backend services
  • Define and enforce backend and data engineering standards: service contracts, error handling, logging, secrets management
  • Own code quality and architectural consistency
  • Own event-driven integrations with 20+ external data partners — data contracts, ingestion, transformation, failure handling
  • Design and govern data models across PostgreSQL, DynamoDB, S3, and analytical systems
  • Define and maintain IaC architecture for owned services using Terraform
  • Collaborate with DevOps on deployment patterns, observability, and incident runbooks
  • Monitor production systems, drive alerting standards, and lead resolution of critical data incidents
  • Represent backend and data constraints in planning and API contract discussions — raises risks before implementation starts
  • Produce and maintain architecture documentation, ADRs, and onboarding materials
What we offer
What we offer
  • Comfortable atmosphere
  • support for well-being
  • charge professional growth
  • equity, diversity, and inclusion
  • Fulltime
Read More
Arrow Right
New

Lead .Net Platform Engineer (Payments Ingestion) - Senior Vice President

We are seeking an experienced, hands-on Senior .Net Developer to contribute to t...
Location
Location
United States , New Castle; Irving
Salary
Salary:
156160.00 - 234240.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
June 16, 2026
Flip Icon
Requirements
Requirements
  • .Net: Extensive hands-on experience in high-throughput, production-grade .Net engineering, including JVM performance tuning
  • API Development: Hands-on experience building RESTful APIs with frameworks such as Spring MVC or Spring Boot
  • Microservices Architecture: Proven experience designing microservices ecosystems, including service decomposition, API design, inter-service communication, and cloud engineering
  • Event-Driven & Messaging Systems: Deep, hands-on expertise in Kafka, including topic design, partitioning, consumer groups, exactly-once semantics, and high-throughput stream processing
  • High-Performance Computing: Hands-on experience with profiling and optimization, including JVM tuning, garbage collection (GC) optimization, thread management, and memory profiling
  • High Availability & Fault Tolerance: Practical experience designing resilience patterns such as circuit breakers, bulkheads, failover, and disaster recovery
  • Databases: Hands-on expertise in Oracle (SQL) and Microsoft SQL for schema design, query optimization, and indexing, as well as MongoDB (NoSQL) for document modeling, aggregation pipelines, sharding, and replica sets
  • Cloud-Native Engineering: Hands-on experience with OpenShift/AWS, Kubernetes, and Docker for container orchestration, autoscaling, and cloud-native deployment
  • CI/CD & DevOps: Experience designing and owning CI/CD pipelines aligned with enterprise-level Engineering Excellence Standards. Experience with tools like Jenkins and Gradle/Maven
  • Observability: Hands-on experience with distributed tracing, intelligent alerting, and AI-driven observability using tools like Grafana
Job Responsibility
Job Responsibility
  • Actively code in .Net developing reusable frameworks while performing system design, architecture reviews, and code reviews for the core cheque payment platform
  • Contribute to the design of distributed, fault-tolerant, real-time systems for high-volume, low-latency transaction processing
  • Write, review, and refactor production-grade code in .Net setting a high technical standard for the team
  • Independently design event-driven, microservices-based architectures utilizing REST APIs, .Net. React knowledge is a plus
  • Apply hands-on experience with Kafka, including message schema design, topic partitioning, consumer group strategies, and fault-tolerant processing
  • Design and govern data architecture across Oracle (SQL) and MongoDB (NoSQL), covering schema design, indexing strategies, query optimization, and data consistency patterns
  • Champion continuous development, feature flags, and progressive delivery, contributing to the design and optimization of CI/CD pipelines
  • Produce and review Architecture Decision Records (ADRs) and technical design documents for key platform components
  • Maintain and enforce engineering standards within the scrum team, including Test-Driven Development (TDD), reusable framework development, CI/CD, secure coding, and observability
  • Conduct code reviews for critical platform components, providing detailed technical feedback to enhance team quality and capacity, ensuring the development of scalable and reusable services
What we offer
What we offer
  • Discretionary and formulaic incentive and retention awards
  • Medical, dental & vision coverage
  • 401(k)
  • Life, accident, and disability insurance
  • Wellness programs
  • Planned time off (vacation)
  • Unplanned time off (sick leave)
  • Paid holidays
  • Fulltime
Read More
Arrow Right
New

Lead Java Platform Engineer

We are seeking an experienced, hands-on Senior Java Developer to contribute to t...
Location
Location
United States , New Castle; Irving
Salary
Salary:
156160.00 - 234240.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
June 16, 2026
Flip Icon
Requirements
Requirements
  • Extensive hands-on experience in high-throughput, production-grade Java engineering, including JVM performance tuning
  • Hands-on experience building RESTful APIs with frameworks such as Spring MVC or Spring Boot
  • Proven experience designing microservices ecosystems, including service decomposition, API design, inter-service communication, and cloud engineering
  • Deep, hands-on expertise in Kafka, including topic design, partitioning, consumer groups, exactly-once semantics, and high-throughput stream processing
  • Hands-on experience with profiling and optimization, including JVM tuning, garbage collection (GC) optimization, thread management, and memory profiling
  • Practical experience designing resilience patterns such as circuit breakers, bulkheads, failover, and disaster recovery
  • Hands-on expertise in Oracle (SQL) and Microsoft SQL for schema design, query optimization, and indexing, as well as MongoDB (NoSQL) for document modeling, aggregation pipelines, sharding, and replica sets
  • Hands-on experience with OpenShift/AWS, Kubernetes, and Docker for container orchestration, autoscaling, and cloud-native deployment
  • Experience designing and owning CI/CD pipelines aligned with enterprise-level Engineering Excellence Standards. Experience with tools like Jenkins and Gradle/Maven
  • Hands-on experience with distributed tracing, intelligent alerting, and AI-driven observability using tools like Grafana
Job Responsibility
Job Responsibility
  • Actively code in Java developing reusable frameworks while performing system design, architecture reviews, and code reviews for the core cheque payment platform
  • Contribute to the design of distributed, fault-tolerant, real-time systems for high-volume, low-latency transaction processing
  • Write, review, and refactor production-grade code in Java setting a high technical standard for the team
  • Independently design event-driven, microservices-based architectures utilizing REST APIs, Java and React
  • Apply hands-on experience with Kafka, including message schema design, topic partitioning, consumer group strategies, and fault-tolerant processing
  • Design and govern data architecture across Oracle (SQL) and MongoDB (NoSQL), covering schema design, indexing strategies, query optimization, and data consistency patterns
  • Champion continuous development, feature flags, and progressive delivery, contributing to the design and optimization of CI/CD pipelines
  • Produce and review Architecture Decision Records (ADRs) and technical design documents for key platform components
  • Maintain and enforce engineering standards within the scrum team, including Test-Driven Development (TDD), reusable framework development, CI/CD, secure coding, and observability
  • Conduct code reviews for critical platform components, providing detailed technical feedback to enhance team quality and capacity, ensuring the development of scalable and reusable services
What we offer
What we offer
  • Discretionary and formulaic incentive and retention awards
  • Medical, dental & vision coverage
  • 401(k)
  • Life, accident, and disability insurance
  • Wellness programs
  • Paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
Read More
Arrow Right
New

Senior Java Engineer (Kafka, Kubernetes, SpringBoot) – Banking

My client is looking for a Senior Java Engineer to join a contract basis. They n...
Location
Location
United Kingdom , London
Salary
Salary:
600.00 - 700.00 EUR / Day
welovesalt.com Logo
Salt
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong systems development experience at all stages of systems development covering design, development, testing, live implementation and post implementation support
  • Strong hands-on Object-Oriented Design skills
  • Strong core Java programming skills
  • Experience of developing services/micro-services in Java
  • Experience of developing containerised services using Docker and Kubernetes
  • Hands-on SpringBoot skills
  • Experience of developing and deploying on Unix or Linux
  • Hands-on experience of using the Kafka ecosystem
  • Experience of profiling and performance tuning
  • Experience of Behaviour-Driven and Test-Driven development principles and skills
Job Responsibility
Job Responsibility
  • Working as part of an Agile development team to deliver the migration of the legacy application to new event-based and service-oriented architecture solution, working in collaboration with the Solution Architect, Technical Lead, Application architects and other stakeholders
  • Lead delivery of a coherent end-to-end IT solution that meets both functional and non-functional requirements
  • Ensuring that the IT solution complies with the Enterprise engineering and architecture standards
  • Ensuring end-to-end consistency of solution delivery across platforms and teams by, for instance, organising walkthroughs of the solution with delivery teams
  • Ensuring that the solution meets guidelines and standards for design and development
  • Undertaking hands-on development and coaching staff in the new technologies used
  • The successful candidate will be expected to support the development of more junior colleagues
  • Fulltime
Read More
Arrow Right

Principal Data Genai Platform Engineer - Senior Vice President

Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of relevant experience in enterprise application development, data engineering, or AI platform engineering, with a strong track record of leadership in regulated environments
  • 8+ years of experience leading multi-team Agile organizations (20+ engineers), including managing distributed and hybrid AI-assisted teams
  • Advanced expertise in Python, PySpark, and Databricks ecosystem for large-scale data processing and ELT/ETL pipelines
  • Proven experience architecting and implementing enterprise AI/GenAI platforms, including agentic AI frameworks, LLM integrations, and prompt engineering
  • Hands-on experience with AI-assisted development tools such as Devin.AI and GitHub Copilot and integrating them into engineering workflows
  • Strong experience with microservices architecture, APIs, and cloud-native deployment (Kubernetes/OpenShift)
  • Strong experience with event-driven architectures and streaming platforms (Kafka)
  • Deep understanding of data architecture, data mesh, data federation, and regulatory data requirements
  • Exceptional leadership, communication, stakeholder management, and decision-making capabilities
  • Experience with cloud platforms (AWS, Azure, GCP, Databricks) and modern data ecosystems
Job Responsibility
Job Responsibility
  • Lead multiple agile scrum teams comprising ~15+ engineers, including hybrid teams of human engineers and AI-assisted development (Devin.AI, Copilot), ensuring delivery excellence and alignment with business priorities
  • Define and execute the enterprise strategy for Python engineering, AI agent platforms, and full-stack data applications, aligned with Retail and Wealth Risk objectives
  • Serve as the senior architect and technical authority for enterprise-scale AI agents, data engineering pipelines, and microservices-based applications, ensuring scalability, resilience, and security
  • Drive the adoption and operationalization of AI Product Development Lifecycle (AI PDLC), including model governance, evaluation, deployment, monitoring, and compliance with Model Risk Management (MRM)
  • Lead development of high-volume data pipelines and data federation layers using PySpark, Databricks, Kafka, and Data Mesh architecture to support regulatory reporting (CCAR, FDIC) and risk analytics
  • Architect and oversee GenAI agent ecosystems using LLMs (Google ADK, Gemini/Flash), implementing Human-in-the-Loop (HITL) frameworks to ensure explainability, auditability, and compliance
  • Drive AI-augmented software development lifecycle, integrating tools such as Devin.AI, GitHub Copilot, and MCP platforms through advanced prompt engineering and governance guardrails
  • Lead microservices and cloud-native architecture using FastAPI/Spring Boot, Kubernetes/OpenShift, and CI/CD pipelines, ensuring high availability and performance
  • Drive engineering efficiency and standardization by reusing and repurposing enterprise-level frameworks, platforms, and tools, reducing duplication and accelerating delivery across teams
  • Ensure all engineering solutions incorporate data governance and non-functional requirements, including Data Quality (DQ), data lineage, data tracing, and auditability, aligned with enterprise governance processes and regulatory expectations
  • Fulltime
Read More
Arrow Right

Qa Automation Engineer (Kafka)

Take your career to the next level with Amaris Consulting as a QA Integration En...
Location
Location
Spain , Valencia, Barcelona, Madrid
Salary
Salary:
Not provided
amaris.com Logo
Amaris Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Between 4 - 7 years of experience as a QA Engineer
  • Solid experience with CI/CD pipelines and manual/automated testing (mandatory)
  • Hands-on experience with Kafka / event-driven architectures
  • Strong knowledge of JUnit and Mockito in real projects
  • Experience with API testing tools such as Postman, Bruno or similar
  • Proven E2E testing experience in integration contexts
  • Experience with Confluent / Kafka streaming platforms
  • Background in Java-based testing environments
  • Understanding of data mapping and transformation logic
  • English proficiency for daily work in an international environment (mandatory)
Job Responsibility
Job Responsibility
  • Design, execute and automate test cases for event-driven integrations
  • Validate event flows across layers (Producer → Canonical → Consumer) to ensure data consistency and reliability
  • Test event processing pipelines in close collaboration with producer and consumer owners
  • Validate API integrations and connectors between multiple systems and platforms
  • Work closely with development, architecture and business teams to ensure Go-Live readiness and high-quality deliveries
  • Contribute to continuous improvement of testing frameworks, standards and best practices in an event-driven environment
What we offer
What we offer
  • Tailored career path and salary evaluation
  • Tech Academy catalog, Udemy E-learning Platform, Languages Sessions, webinars, and workshops
  • Annual personal budget and company-paid certifications
  • Flexible policies, remote work options, social benefits like transit and restaurant tickets, kindergarten support, and private health insurance
  • WeCare program
Read More
Arrow Right

Data Platform Engineer

OneTrust’s mission is to enable innovation through the responsible use of data a...
Location
Location
United States , New York
Salary
Salary:
81150.00 - 121725.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering or related field
  • 3+ years of overall experience and 3+ years of experience with very large-scale data warehouse projects
  • Strong experience in SQL, knowledge of dimensional modeling, supporting data warehouse, scaling, optimizing and performance tuning ETL pipelines
  • 1+ years of experience with Python and manipulation of various data formats for extraction and transformation
  • 1+ years of experience with Snowflake, Airflow, ETL/Integration tools administration
  • Hands-on experience with Data Warehouse technologies (Snowflake, Redshift) and Big Data technologies (Hadoop, Hive, Spark, Kafka, Kinesis)
  • Experience evaluating new tools and enriching existing architecture
  • You are a self-starter, hands-on technical expert who continuously gather and synthesize high-impact needs from business partners, design and implement the appropriate technical platform solution, and effectively communicate about deliverables,timelines and tradeoffs
Job Responsibility
Job Responsibility
  • Build and automate modern data platforms (AWS, AZURE, Snowflake) with native technologies, deploy applications, and provision of infrastructure
  • Perform Administration, Maintenance and provide support to production systems (Snowflake, Fivetran, DBT, Power BI, Airflow)
  • Build and maintain CI/CD pipelines and infrastructure as code (IaC) practice across the platform for safe and reproducible deployments
  • Design, build and implement automation framework for scale that deliver data with measurable quality under the SLA
  • Drive technical conversations with stakeholders to understand the platform's needs and come up with a provisioning strategy
  • Work effectively using scrum with multiple team members to deliver value effectively
  • Reduce technical debt over time with root cause identification, issue resolution and promote best practices across the platform
What we offer
What we offer
  • comprehensive healthcare coverage
  • flexible PTO
  • equity RSUs
  • annual performance bonus opportunities
  • retirement account support
  • 14+ weeks of paid parental leave
  • career development opportunities
  • company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right