CrawlJobs Logo

Senior Infrastructure Kafka Engineer

technologent.com Logo

Technologent

Location Icon

Location:
United States , Phoenix

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are seeking a Senior Infrastructure - Kafka Engineer to join a high-performing data engineering team supporting large-scale, event-driven data platforms. This role is ideal for a seasoned engineer with deep experience in Apache Kafka / Confluent Kafka, messaging platforms, SQL/NoSQL databases, and cloud infrastructure, who can lead engineering, operations, and automation efforts across complex enterprise environments. This is a 6-month contract-to-hire opportunity supporting a hybrid work model in Phoenix, AZ. The ideal candidate is a hands-on infrastructure engineer with strong experience designing resilient Kafka environments, building real-time data pipelines, and supporting production systems in fast-paced enterprise settings.

Job Responsibility:

  • Administer, configure, and troubleshoot Kafka clusters across on-prem and cloud environments, including broker and cluster configuration, partitioning, and performance tuning
  • Design and implement scalable, highly available Kafka infrastructure, including disaster recovery and multi-environment strategies
  • Integrate Kafka with upstream and downstream systems using Kafka Connect and related connectors, including MQ, MongoDB, Oracle, SQL Server, PostgreSQL, and MySQL
  • Build and support real-time data pipelines using Kafka producers and streaming consumers such as Spark Streaming and Kafka Streams
  • Automate infrastructure provisioning and configuration across environments using Terraform and modern DevOps practices
  • Deploy and manage Kafka components and clients in production and disaster recovery environments, ensuring resilience and recoverability
  • Lead a small team of engineers and technicians in monitoring, diagnosis, and remediation of infrastructure issues
  • Implement and maintain comprehensive monitoring, logging, and alerting using tools such as Splunk, Datadog, and Grafana
  • Perform proactive health checks and capacity planning to identify and resolve issues before they impact service
  • Serve as a primary point of contact for daily operations, major incidents, and escalations related to Kafka and associated infrastructure
  • Develop, maintain, and continuously improve runbooks and playbooks for incident response, maintenance, and recurring operational tasks
  • Analyze support trends and incident patterns to reduce downtime and drive root-cause resolution
  • Ensure infrastructure and platform changes comply with internal standards, security policies, and applicable regulatory requirements
  • Partner with security, networking, application, and data engineering teams to design and operate secure, compliant, event-driven architectures
  • Contribute to standards, best practices, and technical documentation for Kafka, messaging, and integration patterns
  • Participate in agile ceremonies and help influence technical direction for streaming and integration platforms

Requirements:

  • 7+ years of experience in infrastructure engineering with a strong focus on: Kafka administration across on-prem and cloud environments
  • Kafka ecosystem components including brokers, topics, consumer groups, replication, and failover
  • Messaging systems such as MQ
  • SQL and NoSQL database integration
  • Proven experience designing, deploying, and scaling Kafka clusters and connector infrastructure in production and DR environments
  • Hands-on experience building real-time data pipelines using Kafka producers and streaming consumers such as Spark Streaming
  • Strong proficiency with at least one major cloud platform: AWS, GCP, or Azure
  • Experience with event-driven architectures, containerization, and DevOps practices
  • Experience with observability and monitoring tools such as Splunk, Datadog, and Grafana
  • Solid understanding of networking, Linux/Windows operating systems, and core diagnostic tools
  • Proficiency with source control tools such as SVN and Git
  • Scripting and programming experience with tools such as PowerShell, Bash, Python, or Perl
  • Demonstrated ability to analyze complex issues, make sound decisions with limited information, and drive issues through resolution
  • Strong communication, customer service, and collaboration skills with the ability to work effectively across cross-functional technical teams

Nice to have:

  • Experience with additional enterprise monitoring and infrastructure support tools
  • Experience working in highly regulated enterprise environments
  • Prior exposure to large-scale data engineering or integration platforms

Additional Information:

Job Posted:
April 27, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Technologent - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Infrastructure Kafka Engineer

Senior Infrastructure Engineer

Coralogix is seeking a Senior Infrastructure Engineer to join our Core SRE team ...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
coralogix.com Logo
Coralogix
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in DevOps, SRE, platform engineering, or infrastructure roles
  • Deep understanding of Kubernetes: API, CNI, scheduling, container runtimes and such
  • Strong hands-on experience with Kafka and Istio (or similar technologies ), and core networking protocols (HTTP, gRPC, TLS)
  • Proven experience managing large-scale cloud infrastructure (AWS, GCP, etc.)
  • Experience in incident response and troubleshooting complex distributed systems
  • Some software engineering experience, preferably in Golang
  • Passion for automation, performance tuning, and operational excellence
Job Responsibility
Job Responsibility
  • Act as a hands-on technical leader with deep expertise in modern cloud infrastructure
  • Serve as a go-to person in the team — leading through influence, not hierarchy
  • Collaborate cross-functionally to refine requirements and propose innovative, scalable solutions
  • Drive long-term, high-impact infrastructure projects across multiple teams, from design to implementation, within defined timelines
  • Contribute to improving system reliability, performance, and cost-efficiency at scale
  • Fulltime
Read More
Arrow Right

Senior Infrastructure Engineer

Coralogix is seeking a Senior Infrastructure Engineer to join our Core SRE team ...
Location
Location
Israel , Ramat Gan
Salary
Salary:
Not provided
coralogix.com Logo
Coralogix
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in DevOps, SRE, platform engineering, or infrastructure roles
  • Deep understanding of Kubernetes: API, CNI, scheduling, container runtimes and such
  • Strong hands-on experience with Kafka and Istio (or similar technologies ), and core networking protocols (HTTP, gRPC, TLS)
  • Proven experience managing large-scale cloud infrastructure (AWS, GCP, etc.)
  • Experience in incident response and troubleshooting complex distributed systems
  • Some software engineering experience, preferably in Golang
  • Passion for automation, performance tuning, and operational excellence
Job Responsibility
Job Responsibility
  • Act as a hands-on technical leader with deep expertise in modern cloud infrastructure
  • Serve as a go-to person in the team — leading through influence, not hierarchy
  • Collaborate cross-functionally to refine requirements and propose innovative, scalable solutions
  • Drive long-term, high-impact infrastructure projects across multiple teams, from design to implementation, within defined timelines
  • Contribute to improving system reliability, performance, and cost-efficiency at scale
  • Fulltime
Read More
Arrow Right

Senior Cloud Infrastructure Engineer

HPE Aruba Networking is a leading provider of next-generation networking solutio...
Location
Location
United States , San Jose
Salary
Salary:
133500.00 - 307000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum expected industry experience is around 6 years
  • Minimum education at BS or MS level in Computer Science or related fields
  • Proven record of developing and releasing cloud applications in the production environment
  • Experience with DevOps and Cloud Infrastructure Deployment and Automation in Python, Terraform, Ansibles, GitOps, GitLabs, and Jenkins/Spinnaker
  • Experience in RDBMS (Postgres), GraphQL, and NoSQL (Cassandra, OpenSearch, Clickhouse, and etc.)
  • Experience in cloud stacks such as Redis, Kafka, RabbitMQ, Hazelcast
  • Experience in development in Kubernetes and Docker containers
  • Programming language experience with Shell Scripts, Python, Golang, or Java
  • Ability to deploy various techniques to ‘scale’ an application in a cloud environment
  • Demonstrated abilities to work with QA and Remote Teams
Job Responsibility
Job Responsibility
  • Participate in architecture and design discussions
  • Develop scalable applications that run on top of Next Generation Central
  • Contribute to multiple technical programs simultaneously
What we offer
What we offer
  • Health benefits
  • Comprehensive suite of benefits supporting physical, financial, and emotional wellbeing
  • Personal and professional development programs
  • Inclusion and diversity initiatives
  • Exciting and fun work culture
  • Innovation and growth opportunities
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

The Wikimedia Foundation is looking for a Senior Software Engineer to join our t...
Location
Location
United States of America
Salary
Salary:
141352.00 - 175725.00 USD / Year
wikimediafoundation.org Logo
Wikimedia Foundation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Being comfortable working in a semi-ambiguous environment, similar to that of a startup
  • Experience in supporting complex web applications running on Amazon Web Services or other comparable cloud platforms
  • Experience working with Kafka or similar distributed event processing systems
  • Experience working with Nodejs and Go applications
  • Comfortable with configuration management and orchestration tools (ECS, Kubernetes), and modern observability infrastructure (monitoring, metrics and logging)
  • Aptitude for automation and streamlining of tasks
  • Comfortable with shell and scripting languages used in an SRE/Operations engineering context (e.g. Python, Go, Bash, Ruby, etc.)
  • Good understanding of Linux/Unix fundamentals and debugging skills
  • Strong English language skills and ability to work independently, as an effective part of a globally distributed team
  • B.S. or M.S. in Computer Science or equivalent in related work experience
Job Responsibility
Job Responsibility
  • Bringing your creativity to improve our current infrastructure
  • Being a key part of planning our future technical roadmap
  • Maintaining and improving the reliability of highly used commercial data feeds
  • Supporting new code/feature deployments
  • Troubleshooting, debugging and following-up on emerging issues in our application stack and its surroundings
  • Assisting in the architectural design of new services and making them operate at scale
  • Incident response, diagnosis and follow-up on system outages or alerts across Wikimedia Enterprise’s production infrastructure
  • Sharing our values and work in accordance with them
  • Fulltime
Read More
Arrow Right

Senior Engineering Manager, Big Data

Checkr is looking for a Senior Engineering Manager to lead the Criminal Data tea...
Location
Location
United States , San Francisco
Salary
Salary:
238000.00 - 280000.00 USD / Year
https://checkr.com Logo
Checkr
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years as an engineering manager
  • 8+ years as an engineer
  • Exceptional verbal and written communication skills
  • Unparalleled bar for quality (data quality metrics, QC gates, data governance, automated regression test suites, data validations, etc)
  • Experience working on data products at scale and understanding the legal, human impact, and technical nuances of supporting a highly regulated product
  • Experience designing and maintaining: Real-time & batch processing data pipelines serving up billions of data points
  • Normalizing and cleansing data across a medallion lakehouse architecture
  • Systems that rely on high-volume, low-latency messaging infrastructure (e.g. Kafka or similar)
  • Highly tolerant production systems with streamlined operations (data lineage, logging, telemetry, alerting, etc.)
  • Familiarity with AWS Glue, OpenSearch, EMR, etc
Job Responsibility
Job Responsibility
  • Drive a motivating technical vision for the team
  • Partner closely with product management to solve business problems
  • Work with the team to build a world-class architecture that can scale into the next phase of Checkr’s growth
  • Hire the best talent and continue to raise the bar for the team
  • Represent the team in planning and product meetings
  • Optimize engineering processes and policies to drive velocity and quality
What we offer
What we offer
  • A fast-paced and collaborative environment
  • Learning and development allowance
  • Competitive compensation and opportunity for advancement
  • 100% medical, dental, and vision coverage
  • Up to 25K reimbursement for fertility, adoption, and parental planning services
  • Flexible PTO policy
  • Monthly wellness stipend, home office stipend
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

As a Senior Software Engineer on AI Experiences, you will build on our WHOOP gen...
Location
Location
United States , Boston
Salary
Salary:
150000.00 - 210000.00 USD / Year
whoop.com Logo
Whoop
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of professional backend software development experience, ideally in languages like Java
  • Familiarity with asynchronous processing systems (Kafka, SQS)
  • Experience in backend development, working on large-scale software systems and RESTful API design
  • Experience in relational database design and development (PostgreSQL)
  • Experience with scalable system design and performance optimization
  • Strong independent problem-solving skills and the ability to work effectively in a fast-paced, collaborative environment
  • Excellent communication skills and a commitment to delivering high-quality work
  • A proactive, collaborative team player, eager to take on new challenges, continuously learn, and adapt in a fast-paced, data-informed environment
  • Proven track record of supporting junior engineers
Job Responsibility
Job Responsibility
  • Collaborate with cross-functional teams including Product, Design, Analytics, and Data Science to gather technical requirements and deliver impactful infrastructure and tools
  • Develop backend features and services, leveraging Java, Kafka, AWS, and PostgreSQL to deliver scalable and reliable software solutions
  • Consistently deliver high-quality code, adhering to best practices in software design and development
  • Develop and maintain observability and monitoring systems to ensure the stability and reliability of deployed features
  • Mentor and support junior engineers, fostering a culture of collaboration and continuous improvement
What we offer
What we offer
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Senior Manager, Software Engineering (Orchestration Services)

The Data and Storage Services team is responsible for handling all of Affirm’s D...
Location
Location
United States
Salary
Salary:
232000.00 - 310000.00 USD / Year
affirm.com Logo
Affirm
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid leadership and interpersonal skills
  • 10+ years of experience in managing multiple diverse and inclusive teams and delivering large cross-functional technical programs
  • Proven track record in stakeholder management, ownership, and successful delivery
  • Expertise in managing large-scale, geographically distributed compute and data processing systems, including data lake solutions and Workflow Orchestration frameworks
  • Expertise in scaling frameworks like Spark, Flink and, Kafka on Kubernetes and cloud providers like AWS, leveraging storage systems such as AWS S3 and Apache Iceberg
  • Capable of mentorship, cross-functional project execution, and individual contribution
  • Strong interpersonal, written, and verbal communication skills with a growth mindset
  • Experience in the data infrastructure domain and a passion for leading technical teams and contributing to Open Source solutions
  • Bachelor’s degree in Computer Science, related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Lead a team of engineers and managers with empathy while fostering a high-performance, ownership-driven & inclusive culture to develop frameworks, systems, and tools for new Affirm products
  • Oversee teams managing storage services including relational, key-value, and analytics storage infrastructure and tools at scale
  • Understand and drive business and engineering metrics, promoting a culture of reliability, security, and productivity
  • Collaborate with tech leads, program managers, and other engineering managers on security, tools, architecture, planning, and delivery of multiple concurrent projects
  • Work across the engineering organization and with internal and external partners
  • Provide leadership and growth opportunities to team members, mentor engineers, recruit, and represent Affirm hiring brands
  • Lead technical decisions, projects, and roadmaps within the Batch and Streaming teams, shaping Affirm’s strategy for managing and serving orchestration workloads
  • Collaborate with peers, leadership, and stakeholders across platform engineering and product engineering organizations
  • In collaboration with tech leads, develop a multi year roadmap to design and implement frameworks, services, and tools for new Affirm products and business needs
  • Guide, tutor, and aid in the professional growth of junior and senior engineers within the team
What we offer
What we offer
  • Health care coverage - Affirm covers all premiums for all levels of coverage for you and your dependents
  • Flexible Spending Wallets - generous stipends for spending on Technology, Food, various Lifestyle needs, and family forming expenses
  • Time off - competitive vacation and holiday schedules allowing you to take time off to rest and recharge
  • ESPP - An employee stock purchase plan enabling you to buy shares of Affirm at a discount
  • Fulltime
Read More
Arrow Right

Senior Backend Engineer

Come help us build the next generation platform that will power Highspot’s visio...
Location
Location
Canada , Vancouver
Salary
Salary:
146000.00 - 220000.00 CAD / Year
highspot.com Logo
Highspot
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Have 8+ years of relevant industry experience
  • 3+ years leading large-scale, complex projects or teams as an engineer or tech lead
  • Are obsessed with distributed systems at scale, infrastructure reliability, scalability, security, and continuous improvement
  • Strong problem-solving skills and the ability to work independently
  • Have a passion for supporting internal partners, like research, to understand their needs
  • Have excellent communication skills to build consensus with stakeholders, both internally and externally
  • Possess deep knowledge of modern cloud infrastructure, including Kubernetes, Kafka, AWS, and Azure
Job Responsibility
Job Responsibility
  • Develop product features and a platform with the highest quality
  • Define and meet scalability, uptime, performance, and security goals
  • Leads by example and mentors others to produce extensible and maintainable code used across products
  • Partner cross-functionally with UX and Product Management to create the best software possible
  • Take on the role of a technology leader in our most challenging cross-functional projects
  • Support the professional growth of others by actively mentoring individuals
  • Leverage your extensive knowledge and experience to exert technical influence over multiple teams, enhancing their productivity and effectiveness through sharing
  • Resolve major customer technical issues in production, and contribute to internal and external technical documentation
  • Set technical strategy and oversee the development of high-scale, reliable infrastructure systems
  • Work across many of Highspot partners and their EcoSystems
What we offer
What we offer
  • Comprehensive medical, dental, vision, disability, and life benefits
  • Group Retirement Savings Plan (RRSP) and matching employer contributions (DPSP) with immediate vesting
  • Flexible PTO
  • Generous Holiday Schedule + 5 Days for Annual Holiday Week
  • Quarterly Recharge Fridays (paid days off for mental health recharge)
  • Flexible work schedules
  • Access to Coaches and Therapists through Modern Health
  • 2 Volunteer days per year
  • Monthly transportation allowance for employees that work in our Vancouver Hub location
  • Employees are eligible to receive stock options
  • Fulltime
Read More
Arrow Right