CrawlJobs Logo

Senior System Engineer - Platform/Messaging

oreillyauto.com Logo

O'Reilly Auto Parts

Location Icon

Location:
United States , Springfield

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The Sr Systems Engineer Platform – Messaging Platform will play a key role in designing, implementing, and maintaining enterprise messaging systems that support both real-time and asynchronous communication between distributed applications and services. This role focuses on ensuring robust, scalable, secure, and cost-efficient messaging solutions across hybrid cloud and on-premises environments. The engineer will work closely with architects, developers, infrastructure, and DevOps teams to standardize messaging platforms and promote modern integration patterns that align with the organization’s digital transformation goals.

Job Responsibility:

  • Design, implement, and support scalable messaging platforms including Apache Kafka (Confluent/OSS), Google Cloud Pub/Sub, and legacy systems such as IBM MQ
  • Build high-throughput, low-latency event streaming pipelines that support mission-critical workloads, leveraging Kafka brokers, topics, partitions, and consumer groups
  • Define and enforce schema governance using tools like Confluent Schema Registry or Apicurio
  • enforce consistent serialization formats (e.g., Avro, JSON, Protobuf)
  • Standardize topic taxonomy and hierarchy across business domains, enforce naming conventions, and implement lifecycle management practices for topics and subscriptions
  • Manage Kafka Connect connectors (source/sink), KSQLDB flows, and stream processing topologies using Kafka Streams
  • Define and implement platform-wide policies for message retention, compaction, ACLs, multi-tenancy isolation, and access control
  • Ensure reliable message delivery through producer retries, dead-letter queues, idempotency handling, and exactly-once semantics where applicable
  • Automate deployment and configuration of messaging infrastructure using Terraform, Helm, Ansible, and Kubernetes operators (e.g., Strimzi for Kafka)
  • Maintain Git-based configuration-as-code repositories to drive consistency and auditability across environments
  • Develop CI/CD pipelines to support promotion of configuration artifacts, rolling upgrades of messaging clusters, and dynamic provisioning of topics and consumer policies
  • Implement proactive drift detection, self-healing scripts, and platform bootstrapping workflows
  • Integrate messaging platforms with enterprise IAM (e.g., GCP IAM, LDAP, Kerberos, or RBAC for Confluent/Kafka)
  • Implement encryption in transit and at rest using TLS, mTLS, SASL/SCRAM, and Kafka-level ACLs
  • Implement observability dashboards and alerts using Prometheus, Grafana, Confluent Control Center, ELK Stack, or Google Cloud Operations Suite
  • Establish performance baselines and configure SLA/SLO-based monitoring for producers, consumers, brokers, and ZooKeeper
  • Partner with development teams to onboard producer and consumer applications through reusable connectors, API-to-event bridges, and SDKs
  • Provide technical guidance and documentation on best practices for schema evolution, idempotent messaging, and replayable data streams
  • Lead efforts to decommission legacy messaging platforms (e.g., MQSeries, RabbitMQ) and consolidate onto modern event streaming technologies
  • Evaluate emerging messaging technologies (e.g., Pulsar, Redpanda) for specific workloads or cost optimization opportunities

Requirements:

  • 5+ years of hands-on experience with enterprise-grade messaging platforms, including Apache Kafka (Confluent/OSS), Google Cloud Pub/Sub, or equivalent
  • Deep expertise in Kafka architecture including broker management, partitioning, replication, log retention, and consumer group coordination
  • Proficiency in schema evolution and contract validation using Confluent Schema Registry, Apicurio, or similar tools
  • Demonstrated experience with Kafka Connect, Kafka Streams, and stream processing applications for real-time data movement
  • Strong knowledge of topic hierarchy management, naming conventions, access control (ACLs), and governance policies
  • Experience designing and deploying messaging platforms for mission-critical, high-throughput, low-latency event-driven systems
  • Experience deploying and managing messaging workloads on GCP using Google Cloud Pub/Sub, Eventarc, or custom solutions
  • Familiar with hybrid architectures including secure messaging between on-prem and cloud workloads via VPN/Interconnect
  • Hands-on implementation of GCP IAM, VPC Service Controls, and secure endpoint management for messaging components
  • Understanding of regional and multi-region messaging designs for high availability and disaster recovery
  • Skilled in automating infrastructure provisioning and configuration using Terraform, Helm, and Kubernetes (e.g., Strimzi operators)
  • CI/CD experience with GitHub Actions, Jenkins, or Google Cloud Build for promoting messaging configurations and application artifacts
  • Strong understanding of data protection practices including TLS/mTLS encryption, SASL/SCRAM, and token-based authentication
  • Integration with enterprise IAM providers (e.g., GCP IAM, LDAP, SSO, RBAC) and audit logging tools
  • Familiarity with industry regulations such as PCI-DSS, SOC2, HIPAA, and practices such as data classification and lineage
  • Experience building reusable onboarding assets, SDKs, and best practice guides for application teams
  • Development of shared connectors, bridges (e.g., API-to-Kafka), and schema-first design pipelines
  • Exposure to alternative messaging systems like Apache Pulsar, Redpanda, RabbitMQ, and NATS

Nice to have:

  • Experience deploying and managing Apache Kafka on Kubernetes (e.g., using Strimzi or Confluent Operator), including custom broker configurations and scaling strategies
  • Familiarity with containerization using Docker and orchestration using GKE or other Kubernetes-based platforms
  • Exposure to multi-tenant Kafka architectures with namespace isolation, quota enforcement, and security boundaries
  • Strong understanding of event-driven architecture (EDA), microservices communication patterns, and asynchronous messaging design
  • Hands-on experience with real-time data processing frameworks like Apache Flink, Kafka Streams, or Spark Structured Streaming
  • Experience configuring and tuning Kafka Connect connectors (e.g., Debezium, JDBC, Elasticsearch) for data pipeline integration
  • Proficiency in schema evolution practices using Avro, Protobuf, and tools like Confluent Schema Registry or Apicurio
  • Familiarity with service mesh technologies (e.g., Istio, Linkerd) and secure east-west traffic routing within cloud-native messaging environments
  • Knowledge of enterprise messaging migration strategies from legacy platforms such as IBM MQ or RabbitMQ to cloud-native solutions
  • Experience using Google Cloud Pub/Sub and Dataflow for scalable event ingestion, transformation, and streaming analytics
  • Knowledge of access control and authentication mechanisms such as Kafka ACLs, SASL/SCRAM, Kerberos, or GCP IAM
  • Awareness of message delivery semantics (at-least-once, exactly-once) and how to implement idempotency in distributed systems
  • Hands-on exposure to observability stacks such as Prometheus/Grafana, Confluent Control Center, and GCP Monitoring for tracking message flow, latency, and system health
  • Experience building and maintaining automated CI/CD pipelines for Kafka topic provisioning, ACL management, and connector deployment
  • Familiarity with metadata and governance platforms such as Dataplex, Google Data Catalog, or Collibra in the context of messaging assets
  • Industry experience in domains such as retail, supply chain, or financial services with large-scale streaming use cases
  • Certifications related to Apache Kafka (e.g., Confluent Certified Developer/Administrator) or Google Cloud (e.g., Professional Cloud Developer)
  • Understanding of compliance standards (e.g., PCI-DSS, ISO 27001) as they relate to secure messaging
  • Comfortable working in agile delivery models with tools like JIRA, Confluence, and participating in sprints and architecture reviews
  • Ability to lead design discussions, provide technical mentoring, and promote platform adoption across enterprise teams
  • Bachelor’s Degree in Computer Science, Software Engineering, Information Systems, or equivalent practical experience
What we offer:
  • Competitive Wages & Paid Time Off
  • Stock Purchase Plan & 401k with Employer Contributions Starting Day One
  • Medical, Dental, & Vision Insurance with Optional Flexible Spending Account (FSA)
  • Team Member Health/Wellbeing Programs
  • Tuition Educational Assistance Programs
  • Opportunities for Career Growth

Additional Information:

Job Posted:
March 12, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior System Engineer - Platform/Messaging

Receptionist

We are looking for a detail-oriented Receptionist to join our team in Miami, Flo...
Location
Location
United States , Miami
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in using a multi-line phone system for managing calls
  • Strong customer service skills with the ability to handle inquiries professionally
  • Experience in data entry with attention to detail and accuracy
  • Ability to communicate effectively through email correspondence
  • Excellent interpersonal skills to interact with staff and visitors
  • Competence in Microsoft Excel, Outlook, and Word for administrative tasks
  • Organizational skills to manage files and maintain office order
  • Capability to schedule appointments and coordinate meetings efficiently
Job Responsibility
Job Responsibility
  • Oversee access to the office, ensuring security and proper protocols are followed
  • Manage the stocking and organization of supplies in the kitchens to maintain efficiency
  • Maintain the cleanliness and orderliness of the office environment to ensure a neat appearance
  • Handle incoming phone calls using a multi-line phone system, providing courteous and efficient service
  • Assist with scheduling appointments and coordinating meetings as needed
  • Perform accurate data entry tasks to support administrative functions
  • Organize and maintain files, ensuring easy accessibility and proper documentation
  • Communicate effectively via email to address inquiries and provide information
  • Execute various ad hoc projects and tasks as assigned to support office operations
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Read More
Arrow Right

Psychiatrist

Astrya Global, a San Diego–based medical staffing agency, is hiring Psychiatrist...
Location
Location
United States , San Bernardino
Salary
Salary:
Not provided
astryaglobal.com Logo
Astrya Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Active CA licensure
  • Board certification
  • Active CA DEA
  • New graduates eligible
Job Responsibility
Job Responsibility
  • Evaluate and diagnose mental health disorders
  • Develop and implement treatment plans
  • See 15+ patients per day completing initial and follow up appointments
  • Prescribe and refill medications
  • Collaborate with up to 4 NPs as needed
What we offer
What we offer
  • Malpractice Insurance
  • Weekly pay
  • Full-service credentialing and licensing department
  • Dedicated corporate travel team with airfare, car rental and hotel booking
  • Referral Bonus up to $5,000
  • Fulltime
Read More
Arrow Right

Cook

Boston Pizza Cooks are the engine of the entire restaurant! They are responsible...
Location
Location
Canada , Campbell River
Salary
Salary:
17.85 - 22.00 CAD / Hour
bostonpizza.com Logo
Boston Pizza
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Collaborative
  • Team Player
  • Multi Tasker
  • Self-Starter
  • Detail Oriented
  • Efficient
Job Responsibility
Job Responsibility
  • Creating delicious menu items perfectly every time for every guest
  • Ensuring Guests have an excellent Boston Pizza experience from start to finish
  • Championing a fun and safe work environment
  • Contributing to a thriving workplace culture
  • Works alongside their team members
  • Builds relationships by finding common ground and working cohesively with all team members
  • Committed to championing the 'Heart of Hospitality', Boston Pizza's Brand Standards and Food Safety
  • Dedicated to providing Perfect Food Every Time to our Guests
  • Maintains composure and thrives in a fast pace environment
  • Works with a sense of purpose and always prioritize Guest’s orders
What we offer
What we offer
  • Flex scheduling, days or nights
  • A discount on Canada's best gourmet pizza
  • A company entrenched in community service with opportunities to give back
  • Staff parties, pizza recipe contests etc
  • Work as part of an amazing team
  • BPI Scholarship Awards
  • Flexible scheduling that fits your lifestyle and contributes to your life-work balance
  • Exciting opportunities for career growth within the restaurant or at Boston Pizza head office
  • Build relationships and give back to your local community
  • Boston Pizza Scholarship Program
Read More
Arrow Right

Specialist Education Support Assistant

Are you looking to get into supply or long‑term school-based support work? Are y...
Location
Location
United Kingdom , South Gloucestershire
Salary
Salary:
Not provided
affinityworkforce.com Logo
AFFINITY WORKFORCE
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hold an Enhanced Child DBS on the Update Service (or be willing to apply through AWS)
  • Have the ability to develop, encourage and promote learning
  • Have a passion for making a positive difference to children’s lives
  • Bring experience working within a UK school environment
  • Hold a valid safeguarding certificate
  • Demonstrate strong communication skills with children, staff and parents
Job Responsibility
Job Responsibility
  • Delivering targeted interventions
  • Supporting behaviour and pastoral needs
  • Helping pupils overcome barriers to learning
  • Providing lunchtime support
What we offer
What we offer
  • Competitive daily rate
  • Opportunities to gain valuable, varied school experience
  • Access to exclusive rewards hub offering training, discounts & cashback
  • Generous referral bonus
  • Flexible work schedule
  • Temp-to-perm opportunities
  • Weekly pay
Read More
Arrow Right

Psychiatrist

Astrya Global, a San Diego–based medical staffing agency, is looking for a psych...
Location
Location
United States , San Diego
Salary
Salary:
250.00 - 260.00 USD / Hour
astryaglobal.com Logo
Astrya Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • M.D. or D.O. with active, unrestricted California medical license
  • Active California DEA
  • 2 years of experience preferred
  • Credentialed with Optum and PAVE preferred
Job Responsibility
Job Responsibility
  • Conduct comprehensive psychiatric evaluations including DSM-5-TR diagnostic assessments and clinical formulation
  • Develop and oversee individualized treatment plans in collaboration with patients and multidisciplinary care teams
  • Prescribe, monitor, and adjust psychotropic medications while evaluating treatment response and side effects
  • Perform risk assessments for suicidality, homicidality, and danger to self or others, and implement appropriate safety planning
  • Coordinate care with psychologists, therapists, primary care providers, case managers, and community agencies to support integrated treatment
  • Provide crisis evaluation, stabilization, and psychiatric consultation as needed
  • Facilitate referrals to appropriate levels of care including inpatient, partial hospitalization (PHP), intensive outpatient (IOP), and residential treatment programs
  • Maintain accurate and timely clinical documentation in accordance with regulatory and organizational standards
What we offer
What we offer
  • Malpractice Insurance
  • Weekly pay
  • Full-service credentialing and licensing department
  • Dedicated corporate travel team with airfare, car rental and hotel booking
  • Referral Bonus up to $5,000
  • Fulltime
Read More
Arrow Right

Power Apps Developer

The Power Apps Developer is responsible for designing, developing, and maintaini...
Location
Location
United States , Riviera Beach
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Information Technology, Computer Science, Business Systems, or related field OR equivalent combination of certifications and relevant experience in lieu of degree
  • Minimum 4–6 years of experience developing business applications or enterprise solutions
  • Minimum 2+ years of hands-on Power Platform development experience
  • Strong experience with: Power Apps (Canvas and/or Model-Driven)
  • Power Automate workflows
  • SharePoint and Microsoft 365 integration
  • Data modeling and structured data design
  • Ability to translate business requirements into technical solutions
Job Responsibility
Job Responsibility
  • Design, develop, and deploy custom business applications using Microsoft Power Apps (Canvas and Model-Driven apps)
  • Build solutions that support operational workflows, approvals, data collection, and reporting needs
  • Create responsive applications that function across desktop, tablet, and mobile platforms
  • Ensure applications follow enterprise architecture and security standards
  • Develop automated workflows using Power Automate
  • Integrate applications with enterprise platforms such as: SharePoint
  • Microsoft 365 services
  • Dataverse
  • SQL databases
  • Oracle or other enterprise systems (as applicable)
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Read More
Arrow Right

Cook

Looking for Line Cooks to join our team here at Boston Pizza. We strive to creat...
Location
Location
Canada , Campbell River
Salary
Salary:
17.85 - 22.00 CAD / Hour
bostonpizza.com Logo
Boston Pizza
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Collaborative
  • Team Player
  • Multi Tasker
  • Self-Starter
  • Detail Oriented
  • Efficient
Job Responsibility
Job Responsibility
  • Works alongside their team members
  • Committed to championing the 'Heart of Hospitality', Boston Pizza's Brand Standards and Food Safety
  • Dedicated to providing Perfect Food Every Time to our Guests
  • Maintains composure and thrives in a fast pace environment
  • Works with a sense of purpose and always prioritize Guest’s orders
What we offer
What we offer
  • Flex scheduling, days or nights
  • A discount on Canada's best gourmet pizza
  • A company entrenched in community service with opportunities to give back
  • Staff parties, pizza recipe contests etc
  • Work as part of an amazing team
  • BPI Scholarship Awards
  • Flexible scheduling that fits your lifestyle and contributes to your life-work balance
  • Exciting opportunities for career growth
  • Management Training Programs, Leadership Development conferences and access to dynamic mentorship programs
  • Fantastic reward and recognition programs
Read More
Arrow Right

Principal Civil Engineer

BSP Consulting has an immediate vacancy for a Principal Civil Engineer Nottingha...
Location
Location
United Kingdom , Nottingham
Salary
Salary:
Not provided
bsp-consulting.co.uk Logo
BSP Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Specific experience in the use of AutoCAD for technical drawing
  • A strong background of Degree level Civil Engineering and a logical analytical approach to problem solving
  • Civil3D or PDS, InfoDrainage or MicroDrainage software experience
  • Knowledge of the construction industry and basic health and safety
  • 10+ years of relevant technical experience
  • Strong client‑care skills
  • Effective communicator in written English and verbal communication
  • Solid understanding of the construction industry, current design standards, and health and safety requirements
  • Experience with InfoDrainage, Civil 3D for design, and AutoCAD for technical drawing
  • A strong background of English, Mathematics and a logical analytical approach to problem solving
Job Responsibility
Job Responsibility
  • Management, design, and drafting of a wide range of civil engineering schemes
  • Section 278 / Section 38 highway works for adoption
  • Section 104 / Section 185 drainage works for adoption
  • Private levels and private drainage design
  • External works design
  • Cut and fill analysis and earthworks design
  • Sustainable drainage systems (SuDS) design
  • Liaison with local authorities, water companies, the Environment Agency, and project stakeholders
  • Design and drafting of civil engineering works across multiple sectors
  • Deputise for the team leader, supporting the planning and organisation of tasks, people, and resources
What we offer
What we offer
  • Mentorship towards ICE Chartership can be provided where required
  • Fulltime
Read More
Arrow Right