CrawlJobs Logo

Senior System Engineer - Platform/Messaging

oreillyauto.com Logo

O'Reilly Auto Parts

Location Icon

Location:
United States , Springfield

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The Sr Systems Engineer Platform – Messaging Platform will play a key role in designing, implementing, and maintaining enterprise messaging systems that support both real-time and asynchronous communication between distributed applications and services. This role focuses on ensuring robust, scalable, secure, and cost-efficient messaging solutions across hybrid cloud and on-premises environments. The engineer will work closely with architects, developers, infrastructure, and DevOps teams to standardize messaging platforms and promote modern integration patterns that align with the organization’s digital transformation goals.

Job Responsibility:

  • Design, implement, and support scalable messaging platforms including Apache Kafka (Confluent/OSS), Google Cloud Pub/Sub, and legacy systems such as IBM MQ
  • Build high-throughput, low-latency event streaming pipelines that support mission-critical workloads, leveraging Kafka brokers, topics, partitions, and consumer groups
  • Define and enforce schema governance using tools like Confluent Schema Registry or Apicurio
  • enforce consistent serialization formats (e.g., Avro, JSON, Protobuf)
  • Standardize topic taxonomy and hierarchy across business domains, enforce naming conventions, and implement lifecycle management practices for topics and subscriptions
  • Manage Kafka Connect connectors (source/sink), KSQLDB flows, and stream processing topologies using Kafka Streams
  • Define and implement platform-wide policies for message retention, compaction, ACLs, multi-tenancy isolation, and access control
  • Ensure reliable message delivery through producer retries, dead-letter queues, idempotency handling, and exactly-once semantics where applicable
  • Automate deployment and configuration of messaging infrastructure using Terraform, Helm, Ansible, and Kubernetes operators (e.g., Strimzi for Kafka)
  • Maintain Git-based configuration-as-code repositories to drive consistency and auditability across environments
  • Develop CI/CD pipelines to support promotion of configuration artifacts, rolling upgrades of messaging clusters, and dynamic provisioning of topics and consumer policies
  • Implement proactive drift detection, self-healing scripts, and platform bootstrapping workflows
  • Integrate messaging platforms with enterprise IAM (e.g., GCP IAM, LDAP, Kerberos, or RBAC for Confluent/Kafka)
  • Implement encryption in transit and at rest using TLS, mTLS, SASL/SCRAM, and Kafka-level ACLs
  • Implement observability dashboards and alerts using Prometheus, Grafana, Confluent Control Center, ELK Stack, or Google Cloud Operations Suite
  • Establish performance baselines and configure SLA/SLO-based monitoring for producers, consumers, brokers, and ZooKeeper
  • Partner with development teams to onboard producer and consumer applications through reusable connectors, API-to-event bridges, and SDKs
  • Provide technical guidance and documentation on best practices for schema evolution, idempotent messaging, and replayable data streams
  • Lead efforts to decommission legacy messaging platforms (e.g., MQSeries, RabbitMQ) and consolidate onto modern event streaming technologies
  • Evaluate emerging messaging technologies (e.g., Pulsar, Redpanda) for specific workloads or cost optimization opportunities

Requirements:

  • 5+ years of hands-on experience with enterprise-grade messaging platforms, including Apache Kafka (Confluent/OSS), Google Cloud Pub/Sub, or equivalent
  • Deep expertise in Kafka architecture including broker management, partitioning, replication, log retention, and consumer group coordination
  • Proficiency in schema evolution and contract validation using Confluent Schema Registry, Apicurio, or similar tools
  • Demonstrated experience with Kafka Connect, Kafka Streams, and stream processing applications for real-time data movement
  • Strong knowledge of topic hierarchy management, naming conventions, access control (ACLs), and governance policies
  • Experience designing and deploying messaging platforms for mission-critical, high-throughput, low-latency event-driven systems
  • Experience deploying and managing messaging workloads on GCP using Google Cloud Pub/Sub, Eventarc, or custom solutions
  • Familiar with hybrid architectures including secure messaging between on-prem and cloud workloads via VPN/Interconnect
  • Hands-on implementation of GCP IAM, VPC Service Controls, and secure endpoint management for messaging components
  • Understanding of regional and multi-region messaging designs for high availability and disaster recovery
  • Skilled in automating infrastructure provisioning and configuration using Terraform, Helm, and Kubernetes (e.g., Strimzi operators)
  • CI/CD experience with GitHub Actions, Jenkins, or Google Cloud Build for promoting messaging configurations and application artifacts
  • Strong understanding of data protection practices including TLS/mTLS encryption, SASL/SCRAM, and token-based authentication
  • Integration with enterprise IAM providers (e.g., GCP IAM, LDAP, SSO, RBAC) and audit logging tools
  • Familiarity with industry regulations such as PCI-DSS, SOC2, HIPAA, and practices such as data classification and lineage
  • Experience building reusable onboarding assets, SDKs, and best practice guides for application teams
  • Development of shared connectors, bridges (e.g., API-to-Kafka), and schema-first design pipelines
  • Exposure to alternative messaging systems like Apache Pulsar, Redpanda, RabbitMQ, and NATS

Nice to have:

  • Experience deploying and managing Apache Kafka on Kubernetes (e.g., using Strimzi or Confluent Operator), including custom broker configurations and scaling strategies
  • Familiarity with containerization using Docker and orchestration using GKE or other Kubernetes-based platforms
  • Exposure to multi-tenant Kafka architectures with namespace isolation, quota enforcement, and security boundaries
  • Strong understanding of event-driven architecture (EDA), microservices communication patterns, and asynchronous messaging design
  • Hands-on experience with real-time data processing frameworks like Apache Flink, Kafka Streams, or Spark Structured Streaming
  • Experience configuring and tuning Kafka Connect connectors (e.g., Debezium, JDBC, Elasticsearch) for data pipeline integration
  • Proficiency in schema evolution practices using Avro, Protobuf, and tools like Confluent Schema Registry or Apicurio
  • Familiarity with service mesh technologies (e.g., Istio, Linkerd) and secure east-west traffic routing within cloud-native messaging environments
  • Knowledge of enterprise messaging migration strategies from legacy platforms such as IBM MQ or RabbitMQ to cloud-native solutions
  • Experience using Google Cloud Pub/Sub and Dataflow for scalable event ingestion, transformation, and streaming analytics
  • Knowledge of access control and authentication mechanisms such as Kafka ACLs, SASL/SCRAM, Kerberos, or GCP IAM
  • Awareness of message delivery semantics (at-least-once, exactly-once) and how to implement idempotency in distributed systems
  • Hands-on exposure to observability stacks such as Prometheus/Grafana, Confluent Control Center, and GCP Monitoring for tracking message flow, latency, and system health
  • Experience building and maintaining automated CI/CD pipelines for Kafka topic provisioning, ACL management, and connector deployment
  • Familiarity with metadata and governance platforms such as Dataplex, Google Data Catalog, or Collibra in the context of messaging assets
  • Industry experience in domains such as retail, supply chain, or financial services with large-scale streaming use cases
  • Certifications related to Apache Kafka (e.g., Confluent Certified Developer/Administrator) or Google Cloud (e.g., Professional Cloud Developer)
  • Understanding of compliance standards (e.g., PCI-DSS, ISO 27001) as they relate to secure messaging
  • Comfortable working in agile delivery models with tools like JIRA, Confluence, and participating in sprints and architecture reviews
  • Ability to lead design discussions, provide technical mentoring, and promote platform adoption across enterprise teams
  • Bachelor’s Degree in Computer Science, Software Engineering, Information Systems, or equivalent practical experience
What we offer:
  • Competitive Wages & Paid Time Off
  • Stock Purchase Plan & 401k with Employer Contributions Starting Day One
  • Medical, Dental, & Vision Insurance with Optional Flexible Spending Account (FSA)
  • Team Member Health/Wellbeing Programs
  • Tuition Educational Assistance Programs
  • Opportunities for Career Growth

Additional Information:

Job Posted:
March 12, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior System Engineer - Platform/Messaging

New

Chef

We're currently recruiting an ambitious Chef to help us create exceptional food ...
Location
Location
United Kingdom , Cockfosters
Salary
Salary:
16.50 GBP / Hour
14forty.co.uk Logo
14forty
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Be passionate about great-tasting food and exceptional customer service
  • Hold a City & Guilds 706/1 & 2 or NVQ equivalent
  • Have experience supervising a team
  • Have experience in a similar Chef role
  • Hold a Food Hygiene certificate
  • Have a flexible approach to working
Job Responsibility
Job Responsibility
  • Preparing delicious, high-quality food that delights our clients and customers
  • Overseeing and implementing menu changes
  • Identifying opportunities to improve our food services
  • Listening and acting on customer feedback to consistently improve our food services
  • Supporting with the creation of new menus and creative food concepts
  • Representing Healthcare and maintaining a positive brand image
  • Monitoring inventories to keep our kitchens well-stocked
  • Overseeing kitchen cleaning responsibilities to maintain hygiene standards
  • Complying with Food Handling, Hygiene and Health and Safety regulations
What we offer
What we offer
  • Free meals
  • Onsite free car parking
  • Contributory pension scheme
  • Grow your career with our Career Pathways and MyLearning programmes
  • Quick access for you and your immediate family to a Digital GP, and wider healthcare benefits
  • Exclusive travel discounts with TUI, Expedia, Booking.com and many more
  • Save money on your food shop with discounts on Tesco, Sainsbury's, Morrisons and many more
  • Up to 44% off cinema tickets to enjoy your favourite blockbuster
  • Receive cash rewards every time you spend and use them on a wide range of brands
  • Un-wind with us with free wellness, mindfulness and exercise classes
  • Parttime
Read More
Arrow Right
New

Principal Engineer – SAP PS, CLM(Re-FX) & EPPM

Wells Fargo is seeking a Principal Engineer.
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
May 19, 2026
Flip Icon
Requirements
Requirements
  • 7+ years of Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 7+ years of experience in, with at least 3+ full-cycle R/3/ECC to S/4HANA migration projects as a Technical Lead or Architect
  • Proven experience in a lead or principal role managing complex SAP landscapes
  • Strong understanding of technical architectures for SAP FI, AP, AR, GL, AA, MM, PS, Ariba, CLM(Re-FX), and EPPM
  • Proven capability to operate as a Principal-level leader: owning solution direction, making architectural decisions, and driving outcomes across multiple workstreams/teams
  • Strong hands-on expertise in SAP (relevant area to the role), with deep understanding of SAP standard processes and fit-to-standard principles
  • Strong knowledge of SAP best practice for Clean Core adoption
  • Knowledge of SAP BTP (Business Technology Platform) integration and SAP Analytics Cloud (SAC) for reporting
  • Demonstrated experience with SAP solution design across at least two of the following: core process design, integration, data migration, extension strategy, security/authorizations, reporting/analytics, testing & cutover
Job Responsibility
Job Responsibility
  • Lead the strategy, evaluation, and resolution of highly complex, enterprise-wide challenges by delivering long-term, scalable solutions that require vision, innovation, and advanced analytical thinking
  • Assess and recommend emerging technologies and products to automate Embedded IT controls, processes, and reporting
  • Serve as a subject-matter expert to functional teams, system administrators, architects, and developers in designing target solution architectures and applying industry best practices
  • Identify and champion innovations that enhance operational efficiency or create competitive advantage for Embedded IT and the broader organization as a shared services provider
  • Perform hands-on engineering work, including designing, coding, testing, debugging, and documenting solutions for projects and programs
  • Develop end-to-end solution designs, determining appropriate technologies, defining interface patterns, managing upstream and downstream integrations, architecting data models to support cases, and producing required documentation and best-practice guidance
  • Collaborate closely with development teams to communicate design intent, provide technical direction, and support implementation as needed
  • Engage strategically with cross-functional partners and leaders at all levels, serving as a trusted technical advisor to executive leadership
  • Fulltime
Read More
Arrow Right
New

Operations Manager

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Atlanta
Salary
Salary:
19.00 - 29.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
June 27, 2026
Flip Icon
Requirements
Requirements
  • Deductive reasoning ability, advanced analytical skills and computer skills
  • Advanced communication skills, leadership, supervision, and influencing skill
  • Ability to work a full-time flexible schedule, including some early morning, overnight and weekend shifts, to work overtime as needed, and to respond to urgent issues at the store when they arise
  • High School diploma or equivalent preferred but not required
Job Responsibility
Job Responsibility
  • Overall store management, supervision, and policy implementation
  • Sales and inventory management
  • Employee staffing, training, and development
  • Financial management
  • Customer service leadership
  • Lead others and work effectively with store crews
  • Supervise, assign and direct activities of the store's crew
  • Effectively communicate information to store crew and supervisors in an open and timely manner
  • Support Store Manager with actions plans for operational and service improvement
  • Assist customers with their questions, problems and complaints
What we offer
What we offer
  • medical, dental, and vision coverage
  • paid time off
  • retirement savings options
  • wellness programs
  • other resources, based on eligibility
  • Fulltime
Read More
Arrow Right
New

Principal Electrical Design Engineers

Due to our ongoing growth, we are looking for Principal-level Electrical Enginee...
Location
Location
United Kingdom , Blackburn
Salary
Salary:
Not provided
vitalenergi.co.uk Logo
Vital Energi Utilities Limited
Expiration Date
June 05, 2026
Flip Icon
Requirements
Requirements
  • 6+ years' experience producing electrical designs for Power Generation, Power Transmission, Renewable Energy, Building Services or similar projects
  • Ideally educated to HND/HNC or Degree level in an Electrical Engineering discipline
  • Knowledge of BS7671 Wiring Regulations and relevant CIBSE electrical standards
  • Full UK manual driving licence
  • Holding Chartered Engineer status or working towards this (advantageous)
  • Knowledge of CHP, Biomass, Solar or other Renewable technologies (advantageous)
  • An understanding of HV design and protection (advantageous)
  • Experience with Amtech design software (advantageous)
  • An understanding of pneumatic & hydraulics (advantageous)
  • Experience with motor VSD controls and MCC equipment (advantageous)
Job Responsibility
Job Responsibility
  • Overseeing the delivery of design work for high-profile projects, including operational responsibility for a section of the Electrical Design team to ensure requirements and timelines are met and submissions are produced to the highest standard
  • Liaising with clients to appraise, interpret and document their requirements as well as carrying out business development activities
  • Leading the development of technical specifications, calculations, electrical designs and drawings used in a variety of projects
  • Producing things such as power cable calculations, C&I cabling specifications, cable & interconnection schedule projection and electrical building service designs such as for Lighting and Alarms
  • Inputting into initial project conceptual work including site investigations, surveys, client meetings, project submissions and presentations
  • Supporting the compilation and production of design documentation to bespoke project specifications, client specifications and/or legislative compliance
  • Identifying, resolving and proactively preventing design issues
  • Carrying out relevant equipment selection for projects
  • Ensuring compliance with CDM requirements, in-house design processes, legislation and company procedures
  • Assisting in the specification of electrical aspects for tendering works
What we offer
What we offer
  • Salary negotiable DOE
  • Car Allowance
  • Paid Professional engineering institutions (IET, CIBSE etc.)
  • Contributory Company Pension Scheme
  • Non-contributory death-in-service insurance
  • Employee Assistance Programme
  • 25 Days Holiday plus 8 days bank holidays
  • Additional holidays awarded in line with length of service
  • Option to purchase/sell additional holidays
  • Onsite gym/wellbeing centre at our Blackburn Head Office
  • Fulltime
Read More
Arrow Right
New

Store Associate

We're building a world of health around every individual — shaping a more connec...
Location
Location
United States , Aiea
Salary
Salary:
16.00 - 23.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
June 27, 2026
Flip Icon
Requirements
Requirements
  • At least 16 years of age
  • Remaining upright on the feet, particularly for sustained periods of time
  • Lifting and exerting up to 35 lbs of force occasionally, up to 10 lbs of force frequently, and a negligible amount of force regularly to move objects to and from, including overhead lifting
  • Visual Acuity - Having close visual acuity to perform activities such as: viewing a computer terminal, reading, visual inspection involving small parts/details
Job Responsibility
Job Responsibility
  • Providing differentiated customer service by anticipating customer needs, demonstrating compassion and care in all interactions, and actively identifying and resolving potential service issues
  • Focusing on the customer by giving a warm and friendly greeting, maintaining eye contact and offering help locating additional items, when needed
  • Accurately perform cashier duties - handling cash, checks and credit card transactions with precision while following company policies and procedures
  • Maintaining the sales floor by restocking shelves, checking in vendors, updating pricing information and completing inventory management tasks as directed by store manager
  • Supporting opening and closing store activities, when needed
  • Providing customer support to all departments, including photo and beauty, ensuring departments are fully stocked and operational while remaining current with all updated services and tools
  • Assisting pharmacy personnel when needed, including working regular shifts in the pharmacy as part of opportunities for growth and career development
  • Embracing and advocating for new CVS services and loyalty programs that support our purpose of helping people on their path to better health
What we offer
What we offer
  • dental
  • vision
  • wellness resources
  • employee discounts
  • access to certain voluntary benefits
  • other programs
  • Parttime
Read More
Arrow Right
New

Lead Commercial Loan Closing Representative

Wells Fargo is seeking a Lead Commercial Loan Closing Representative
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
May 07, 2026
Flip Icon
Requirements
Requirements
  • 4+ years of Commercial Loan Closing support experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • Understanding and Application of AI Tools: Ability to leverage AI platforms (e.g., Microsoft Copilot, GitHub Copilot, Tachyon, Agentspace) for routine tasks such as summarizing information, drafting content, and analyzing data, while maintaining human oversight
  • Critical Thinking: Ability to interpret AI outputs, validate insights, and make informed business decisions
  • Responsible AI Use: Awareness of ethical considerations, data privacy, and compliance when using AI solutions
  • Adaptability and Continuous Learning: Commitment to upskilling and staying current with emerging technologies
Job Responsibility
Job Responsibility
  • Support performance and overall effectiveness of team, as well as cross-group pre-close and post-close documents for the most complex commercial real estate loans
  • Provide feedback and present ideas for improving or implementing processes and tools within Commercial Loan Closing
  • Perform or guide others on complex business and operational decisions that require planning, evaluation, and interpretation
  • Review and prepare loan related documents
  • Independently prioritize work and provide day-to-day-work leadership and mentorship to Commercial Loan Closing team
  • Lead or contribute to implementation of new or revised processes and procedures that require coordination among various work groups
  • Provide guidance and subject matter expertise to peers, colleagues and managers on the functions, policies, procedures and compliance requirements
  • Fulltime
!
Read More
Arrow Right
New

Spa Support Expert - Receptionist

Our Spa Specialists play an important role in support of a number of vital Spa f...
Location
Location
Malaysia , Langkawi
Salary
Salary:
Not provided
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High school diploma or G.E.D. equivalent
  • No related work experience
  • No supervisory experience
Job Responsibility
Job Responsibility
  • Promoting Spa services or retail
  • Scheduling reservations and confirming appointments
  • Providing answers about services
  • Checking in guests
  • Processing payments
  • Creating a safe workplace
  • Following company policies and procedures
  • Upholding quality standards
  • Ensuring professional uniform, personal appearance, and communications
  • Fulltime
Read More
Arrow Right
New

Operations and Performance Manager

The Operations and Performance Manager is responsible for the safe, proper and e...
Location
Location
United Kingdom , Drakelow
Salary
Salary:
Not provided
vitalenergi.co.uk Logo
Vital Energi Utilities Limited
Expiration Date
May 21, 2026
Flip Icon
Requirements
Requirements
  • Knowledge of construction detail and the installation and commissioning sequences of MEP Services
  • Understanding of planning and scheduling techniques
  • Understanding of project lifecycles from concept to handover
  • Proficiency in project management software Asta Powerproject
  • Relevant contractual knowledge including use of standard forms of NEC and JCT contracts
  • Recognised qualification in a construction related field
  • Degree or HND / HNC or equivalent in a relevant Engineering discipline (mechanical or electrical) and have previous SAP authorisation
  • A safety qualification, preferably IOSH or NEBOSH
  • Full UK Driving Licence
Job Responsibility
Job Responsibility
  • As a Lead Senior Authorised Person, be the custodian of the Site Safety Rules including their training, compliance and implementation
  • Ensure all activities in the plant are carried out with the highest regard for the health, safety & environmental consideration and well-being of all employees and customers on site
  • Thoroughly and promptly investigates any accidents or near misses in conjunction with the SHE department to ensure that any unsafe practices or conditions are addressed and eliminated immediately
  • Ensure compliance with the site Environmental Permit and other Environmental Legislation
  • Assist the SHEQ Manager with Environment Agency quarterly and annual reporting and the closure of Improvement Conditions
  • Systematically deliver accurate and timely compliance reporting ensuring compliance with essential contracts delivering BAU essential services
  • Direct and co-ordinate resources to meet plant and business requirements
  • Maintain and enforce company policies and procedures, environmental compliance, and health and safety requirements
  • Monitor and, where possible, improve plant performance against set Key Performance Indicators (KPIs) and standards
  • Meet agreed organisational performance plans within agreed budgets and timescales
  • Fulltime
Read More
Arrow Right