CrawlJobs Logo

Principal Engineer

paloaltonetworks.com Logo

Palo Alto Networks

Location Icon

Location:
United States , Santa Clara

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

147000.00 - 237500.00 USD / Year

Job Description:

The Senior Data Center Operations Engineer is responsible for the bedrock of our high-availability infrastructure. This role bridges the gap between physical hardware and the Red Hat OpenShift Container Platform (OCP). Your mission is to ensure 99.99% availability by architecting resilient physical layouts and automating the deployment, scaling, and self-healing capabilities of our production clusters.

Job Responsibility:

  • Design and development of a scalable distributed management plane infrastructure to manage Palo Alto Networks’ next-generation network security solutions
  • Ensure 99.99% availability by architecting resilient physical layouts and automating the deployment, scaling, and self-healing capabilities of our production clusters
  • Monitor and maintain data center systems with a focus on 'Zero Single Point of Failure' (ZSPoF) architecture for OpenShift control planes and worker nodes
  • Implement and manage OpenShift 4.x clusters across multiple power and cooling zones to ensure 99.99% uptime
  • Design, test, and execute automated failover strategies and backup/restore procedures using tools like OADP (Velero) and Red Hat ACM
  • Perform routine maintenance and upgrades using GitOps (ArgoCD) and the Machine Config Operator to ensure zero-downtime node evacuations and patching
  • Resolve deep-stack hardware and software issues, from faulty GPU firmware to OpenShift SDN (OVN-Kubernetes) network latencies
  • Coordinate with vendors for specialized hardware (e.g., NVIDIA, Dell, Cisco) while maintaining strict security and firmware compliance
  • Optimize rack density for high-performance GPU clusters while managing thermal loads and power distribution (PDU) to prevent circuit-trip outages
  • Maintain accurate documentation and integrate hardware health metrics (IPMI/SNMP) into Prometheus/Grafana for proactive alerting
  • Rack and stack high-density GPU servers, ensuring redundant power-pathing and high-speed (100G/200G) InfiniBand or Ethernet cabling
  • Perform precision physical installation and replacement of critical components (CPUs, GPUs, NVMe storage) in a live production environment without impacting cluster quorum

Requirements:

  • Bachelor's degree in Computer Science, IT, or equivalent experience
  • 5+ years of experience specifically operating Red Hat OpenShift (OCP) in a production environment
  • Deep experience racking/stacking and cabling high-density GPU systems (e.g., NVIDIA DGX or similar) and specialized AI/ML hardware
  • Advanced proficiency in Ansible or Pulumi for automating bare-metal provisioning and cluster configuration
  • Strong Python and Bash skills for developing custom health-check scripts and API integrations
  • Expert-level CoreOS and RHEL administration, including kernel tuning and systemd management
  • Solid understanding of BGP, VLAN tagging, LACP, and Load Balancing (F5/NGINX) essential for cluster ingress
  • Experience with vSphere or KVM, and persistent storage solutions like OpenShift Data Foundation (ODF) or Ceph
  • Familiarity with DCIM tools (Netbox) and monitoring stacks ( ELK/Lok ..etci)
  • Ability to lift and move equipment up to 50 pounds (e.g., high-density 2U/4U servers)
  • Comfortable working in high-decibel, climate-controlled data center aisles
  • Capable of standing, walking, and performing precision cabling in tight rack spaces for extended periods
  • May require occasional travel to remote data center sites or edge locations

Additional Information:

Job Posted:
March 04, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Engineer

Principal Engineer, Cloud Engineer

Principal Engineer is responsible for leading the validation and implementation ...
Location
Location
United States , Overland Park; Bellevue
Salary
Salary:
126800.00 - 228900.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree Engineering, Computer Science
  • 7+ years of technical engineering experience
  • Experience with GitLab, GitOps, GitHub implementation and configuration
  • Experience with testing and implementing a cloud orchestrator
  • Experience with VoLTE, VILTE, OTT and LTE nodes interworking, capacity modelling, Quality of Service planning and dimensioning of SDN/NFV nodes
  • Experience with testing methodologies and techniques
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • MCP Orchestration and automation strategic lab planning
  • Develop test strategies and methodologies incorporating automation for quick time to market
  • Collaborate with application owners to ensure a successful implementation
  • Develop and execute detailed test plans
  • Lead QA cycles, report issues, and prepare readiness reports for large programs
  • Document all phases of the lifecycle
What we offer
What we offer
  • Competitive base salary and compensation package
  • Annual stock grant
  • Employee stock purchase plan
  • 401(k)
  • Access to free, year-round money coaches
  • Medical, dental and vision insurance
  • Flexible spending account
  • Employee stock grants
  • Employee stock purchase plan
  • Paid time off
  • Fulltime
Read More
Arrow Right

Principal Engineer - Advanced Customer Engineering

Senior level Advanced Customer Engineering (ACE) engineer working with largest a...
Location
Location
United States
Salary
Salary:
119500.00 - 275000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Mechanical, Electrical, or other Engineering, Computer Science, or equivalent experience
  • Typically 10+ years' experience
  • Deep understanding of enterprise networking
  • Modern enterprise network design, implementation and troubleshooting including DNS, DHCP, spanning tree, network access control technologies
  • WAN/Data Center Design including IGRP and EGRP Routing Protocols
  • 802.11 wireless solutions including design, implementation and troubleshooting
  • Security solutions including IPSec, SSL/TLS, Public Key Infrastructure
  • Excellent analytical and problem-solving skills
  • Strong history of troubleshooting with customers
  • Excellent written and verbal communication skills
Job Responsibility
Job Responsibility
  • Working with Critical Account Program customers acting as senior technical resource
  • Working with premium services customers for onboarding and ongoing care
  • Identifying suboptimal designs and/or misconfigurations and consulting on plans to correct
  • Working with engineering escalations team and customers to identify and troubleshoot bugs
  • Build strong customer relationships and become trusted advisor
  • Build strong relationships across wider internal organization
  • Approximately 25-50% travel
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion
  • Comprehensive benefits suite supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

Principal Engineer - Advanced Customer Engineering

Senior level Advanced Customer Engineering (ACE) engineer working with largest a...
Location
Location
United States
Salary
Salary:
119500.00 - 275000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Mechanical, Electrical, or other Engineering, Computer Science, or equivalent experience
  • Typically 10+ years' experience
  • Deep understanding of enterprise networking including DNS, DHCP, spanning tree, network access control technologies, 802.1X, IGRP routing protocols, remote access technologies
  • WAN/Data Center Design including IGRP and EGRP Routing Protocols, Spine/Leaf topologies and virtualization technologies
  • 802.11 wireless solutions including design, implementation and troubleshooting
  • Security solutions including IPSec, SSL/TLS, Public Key Infrastructure/Certificates, 802.1X, radius and LDAP directories
  • Excellent analytical and problem-solving skills
  • Strong history of troubleshooting with customers
  • Excellent written and verbal communication skills in English
  • Willingness to work as part of larger team
Job Responsibility
Job Responsibility
  • Working with Critical Account Program customers as senior technical resource
  • Working with premium services customers for onboarding and ongoing support
  • Identifying suboptimal designs and/or misconfigurations and consulting on correction plans
  • Working with engineering escalations team and customers to identify and troubleshoot bugs
  • Building strong customer relationships and becoming trusted advisor
  • Building strong relationships across internal organization
  • Collaborative teamwork and knowledge sharing
  • Travel up to 50%
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive benefits suite supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

Principal Engineer, SSD Firmware Engineering

We are seeking a talented Principal Engineer, Firmware Engineering to join our i...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
sandisk.com Logo
Sandisk
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Engineering, Electronics, Electrical Engineering, or related field
  • 10+ years of experience in firmware development for embedded systems
  • Strong proficiency in C/C++ programming languages
  • In-depth knowledge of microcontroller architectures and embedded systems
  • Experience with real-time operating systems (RTOS) and their implementation
  • Familiarity with hardware interfaces such as SPI, I2C, I3C, UART, and GPIO
  • Expertise in developing and debugging low-level device drivers
  • Proficiency in using version control systems, preferably Git
  • Strong analytical and problem-solving skills with attention to detail
  • Experience with firmware testing and validation methodologies
Job Responsibility
Job Responsibility
  • Design, develop, and implement firmware for embedded systems and microcontrollers
  • Collaborate with hardware engineers to integrate firmware with electronic components
  • Optimize firmware for performance, power consumption, and memory usage
  • Develop and maintain device drivers for various hardware interfaces
  • Implement and integrate real-time operating systems (RTOS) in firmware projects
  • Conduct code reviews and ensure adherence to coding standards and best practices
  • Debug and resolve firmware issues using specialized tools and techniques
  • Participate in firmware testing and validation processes
  • Document firmware architecture, design decisions, and implementation details
  • Stay up-to-date with the latest trends and technologies in firmware engineering
  • Fulltime
Read More
Arrow Right

Principal Engineer, ASIC Development Engineering (RTL Design)

We are seeking a highly skilled and experienced Principal Engineer to join our A...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
sandisk.com Logo
Sandisk
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BE or Master's in Electronics or Electrical Engineering, Computer Engineering, or a related field
  • 8+ years of experience in ASIC development, with a proven track record of leading complex project
  • Hands on in IP / blocks / subsystem complex design in verilog / sysverilog
  • Strong digital design development and execution skills , solving bugs
  • Experience in grooming team of 1-4 engineers, interacting with many team
  • Deep expirience in debug , solving problem, see the architecture view, proposing solutions.
  • Hands-on experience with industry-standard EDA tools and design flows
  • Deep knowledge on PCIe, axi , DMA, AHB interfaces
  • Expertise in high-performance and low-power design techniques
  • Excellent communication skills, both verbal and written, with the ability to articulate complex technical concepts clearly
Job Responsibility
Job Responsibility
  • Design and implements IPs and subsystems
  • Dealing the best of class IPs for all SanDisk products
  • Fulltime
Read More
Arrow Right

Principal/ Sr Principal Backend Engineer

Endor Labs is on a mission to enhance developer productivity and accelerate open...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.endorlabs.com Logo
Endor Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in engineering with at least 18+ years of experience building scalable backends for product/SaaS companies, with a strong track record of leading and delivering complex technical projects
  • Proficiency in Golang is strongly preferred
  • experience with other modern backend languages, microservices/distributed architecture, and frameworks is a plus
  • Practical experience in designing APIs with one or more frameworks (gRPC [preferred], ReST, GraphQL, Thrift, etc.)
  • Excellent problem-solving and debugging skills, and effective communication and leadership abilities are a must
  • Scalable Distributed System Experience - understand micro-services and domain-driven design, load balancing, horizontal/vertical scaling, and stateless architectures
  • Architecture - knowledge of data structures and a keen eye for building architectures that scale and extend easily for longevity
  • Ability to discuss tradeoffs between architecture’s choice to influence groups to move in the right direction
  • Able to enjoy working in a fast-moving environment with evolving requirements
  • Ability to solve problems creatively and independently when in uncharted or unfamiliar territory
Job Responsibility
Job Responsibility
  • Play a pivotal role in architecting and building the core backend infrastructure for our SaaS products
  • Lead and contribute to large-scale technical projects, ensuring the scalability, reliability, and performance of our systems
  • Design, architect, and build features end-to-end while working closely with Product Management, and our distributed Engineering team
  • Play a significant role in driving innovation, making critical architectural decisions, and leading the implementation of cutting-edge technologies
  • Mentor and coach team members by sharing your expertise, and promoting best practices within the team to foster a culture of continuous learning and growth
Read More
Arrow Right

Principal Software Engineer, Cloud Storage Engineering

We are working on a greenfield storage platform built on top of Kubernetes and P...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelors, Masters, or PhD in Computer science in a related technical field or similar experience
  • 10+ years of experience in software development and architecture
  • Expert-level experience with one or more prominent languages such as Java, Kotlin, or Go is crucial.
  • An expert in Kubernetes stateful sets and/or databases such as PostgreSQL.
  • Passion for collaborating with and mentoring junior members of the team
  • A real appetite for helping others learn and grow
  • Considers the customer impact when making technical decisions
Job Responsibility
Job Responsibility
  • Regularly tackle the largest and most complex problems on the team, from technical design to launch
  • Deliver solutions that are used by other teams and products
  • Determine plans-of-attack on large projects
  • Routinely tackle complex architecture challenges and apply architectural standards and start using them on new projects
  • Lead code reviews & documentation as well as take on complex bug fixes, especially on high-risk problems
  • Set the standard for thorough, meaningful code reviews
  • Partner across engineering teams to take on company-wide initiatives spanning multiple projects
  • Transfer your depth of knowledge from your current language to excel as a Software Engineer
  • Mentor more junior members
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Principal Development Engineer

Ready to join a team of visionaries who is dedicated to solving one of humankind...
Location
Location
Switzerland , Opfikon, Zurich
Salary
Salary:
Not provided
climeworks.com Logo
Climeworks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree (PhD or Master’s) in Mechanical Engineering, Chemical Engineering, Process Engineering, or a related field
  • 10+ years of experience in developing complex industrial equipment, ideally involving steam, vacuum, and thermal systems
  • Proven history of leading innovation in hardware development, from lab-scale prototypes to industrial-scale systems
  • Deeply knowledgeable in design-for-manufacture, industrialisation, and scaling of hardware systems
  • Proficient in CAD tools (preferably SolidWorks)
  • Experience with sorbents, adsorption/desorption processes, or thermal separation technologies
  • Trusted technical leader who inspires teams and drives alignment across disciplines
  • Communicates effectively with diverse stakeholders
  • Brings an entrepreneurial mindset
Job Responsibility
Job Responsibility
  • Lead the development of next-generation CO₂ collector system architectures, integrating sorbent and process requirements into scalable, manufacturable solutions
  • Drive the prototyping and testing of novel collector concepts and subsystems, overseeing the full lifecycle from ideation to final validation
  • Design and lead complex experimental campaigns to de-risk technologies and accelerate development timelines
  • Act as a key interface between sorbent science, process engineering, mechanical design, and industrialisation
  • Ensure seamless integration of material and process properties into mechanical systems
  • Champion cross-functional collaboration to scale technologies from lab to industrial deployment
  • Monitor industry trends and emerging technologies, identifying opportunities for differentiation
  • Actively contribute to Climeworks’ intellectual property portfolio and help shape our innovation strategy
  • Mentor senior and junior engineers, fostering a culture of technical excellence, creativity, and continuous learning
  • Set engineering standards and ensure best practices in design, prototyping, and documentation
What we offer
What we offer
  • 25 paid vacation days every year, plus public holidays
  • Hybrid work setup and up to 4 weeks of remote work annually within any EU country
  • Fair base pay paired with an equity package
  • Inclusive parental leave
  • Dedicated budget to invest in your professional growth
  • Referral Rewards
Read More
Arrow Right