CrawlJobs Logo
Microsoft Corporation Logo Microsoft Corporation · IT - Software Development

Hpc Operations Engineering Manager

United States, Mountain View 139900.00 - 274800.00 USD / Year · Job Posted February 16, 2026
Apply Position
Job Link Share

Job Description

Microsoft AI is seeking an experienced HPC Operations Engineering Manager to join our Infrastructure Team. In this role, you’ll lead a team of Site Reliability Engineers who blend software engineering and systems engineering to keep our large-scale distributed AI infrastructure reliable and efficient. You’ll work closely with ML researchers, data engineers, and product developers to design and operate the platforms that power training, fine-tuning, and serving generative AI models.

Job Responsibility

  • Team leadership: Lead a team of experienced SREs to ensure uptime, resiliency and fault tolerance of AI model training and inference systems
  • Observability: Design and help maintain monitoring, alerting, and logging systems to provide real-time visibility into model serving pipelines and infra
  • Automation & Tooling: Lead building of automation for deployments, incident response, scaling, and failover in hybrid cloud/on-prem CPU+GPU environments
  • Incident Management: Lead on-call rotations, troubleshoot production issues, conduct blameless postmortems, and drive continuous improvements
  • Security & Compliance: Ensure data privacy, compliance, and secure operations across model training and serving environments
  • Collaboration: Partner with ML engineers and platform teams to improve developer experience and accelerate research-to-production workflows

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with Site Reliability Engineering, DevOps, or Infrastructure Engineering Leadership roles AND 8+ years experience with Kubernetes, Docker, and container orchestration, AND 8+ years experience with public cloud platforms like Azure/AWS/GCP and infrastructure-as-code, AND 6+ years experience with programming/scripting skills not limited to Python, Go, or Bash
  • OR equivalent experience
  • Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience AND 10+ years experience with Kubernetes, Docker, and container orchestration, AND 10+ years' experience with public cloud platforms like Azure/AWS/GCP and infrastructure-as-code
  • OR equivalent experience
  • 6+ years people management experience
  • Experience in monitoring & observability tools (Grafana, Datadog, OpenTelemetry, etc.)
  • Experience running large-scale GPU clusters for ML/AI workloads
  • Experience with high-performance computing (HPC) and workload schedulers (Kubernetes operators)
  • Knowledge of CI/CD pipelines for Inference and ML model deployment
  • Solid knowledge of distributed systems, networking, and storage
  • Familiarity with ML training/inference pipelines
  • Background in capacity planning & cost optimization for GPU-heavy environments
Microsoft Corporation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Hpc Operations Engineering Manager

8 matching positions

Principal Supercomputing Operations Engineering Manager

Microsoft Azure’s Artificial Intelligence and High Performance Computing (AI/HPC...
Location
Location
United States , Multiple Locations
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Own and drive the end to end operational strategy for InfiniBand and GPU interconnect fabric reliability across large scale AI supercomputing environments, ensuring sustained GPU availability, training stability, and SLA compliance
  • Lead, manage, and grow a team of senior and principal engineers responsible for fabric operations, setting clear expectations, developing talent, and holding the organization accountable for outcomes
  • Provide senior technical leadership and executive decision making during high severity fabric incidents, guiding investigation strategy, escalation paths, and risk trade offs while ensuring effective execution through the team
  • Ensure consistent, high quality incident response, root cause analysis, and post incident follow through across the organization, with a strong emphasis on systemic prevention over one off fixes
  • Drive operational excellence by defining reliability models, failure domains, and long term corrective strategies, and ensuring adoption of authoritative TSGs, playbooks, and escalation frameworks
  • Partner deeply with platform, hardware, firmware, and service teams to align roadmaps, influence design decisions, and close systemic reliability gaps impacting interconnect fabrics at scale
  • Sponsor and prioritize automation, telemetry, diagnostics, and tooling investments that improve detection, observability, debuggability, and time to mitigation across the fleet
  • Fulltime
Read More
Arrow Right

Principal Software Engineering Manager - AI Frameworks

As a Principal Software Engineering Manager - AI Frameworks on the team, you wil...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 304200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Master’s Degree in Computer Science or related technical field AND 10+ years of software engineering experience, including 6+ years in engineering management, OR Bachelor’s Degree in Computer Science or related technical field AND 12+ years of software engineering experience, including 6+ years in engineering management, or equivalent experience
  • Strong technical foundation in software engineering principles, computer architecture, GPU architecture, and hardware acceleration for neural networks, with the ability to guide teams working in these areas
  • Experience leading teams responsible for end-to-end performance analysis and optimization of LLMs, AI systems, or HPC workloads, including use of GPU profiling and performance analysis tools
  • Demonstrated ability to lead cross-team initiatives, align stakeholders, and translate research or platform capabilities into scalable, production-ready solutions
  • Proven people leadership skills, including hiring, coaching, performance management, and career development, with a track record of building high-performing, inclusive teams
  • Exposure to AI / ML infrastructure, including DNN or LLM training and/or inference systems, and experience with at least one modern deep learning framework (e.g., PyTorch, TensorFlow, ONNX Runtime)
  • Familiarity with GPU software stacks and acceleration technologies such as CUDA, ROCm, Triton, or equivalent, sufficient to guide technical direction and evaluate tradeoffs
Job Responsibility
Job Responsibility
  • Lead and develop a team of engineers working across multiple layers of the AI software stack to enable large-scale training and inference
  • Set technical vision and execution strategy for model performance benchmarking, optimization, and deployment across GPUs and Microsoft hardware
  • Drive performance outcomes by prioritizing and overseeing efforts to benchmark, profile, debug, and optimize training and inference workloads
  • Own performance health by establishing mechanisms to monitor regressions, measure impact, and continuously improve time-to-deploy and hardware efficiency
  • Partner cross-functionally with research, product, infrastructure, and hardware teams to deliver scalable, production-ready AI performance improvements
  • Balance short-term delivery and long-term investments, ensuring the team’s work aligns with organizational goals, platform roadmaps, and Azure capex objectives
  • Build a strong engineering culture through coaching, feedback, hiring, and career development, enabling the team to operate with increasing autonomy and impact
  • Fulltime
Read More
Arrow Right

Senior Principal Engineering Manager

Microsoft Research (MSR) is working to transform the future of artificial intell...
Location
Location
United States , Redmond
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 5+ years of people management experience leading software engineering teams, including managing principal engineers
  • Experience building or operating infrastructure for large-scale distributed systems, cloud platforms, or artificial intelligence (AI)/machine learning(ML) workloads
  • Track record of driving execution on complex, multi-workstream infrastructure projects with clear milestones and accountability
  • Technical fluency in one or more of: large-scale compute clusters, GPU infrastructure, scheduling and orchestration (Kubernetes, Volcano), or High-Performance Compute (HPC) environments
  • Experience with GPU programming (CUDA, NCCL) and frameworks such as PyTorch
  • Expertise in networking (InfiniBand, NVLink), storage systems, or distributed training parallelisms
  • A track record of strong cross-functional partnerships, including the ability to align on strategic direction, deliver joint accountabilities, and develop relationships with staff members with widely varied expertise
  • Experience scaling engineering teams through significant growth phases (hiring, onboarding, and integrating new engineers into a high-performing team)
  • Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Job Responsibility
Job Responsibility
  • Lead, mentor, and grow the engineering team that builds MSR’s AI research infrastructure
  • Recruit and develop exceptional engineering talent, building a diverse team - including hiring, onboarding, career development, and performance management
  • Drive execution across the team by setting clear goals, tracking milestones, managing dependencies, and ensuring accountability for delivering complex infrastructure projects on time and at high quality
  • Lead team culture and process changes, cultivating an AI-first mentality that accelerates our progress through agentic coding, automation, and skills development
  • Provide technical vision and judgment on the team's architecture, strategy, and roadmap — spanning supercomputer GPU clusters, high performance networking, workload optimization, researcher tools, and agentic workflows — while empowering engineers to own deep technical details
  • Collaborate closely cross-discipline with engineers, program managers, and research and science teams to align priorities, resolve dependencies, and build better solutions together
  • Foster a team culture of operational excellence, continuous improvement, and high psychological safety where engineers are empowered to take ownership and innovate
  • Fulltime
Read More
Arrow Right

Storage Engineering Manager

We are seeking a seasoned Storage Engineering Manager with experience in the spe...
Location
Location
United States , San Jose; San Francisco; Bellevue
Salary
Salary:
297000.00 - 495000.00 USD / Year
lambda.ai Logo
Lambda
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in storage engineering with at least 5+ years in a management or lead role
  • Demonstrated experience leading a team of storage engineers and storage SREs on complex, cross-functional projects in a fast-paced startup environment
  • Extensive hands-on experience in designing, deploying, and maintaining distributed storage solutions in a CSP (Cloud Service Provider), NCP (Neo-Cloud provider), HPC-infrastructure integrator, or AI-infrastructure company
  • Experience with storage solutions serving storage volumes at a scale greater than 20PB
  • Strong project management skills, leading high-confidence planning, project execution, and delivery of team outcomes on schedule
  • Extensive experience with storage site reliability engineering
  • Experience with one or more of the following in an HPC or AI Infrastructure environment: Vast, DDN, Pure Storage, NetApp, Weka
  • Experience deploying CEPH at scale greater than 25PB
  • Experience in serving one or more of the following storage protocols: object storage (e.g., S3), block storage (e.g., iSCSI), or file storage (e.g., NFS, SMB, Lustre)
  • Professional individual contributor experience as a storage engineer or storage SRE
Job Responsibility
Job Responsibility
  • Grow/Hire, lead, and mentor a top-talent team of high-performing storage engineers delivering HPC, petabyte-scale storage solutions
  • Foster a high-velocity culture of innovation, technical excellence, and collaboration
  • Conduct regular one-on-one meetings, provide constructive feedback, and support career development for team members
  • Drive outcomes by managing project priorities, deadlines, and deliverables using Agile methodologies
  • Drive the technical vision and strategy for Lambda distributed storage solutions
  • Lead storage vendor selection criteria, vendor selection, and vendor relationship management (support, installation, scheduling, specification, procurement)
  • Manage team in storage lifecycle management (installation, cabling, capacity upgrades, service, RMA, updating both hardware and software components as needed)
  • Guide choices around optimization of storage pools, sharding, and tiering/caching strategies
  • Lead team in tasks related to multi-tenant security, tenant provisioning, metering integration, storage protocol interconnection, and customer data-migration
  • Guide Storage SREs in development of scripting and automation tools for configuration management, monitoring, and operational tasks
What we offer
What we offer
  • Generous cash & equity compensation
  • Health, dental, and vision coverage for you and your dependents
  • Wellness and commuter stipends for select roles
  • 401k Plan with 2% company match (USA employees)
  • Flexible paid time off plan that we all actually use
  • Fulltime
Read More
Arrow Right

Power & Cooling Product Manager - HPC & AI Group

This role has been designed as ‘’Onsite’ with an expectation that you will prima...
Location
Location
United States of America , Spring
Salary
Salary:
120500.00 - 276500.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree or equivalent in computer science, engineering or related field of study
  • MBA or advanced degree in computer science or engineering preferred
  • 8+ years of work experience in related field
  • Technical understanding and knowledge of the HPC & AI Server Market
  • Expert team skills and ability to cross functionally drive/influence work through others, ability to mentor and lead teams to achieve results for complex, ambiguous projects
  • Expert skills in cost efficient solution building, financial performance metric creation and analysis
  • Expert business acumen and knowledge of root cause analysis and problem detection
  • Presentation skills and the ability to articulate complex concepts to cross functional audiences and provide product specific technical training to the team
  • Ability to juggle multiple priorities and make things happen in a fast-paced, dynamic environment, bias for action
  • Technical understanding and knowledge of AI/ML and HPC industry
Job Responsibility
Job Responsibility
  • Leads and drives the end-to-end strategy and operational product roadmap for one or more products
  • Defines the value proposition, target customer segments, and business case to bring one or more innovative and disruptive products to market with respect to the whole company product portfolio (i.e. Product configuration mix, Revenue/Margins, financials, market share)
  • Synthesizes market requirements (MRD) into marketing/customer details through having intimate customer knowledge and business, financial and industry market acumen
  • Advises key stakeholders on the portfolio strategy across all phases of the lifecycle (e.g., planning, development, launch, management, exit)
  • Creates and drives goal alignment and collaborates across one or more products' value chain partners to optimize margins and enable success of products per plans across the product lifecycle. (ie. Engineering: product development, Supply Chain: SKUs, inventory and Marketing: marketing and pricing strategies and Go to Market Plan)
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

HPC Application Manager

Join a mission-focused team supporting the Department of Defense High Performanc...
Location
Location
United States , Wright-Patterson AFB
Salary
Salary:
Not provided
ctp-web.com Logo
Columbia Technology Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Active DoD 8570 IAT Level II certification with a Bachelor's degree and 2+ years of relevant experience (or equivalent experience in an HPC or Linux environment)
  • Hands-on experience managing and supporting applications in a Linux/UNIX command-line environment, including shell scripting
  • Strong troubleshooting skills across software installation and runtime issues (e.g., dependencies, environment variables, OS-level conflicts)
  • Experience delivering user support through a ticketing system (e.g., ServiceNow) in a technical environment
  • Familiarity with HPC tools and ecosystems (e.g., SLURM/PBS, InfiniBand, GPU computing, or scientific applications like MATLAB)
  • Detail-oriented, team-focused professional with strong problem-solving skills and the ability to quickly learn and support new technologies
  • U.S. Citizenship is required for all applicants
  • DOD 8570 Certification
  • This position requires an active Security Clearance with appropriate Polygraph
Job Responsibility
Job Responsibility
  • Install, configure, maintain, and optimize complex software packages across Linux-based HPC systems
  • Provide responsive technical support by managing and resolving user requests through a ticketing system (e.g., ServiceNow)
  • Diagnose and resolve complex application issues, including OS-level challenges such as library dependencies, environment variables, and driver conflicts
  • Validate software functionality during system updates, OS upgrades, and new deployments to ensure seamless user experience
  • Apply patches and updates to address bugs, improve performance, and remediate security vulnerabilities
  • Execute all tasks in alignment with established Standard Operating Procedures (SOPs), including formal change management processes (RFCs)
  • Partner with internal engineering teams and external vendors to resolve advanced technical issues and improve application performance
What we offer
What we offer
  • Medical: CTP offers 3 superior plans, bringing our employees both in-network and out-of-network options
  • Vision + Dental: Both free to you + paid in full by CTP
  • Retirement: 401k - 6% company contribution
  • PTO + Leave: A work life balance is extremely important to our team here at CTP, which is why our paid time off plans are so lucrative. Offering customizable leave plans to meet your needs is just one of our many perks! Jury Duty, Bereavement + Military Leave provided
  • Career Growth: Up to $10,000 provided for approved career-related learning, training, education, and/or tuition
  • Life and AD&D Insurance/Short-Term & Long-Term Disability: More peace of mind, at zero cost to you
  • Profit Sharing Bonus: End of year cash gets added to your bottom-line
  • Referral Bonus Program: Our tiered program provides an incentive with each stage of the hiring process your referral passes. Our bonuses range from $7,000-$20,000, if your referral joins the team
  • Fulltime
Read More
Arrow Right

Senior Manager IT Storage Engineering

Lead the strategy, architecture, and delivery of enterprise storage and data pro...
Location
Location
United States , San Jose
Salary
Salary:
180400.00 - 270600.00 USD / Year
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Leadership and people management skills
  • Ability to mentor and grow high-performing teams
  • Communication skills, ability to translate complex technical concepts into business outcomes
  • Collaborative mindset with strong stakeholder management across Engineering, IT, Security, and Compliance
  • Strategic thinking with a balance of innovation and pragmatic execution
  • Problem-solving orientation with a focus on continuous improvement and operational excellence
  • Customer-focused approach with an emphasis on user experience and service reliability
  • Experience in enterprise storage and data protection (file, block, object)
  • Engineering team management experience
  • Proven expertise in high-performance storage solutions for EDA, HPC, AI/ML workloads
Job Responsibility
Job Responsibility
  • Own and evolve the storage platform roadmap, balancing EDA performance requirements with enterprise resilience, compliance, and cost goals
  • Define and govern reference architectures across file, block, object storage, and data protection (on-prem and cloud)
  • Lead storage design reviews for EDA workflows, including metadata-intensive and high IOPS/low latency workloads (build/test/simulation/regression flows)
  • Establish standard patterns for tiering, archiving, retention, immutability (WORM), and disaster recovery (RPO/RTO, replication, failover)
  • Design solutions supporting AI workloads (including >5TB/s training throughput)
  • Ensure storage segmentation and isolation aligned with performance and security requirements
  • Align all architectures with security, encryption, RBAC, audit logging, and data governance standards
  • Own end-to-end storage and backup service delivery (availability, performance, capacity, recoverability, user experience)
  • Lead major incident management, root cause analysis, and corrective/preventive actions
  • Define and track SLAs/SLOs (latency, throughput, backup success, restore times, replication health)
What we offer
What we offer
  • Benefits offered are described: AMD benefits at a glance
  • Fulltime
Read More
Arrow Right

Hpc Catalog Application Manager

The HPC Catalog Application Manager is responsible for the end-to-end ownership ...
Location
Location
France , Les Clayes-sous-Bois
Salary
Salary:
Not provided
eviden.com Logo
Eviden
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Software Engineering, Information Systems, or related field OR equivalent professional experience (8+ years in software development)
  • Python (Expert level)
  • SQL (Advanced)
  • Bash scripting for automation
  • Containerization: Docker, docker-compose
  • Web Services: REST API design and implementation
  • Databases: PostgreSQL (primary), experience with other SQL databases
  • Authentication: OAuth2, JWT, Keycloak/SSO integration
  • Version Control: Git, GitHub workflows
  • Reverse Proxy: Traefik or similar (nginx, Apache)
Job Responsibility
Job Responsibility
  • Application Development & Maintenance (40%): Backend Development
  • Frontend Development
  • Data Management
  • Production Deployment & DevOps (30%): Infrastructure Management
  • Deployment Operations
  • CI/CD & Automation
  • Project & Documentation Management (20%): JIRA Management
  • Confluence Documentation
  • Support & Collaboration (10%): Interface with users
  • Management of 2 trainees
Read More
Arrow Right