CrawlJobs Logo

Product Manager - AI Data Center Infrastructure

India, Bangalore · Job Posted March 04, 2026
Apply Position
Job Link Share

Job Description

Product Manager - AI Data Center Infrastructure. We are seeking a Product Line Manager (PLM) for AI Data Center Infrastructure to define and deliver next-generation data center networking platforms for large-scale GPU clusters. This role is ideal for a visionary, hands-on leader who understands how AI workloads stress networks at scale and can translate that insight into clear product requirements and roadmaps.

Job Responsibility

  • AI Data Center & Fabric Architecture: Define product requirements for AI data center network architectures supporting thousands of GPUs
  • Develop requirements for low-latency Ethernet fabrics using Juniper QFX platforms and Apstra-based automation
  • Enable high-bandwidth GPU and NIC interconnects optimized for large-scale distributed training and inference workloads
  • GPU, NIC & Interconnect Strategy: Lead requirements definition for next-generation GPUs, NICs, and interconnect technologies, staying ahead of industry roadmaps
  • Drive alignment with NVIDIA and AMD ecosystems
  • Ensure interoperability across DAC, AEC, ACC, and optical transceivers between switches and NIC endpoints
  • Define scale-up paths using PCIe, NVLink, NVSwitch, ensuring GPU-to-GPU symmetry, consistency, and bandwidth determinism
  • Switching, Routing & Telemetry: Specify and optimize L2/L3 architectures, including EVPN-VXLAN, Class-E IPv4, and AI-optimized buffer tuning
  • Leverage hardware telemetry, streaming sensors, and analytics for proactive performance assurance
  • Drive automation using Python, Ansible, Apstra, Terraform, and related tools to enforce configuration consistency and compliance
  • Performance Optimization & Troubleshooting: Analyze GPU job performance to identify network hotspots, congestion, packet loss, and microbursts
  • Tune ECN, RDMA/ROCEv2, PFC, and traffic-engineering policies for AI workloads
  • Optimize server-to-switch interactions, including BIOS and firmware alignment, NIC queue and link-training parameters, Cable selection and management (AEC/ACC/optics)
  • Cross-Functional & Ecosystem Collaboration: Partner closely with AI platform teams, GPU system architects, data center operations, and strategic vendors (NVIDIA, AMD, Juniper)
  • Lead and participate in root-cause analysis for Link flaps and training failures, FEC and PCS errors, Thermal or power-related performance degradation
  • Drive lab validation, scale testing, and certification of new optics, NIC firmware, and switch software releases

Requirements

  • 5–10+ years of experience in data center networking, AI infrastructure, or HPC environments
  • Strong hands-on experience with Juniper QFX platforms and JunOS
  • Deep understanding of GPU architectures: NVIDIA: H100/H200, GB200/GB300, NVLink/NVSwitch AMD: MI300/MI400, Pollara NICs, Infinity Fabric
  • Proven expertise in scale-up GPU interconnects and scale-out Ethernet fabrics
  • Strong knowledge of RDMA/ROCEv2, ECN, PFC, and buffer management
  • Familiarity with distributed AI workloads, collective operations (NCCL, RCCL)
  • Hands-on troubleshooting experience with high-speed optics, AEC cables, link training, and NIC firmware
  • Proficiency in automation and scripting (Python, Ansible, Bash, Terraform)

Nice to have

  • Certification: JNCIE, CCIE, (NCP-AII), (NCA-AIIO), (NCP-AIO), (NCP-AIN)
  • Experience with Apstra or other intent-based networking platforms
  • Knowledge of 1.6T optics, 200G PAM4 SerDes, and CPO/LPO architectures
  • Experience supporting liquid-cooled GPU clusters and rack-level power/network design
  • Understanding of data center operations, observability, and SLAs for AI training and inference clusters

What we offer

  • Health & Wellbeing: comprehensive suite of benefits that supports physical, financial and emotional wellbeing
  • Personal & Professional Development: specific programs catered to helping you reach any career goals
  • Unconditional Inclusion: unconditionally inclusive in the way we work and celebrate individual uniqueness

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Product Manager - AI Data Center Infrastructure

8 matching positions

Senior Product Manager - Ai Infrastructure And Solutions

The Senior Product Manager, AI Infrastructure and Solutions owns the system-leve...
Location
Location
United States , Santa Clara
Salary
Salary:
188000.00 - 282000.00 USD / Year
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Senior-level, cross-functional, large enterprise experience in Product Management, Solutions Product Management, Technical Product Management, Systems Engineering, or related roles in: Data center infrastructure
  • AI/ML platforms
  • HPC systems
  • Enterprise solutions
  • Integrated hardware + software products
  • Strong working knowledge of several of the following: Platform/system architecture (power/thermals, topology, I/O, networking, memory, RAS)
  • Firmware/driver and software stack dependencies
  • Benchmarking methodology and reproducibility
  • Demonstrated experience defining and launching system-level solutions requiring coordination across hardware, firmware, drivers, software frameworks, and partner ecosystems
  • Excellent communications, collaboration, and relationship building across functions and organizations, including experience presenting to executives
Job Responsibility
Job Responsibility
  • Own system-level product definition (HW + SW)
  • Author and maintain System Requirements Specifications (SRS) for solutions spanning hardware platform, firmware/driver, software stack, compatibility, manageability, and lifecycle expectations
  • Define assumptions, constraints, non-goals, and acceptance criteria
  • Translate customer/segment needs into prioritized requirements
  • Consolidate and normalize customer, Sales, OEM/ODM partner, and internal stakeholder inputs into a structured, prioritized requirements backlog with decision rationale
  • Ensure requirements are workload-grounded and aligned to segment outcomes
  • Lead cross-functional dependency and integration planning
  • Identify dependencies across silicon/platform, firmware/drivers, ROCm/software stack, frameworks, OEM systems, and cloud images
  • Surface integration risks early, drive tradeoff discussions, and maintain decision logs
  • Set performance targets and benchmarking expectations (with TME/Eng)
What we offer
What we offer
  • Benefits offered are described: AMD benefits at a glance
  • Fulltime
Read More
Arrow Right

Senior Product Architect – AI Data Center & SONiC Networking

Senior Product Architect – AI Data Center & SONiC Networking. This role has been...
Location
Location
United States , San Jose
Salary
Salary:
172000.00 - 349000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10 plus years of experience in data center networking, AI infrastructure, or high-performance systems
  • Deep expertise in: SONiC architecture and internals
  • Large-scale Ethernet fabrics
  • High-speed SerDes (112G/224G PAM4) and their impact on system performance
  • Strong understanding of ASIC pipelines, buffering, ECMP behavior, and congestion mechanisms
  • Proven ability to diagnose cross-layer performance and reliability issues involving software, hardware, and physical-layer interactions
  • Hands-on experience with RDMA/RoCE, congestion control, and lossless Ethernet at scale
  • Experience with automation and tooling (Python, Ansible, Terraform) in large-scale environments
  • Industry certifications (e.g., CCIE, JNCIE, NVIDIA) or equivalent practical experience preferred
Job Responsibility
Job Responsibility
  • Architect ultra-low-latency, lossless Ethernet fabrics supporting tens of thousands of GPUs for AI training and inference
  • Own the end-to-end SONiC platform architecture and fabric strategy, spanning control plane, management plane, data-plane integration, and operations at scale
  • Define multi-generation fabric and platform strategy across switch ASICs, NICs, SerDes capabilities, cabling, and system constraints, aligned to power, performance, and deployment realities
  • Own link-level and physical-layer requirements as they impact SONiC performance, including high-speed PAM4 signaling (112G/224G), error handling, and hardware/software interaction
  • Align SONiC architectures with next-generation GPU, NIC, and switch platforms, ensuring optimal performance across hardware and software boundaries
  • Define SONiC capabilities for AI and HPC workloads, including: Lossless Ethernet and RoCE
  • Congestion management, QoS, and ECN
  • Dynamic and flow-based load balancing
  • Drive scale, performance, and resiliency targets for SONiC-based fabrics, including fast convergence, hitless upgrades, and failure recovery
  • Define and enforce system-level validation criteria, including scale testing, fault injection, performance benchmarking, and upgrade scenarios
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Data Center Cooling Infrastructure Manager

The Datacenter Cooling Infrastructure Manager is responsible for developing new ...
Location
Location
United States , Richmond
Salary
Salary:
90000.00 - 110000.00 USD / Year
alfalaval.com Logo
Alfa Laval
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Engineering or related field
  • Minimum 3 years of experience in technical sales, applications engineering, or data center infrastructure
  • Working knowledge of liquid cooling technologies, heat transfer principles, and fluid systems
  • Familiarity with data center standards and terminology (PUE, WUE, AHRI, OCP, ASHRAE, etc.)
  • Strong communication skills with ability to explain complex technical concepts to non-technical stakeholders
  • Technical problem-solving and system-level thinking
  • Customer-focused mindset with strong commercial awareness
  • Strong ability to develop the offer utilizing a value-based solution
  • Ability to manage multiple opportunities simultaneously
  • Proficiency with CRM systems, quotation tools, and technical documentation
Job Responsibility
Job Responsibility
  • Analyze trends such as AI workloads, liquid cooling adoption, and hyperscale expansions
  • Track key players like AWS, Microsoft, Equinix, QTS, Sabey, Digital Realty Vantage and more
  • Identify growth opportunities across colocation and hyperscalers
  • Represent the company in industry forums (e.g., data center conferences, OCP, DCW, etc)
  • Act as a subject matter expert for key accounts and engage early at concept and design phase
  • Build relationships with hyperscalers, colocation providers, system integrators, EPC firms and mechanical contractors
  • Drive pipeline growth for infrastructure solutions (e.g., heat exchangers, CDUs, CCDUs, CUPs)
  • Influence specifications early in the design phase
  • Support large, multi-year framework agreements
  • Translate customer requirements into optimal solutions
What we offer
What we offer
  • Competitive salary
  • Medical/dental/vision/life insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Sr. Data Center Solutions Product Manager

The Sr. Data Center Solutions Product Manager owns the system-level product defi...
Location
Location
United States , Santa Clara
Salary
Salary:
173840.00 - 260760.00 USD / Year
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Senior level, cross functional, large enterprise experience in Product Management, Solutions Product Management, Technical Product Management, Systems Engineering, or related roles in: Data center infrastructure
  • AI/ML platforms
  • HPC systems
  • Enterprise solutions
  • Integrated hardware + software products
  • Strong working knowledge of several of the following: Platform/system architecture (power/thermals, topology, I/O, networking, memory, RAS)
  • Firmware/driver and software stack dependencies
  • Benchmarking methodology and reproducibility
  • Demonstrated experience defining and launching system-level solutions requiring coordination across hardware, firmware, drivers, software frameworks, and partner ecosystems
  • Bachelor degree in Engineering, Computer Science, Computer Engineering, Electrical Engineering, or related technical field strongly desired
Job Responsibility
Job Responsibility
  • Own system-level product definition (HW + SW)
  • Author and maintain System Requirements Specifications (SRS) for solutions spanning hardware platform, firmware/driver, software stack, compatibility, manageability, and lifecycle expectations
  • Define assumptions, constraints, non-goals, and acceptance criteria
  • Translate customer/segment needs into prioritized requirements
  • Consolidate and normalize customer, Sales, OEM/ODM partner, and internal stakeholder inputs into a structured, prioritized requirements backlog with decision rationale
  • Ensure requirements are workload-grounded and aligned to segment outcomes
  • Lead cross-functional dependency and integration planning
  • Identify dependencies across silicon/platform, firmware/drivers, ROCm/software stack, frameworks, OEM systems, and cloud images
  • Surface integration risks early, drive tradeoff discussions, and maintain decision logs
  • Set performance targets and benchmarking expectations (with TME/Eng)
  • Fulltime
Read More
Arrow Right

Senior Product Manager for Data Center AIOps

Senior Product Manager for Data Center AIOps. HPE is seeking an experienced Seni...
Location
Location
United States , Sunnyvale
Salary
Salary:
136500.00 - 276500.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science / Engineering, or equivalent practical experience in data center networking or cloud infrastructure
  • 6+ years of product management or closely related experience in data center networking, network operations, observability, or AIOps/AI-driven infrastructure products
  • Understanding of data center network architectures (leaf-spine and EVPN-VXLAN), intent-based networking, and operational workflows across Day 0 through Day 2+
  • Demonstrated ability to translate complex technical capabilities into clear customer value, business cases, and prioritized roadmaps in a fast-paced environment
  • Excellent communication and stakeholder management skills with a track record of driving alignment across engineering, sales, marketing, and support
  • Understanding of network operations, SRE, or managing large-scale data center or private cloud environments, including troubleshooting and incident response
  • Experience in building business cases, pricing, and go-to-market strategies for enterprise software or cloud services
Job Responsibility
Job Responsibility
  • Influence the product vision and roadmap for Data Center AIOps across the HPE Networking portfolio, aligning with HPE’s AI-native networking strategy and broader data center portfolio
  • Define requirements and user journeys for capabilities such as cross-domain visibility, application awareness, anomaly detection, root cause analysis, impact analysis, and proactive assurance
  • Collaborate closely with engineering, data science, UX, and architecture teams to deliver cloud-hosted AIOps services integrated with Apstra’s intent-based networking and telemetry
  • Partner with GTM, sales, and marketing to craft positioning, packaging, and licensing for AIOps-driven features, including premium and value-added services for data center customers
  • Engage deeply with customers, partners, and field teams to gather feedback, validate hypotheses, and translate operational pain points into prioritized backlog items for AIOps
  • Define and track success metrics for AI and analytics features (e.g., MTTR reduction, automation adoption, model accuracy, recommendation utilization) and iterate based on real-world outcomes
  • Represent the product in customer briefings, business reviews, industry events, and analyst conversations as the subject matter expert for HPE’s Data Center AIOps strategy
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Manager, Data Center Network Deployment & Support

Meta is hiring a Data Center Network Deployment & Support Manager to lead the de...
Location
Location
United States , Aiken
Salary
Salary:
162000.00 - 227000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in network engineering in large-scale data center network deployment, including hands-on responsibility for planning, building, or migrating production networks
  • 3+ years of direct people management experience leading network engineers responsible for Data Center network deployment and operations
  • Bachelor's degree in Computer Engineering, Math, Physics, Networking, or a related technical field (or equivalent practical experience)
  • Hands-on experience with Data Center switching, routing, and dedicated network topologies (“AI Zones”) for backend GPU communication
  • Proven experience leading and executing network deployment and migration projects
  • A proven track record in partnering with cross-functional teams and directly managing large-scale projects
  • Technical expertise in data center, enterprise, or service provider network infrastructure
  • Communication, stakeholder management, and problem-solving skills
  • Knowledge of data center design and operational best practices
  • Experience with process improvement and systems development, leveraging automation to streamline repetitive workflows
Job Responsibility
Job Responsibility
  • Manage the deployment, configuration, and ongoing support of large-scale network infrastructure across data centers and global regions
  • Act as the escalation point for technical issues, providing hands-on support and guidance to resolve complex problems swiftly
  • Develop and maintain relationships with partner teams, vendors, and managed service providers
  • Collaborate with engineering, data center, backbone, AI, and equipment vendors to integrate new technologies and drive innovation
  • Ensure project timelines for network turn-ups and ensure that milestones are met
  • Distribute the deployment workload among team members based on projections, OKRs, and metrics across skill sets and priorities
  • Ensure that standard operating procedures (MOPs, runbooks) are consistently followed
  • Contribute to the standardization and best practices of design, testing, and implementation of scalable network solutions
  • Lead by example and build team chemistry across regions to ensure alignment with organizational priorities
  • Provide mentorship, coaching, and career development to team members
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

Infrastructure Capacity Product Manager (Leadership)

Meta's Infrastructure organization provides the backbone on which the company op...
Location
Location
United States , Menlo Park
Salary
Salary:
249000.00 - 323000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in Product Management and/or Product Design
  • 8+ years of experience hiring, managing, and developing both individual contributors and senior leaders
  • 12+ years of experience working collaboratively with engineering, design and user research teams
  • Critical thinking/analytical leadership experience
  • Experienced in enabling effective east-west/cross org coordination, and global collaboration
  • Experience presenting to senior executive audiences
  • BA/BS in Computer Science or related field
Job Responsibility
Job Responsibility
  • Proactively identify the important problems to solve (e.g. competitively, strategically, for customers, and in support of company goals)
  • Build a coherent strategy and roadmap for addressing these issues with measurable objectives
  • Facilitate the flow of information between everyone involved and create consensus around a vision, priorities and decisions
  • Drive, track, and document progress against roadmaps
  • Define a high standard of quality for product area and hold teams accountable to that bar
  • Make larger org and all of Product Management better by supporting Recruiting initiatives such as interviewing
  • Operate in varying degrees of ambiguity
  • Build a strong bottoms-up culture where teams are able to advocate and pursue robust points of view while at the same time seeking consensus
  • Flexibility to adjust to top line company priority shifts
  • Scope: Responsible for resolving conflict and driving strategic escalations between competing priorities
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Senior Product Manager-Specialized Compute (AI, Edge & Telco)

The Senior Product Manager for HPE Storage Partner Solutions is responsible for ...
Location
Location
United States , Spring, Texas
Salary
Salary:
120500.00 - 276500.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree or equivalent in computer science, engineering or related field of study
  • MBA or advanced degree in computer science, physics, math or engineering preferred
  • Proven experience as a Product Manager in the server, data center, or related hardware industry
  • Strong analytical skills with a knack for translating complex market data into clear, actionable business insights
  • Deep understanding of the technical and market dynamics of at least one of the following: AI servers, Edge computing, or Telco infrastructure
  • Exceptional communication and presentation skills, with the ability to articulate a vision and build consensus with both technical and non-technical audiences
  • A proactive and adaptable mindset, with the ability to manage multiple investigations and projects simultaneously in a fast-paced environment
  • Cross Domain Knowledge
  • Customer Engagement
  • Design Thinking
Job Responsibility
Job Responsibility
  • Investigate New Opportunities: Conduct in-depth market research and competitive analysis to identify emerging trends, customer pain points, and new product opportunities across AI, Edge, and Telco markets
  • Build the Business Case: Develop and present data-driven business cases for new product initiatives, including market sizing, financial projections, and strategic alignment with company goals
  • Scope Out Requirements: Work closely with engineering, sales, and customers to define and prioritize detailed product requirements and user stories, ensuring they are well-documented and understood by all stakeholders
  • Cross-Market Strategy: Navigate the unique technical and business challenges of each market, adapting your approach to meet the diverse needs of AI, Edge, and Telco customers
  • Stakeholder Collaboration: Act as the primary liaison between technical teams and business units, championing the product vision and ensuring alignment across the organization
What we offer
What we offer
  • Health & Wellbeing: comprehensive suite of benefits that supports physical, financial and emotional wellbeing
  • Personal & Professional Development: specific programs catered to helping you reach any career goals
  • Fulltime
Read More
Arrow Right