CrawlJobs Logo
OpenAI Logo OpenAI · IT - Software Development

Software Engineer, Inference – AMD GPU Enablement

United States, San Francisco 295000.00 - 555000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

We’re hiring engineers to scale and optimize OpenAI’s inference infrastructure across emerging GPU platforms. You’ll work across the stack - from low-level kernel performance to high-level distributed execution - and collaborate closely with research, infra, and performance teams to ensure our largest models run smoothly on new hardware. This is a high-impact opportunity to shape OpenAI’s multi-platform inference capabilities from the ground up with a particular focus on advancing inference performance on AMD accelerators.

Job Responsibility

  • Own bring-up, correctness and performance of the OpenAI inference stack on AMD hardware
  • Integrate internal model-serving infrastructure (e.g., vLLM, Triton) into a variety of GPU-backed systems
  • Debug and optimize distributed inference workloads across memory, network, and compute layers
  • Validate correctness, performance, and scalability of model execution on large GPU clusters
  • Collaborate with partner teams to design and optimize high-performance GPU kernels for accelerators using HIP, Triton, or other performance-focused frameworks
  • Collaborate with partner teams to build, integrate and tune collective communication libraries (e.g., RCCL) used to parallelize model execution across many GPUs

Requirements

  • Experience writing or porting GPU kernels using HIP, CUDA, or Triton
  • Familiarity with communication libraries like NCCL/RCCL
  • Experience working on distributed inference systems
  • Ability to solve end-to-end performance challenges across hardware, system libraries, and orchestration layers
  • Ability to thrive in a small, fast-moving team building new infrastructure from first principles

Nice to have

  • Contributions to open-source libraries like RCCL, Triton, or vLLM
  • Experience with GPU performance tools (Nsight, rocprof, perf) and memory/comms profiling
  • Prior experience deploying inference on other non-NVIDIA GPU environments
  • Knowledge of model/tensor parallelism, mixed precision, and serving 10B+ parameter models

What we offer

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends
OpenAI - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer, Inference – AMD GPU Enablement

8 matching positions

Software Engineer II and Senior Software Engineer - Performance

The Artificial Intelligence Performance team at Microsoft develops AI software t...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs
  • Measure, benchmark performance on Nvidia/AMD GPUs and first party Microsoft silicon
  • Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level to improve customer experience and reduce the footprint of the computing fleet
  • Enable fast time to market of LLMs/models and their deployments at scale by building SW tools that afford velocity in porting models on new Nvidia and AMD GPUs
  • Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Communicate and collaborate with our partners both internal and external
  • Embody Microsoft's Culture and Values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Performance

The Artificial Intelligence Performance team at Microsoft develops AI software t...
Location
Location
United States , Mountain View
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs
  • Measure, benchmark performance on Nvidia/AMD GPUs and first party Microsoft silicon
  • Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level to improve customer experience and reduce the footprint of the computing fleet
  • Enable fast time to market of LLMs/models and their deployments at scale by building SW tools that afford velocity in porting models on new Nvidia and AMD GPUs
  • Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Communicate and collaborate with our partners both internal and external
  • Embody Microsoft's Culture and Values
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Performance

The Artificial Intelligence Cloud Inference team at Microsoft develops AI softwa...
Location
Location
United States , Mountain View
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Identify and drive improvements to end-to-end inference performance of OpenAI and other state of the art LLMs
  • Measure, benchmark performance on Nvidia/AMD GPU's and first party Microsoft silicon
  • Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level, help reduce the footprint of the computing fleet and achieve Azure AI capex goals
  • Enable fast time to market of LLMs/models and their deployments at scale by building SW tools that afford velocity in porting models on new Nvidia, AMD GPUs and Maia silicon
  • Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Communicate and collaborate with our partners both internal and external
  • Embody Microsoft's Culture and Values
  • Fulltime
Read More
Arrow Right

AI Model, Framework, and GPU Engineer

We are looking for an experienced Machine Learning Software Engineer who will be...
Location
Location
Germany , Munich
Salary
Salary:
Not provided
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong technical and analytical skills in C/C++/Python AI development in Windows and Linux environment
  • Some knowledge on GPU programming and compiler
  • Capable problem solver
  • Technical leader to define goals and scope and drive development effort
  • Good communication skills
  • Enthusiastic about AI technologies
  • Strongly motivated to enable customers with best feature-rich efficient solutions
  • Strong cross-platform software development experience and deep programming skills in C/C++ and Python
  • Excellent problem-solving and effective communication skills
  • Development experience on CONV, GEMM, and/or non-linear operators
Job Responsibility
Job Responsibility
  • Develop and deliver innovative AI software solutions to AMD customers and users
  • Enable and optimize software stack for standard frameworks like ONNX and PyTorch, as well as new popular Open-Source AI software
  • Bring up new SOTA AI models, analyze and improve their performance
  • Participate and drive end-2-end AI software development from feature scoping, implementation, integration and verification, to customer enablement
Read More
Arrow Right

AI Systems Engineer – AI Model (Training & Inference)

The AMD AI Group is looking for a Senior Software Development Engineer to own th...
Location
Location
Canada , Markham
Salary
Salary:
106400.00 - 159600.00 CAD / Year
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
  • Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline
Job Responsibility
Job Responsibility
  • Enable and optimize large-scale model training (LLMs, VLMs, MoE architectures) on AMD Instinct GPU clusters, ensuring correctness, reproducibility, and competitive throughput.
  • Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.
  • Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).
  • Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.
  • Develop monitoring, alerting, and compliance infrastructure to ensure training cluster health, data security, and SLA adherence at scale.
  • Design and build end-to-end validation and testing infrastructure using proxy workloads, synthetic benchmarks, and configurable workload generators to systematically validate platform readiness across AMD Instinct GPU generations.
  • Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul, GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.
  • Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.
  • Optimize inference serving frameworks (vLLM, SGLang, TorchServe) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.
  • Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.
  • Fulltime
Read More
Arrow Right

Enterprise Territory Executive

AMD is seeking a high-impact Enterprise Territory Executive to drive growth acro...
Location
Location
United States , Texas
Salary
Salary:
224560.00 - 336840.00 USD / Year
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven success selling enterprise technology solutions and consistently exceeding revenue objectives
  • Strong ability to build executive relationships and influence business and technology decision-makers
  • Strategic mindset with a track record of identifying, developing, and closing complex opportunities
  • Passion for emerging technologies including AI, cloud computing, data center modernization, and digital transformation
  • Strong consultative selling skills focused on customer outcomes and business value
  • Collaborative approach with the ability to work effectively across highly matrixed organizations
  • Excellent communication, presentation, and relationship-building skills
  • Willingness and ability to travel approximately 50%
  • Proven success selling Data Center, AI Infrastructure, Enterprise Compute, Cloud, Storage, Networking, or Commercial Client solutions into enterprise organizations
  • Demonstrated ability to consistently exceed sales targets and drive business growth
Job Responsibility
Job Responsibility
  • Develop and execute territory growth strategies that expand AMD's presence across enterprise customers throughout the Central U.S. region
  • Identify, qualify, and close opportunities that drive revenue growth, market share expansion, and long-term customer value
  • Build and maintain a healthy pipeline across Data Center, AI, Cloud, and Commercial Client opportunities
  • Develop territory plans that align customer priorities with AMD's strategic growth objectives
  • Build trusted advisor relationships with CIOs, CTOs, Chief Architects, Infrastructure Leaders, Procurement Organizations, and Line-of-Business stakeholders
  • Understand customer technology roadmaps, business priorities, and modernization initiatives
  • Position AMD solutions as strategic enablers of AI adoption, cloud transformation, infrastructure modernization, and workforce productivity
  • Drive adoption of AMD EPYC™ processors across virtualization, cloud, storage, enterprise applications, and high-performance computing workloads
  • Position AMD Instinct™ accelerators to support AI training, inference, advanced analytics, and emerging enterprise AI initiatives
  • Engage customers on AI infrastructure strategies, GPU acceleration, software ecosystems, and future workload requirements
What we offer
What we offer
  • Benefits offered are described: AMD benefits at a glance.
  • Fulltime
Read More
Arrow Right

Solution Architect – Physical AI

AMD’s Adaptive Embedded Compute Group (AECG) builds products that combine powerf...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experienced Electrical, Computer, or Systems Engineer with deep experience architecting AI‑enabled systems for robotics, automation, autonomous machines, or other safety‑critical / mission‑critical systems
  • Hands‑on experience with AI inference hardware (GPU and NPU) and associated software stacks
  • Experience with robotics application frameworks and system integration
  • Demonstrated ability to break down large, complex problems into manageable deliverables and to manage and prioritize requirements across multiple stakeholders
  • BS, MS, or PhD in Computer Science, Computer Engineering, or Electrical Engineering
Job Responsibility
Job Responsibility
  • Partner with silicon planning and platform architecture teams to help define silicon features and software stacks for next‑generation Physical AI systems
  • Collaborate with market segment architects and business leaders to create customer‑focused Physical AI solutions addressing complex requirements across Aerospace, Automotive, Medical, Robotics, Industrial, and Vision markets
  • Architect heterogeneous AI systems (CPU + GPU + NPU, FPGA)
  • Work closely with software engineering and product planning teams to define all aspects of the Physical AI software stack, including ROCm and Ryzen™ AI software support for iGPUs and NPUs, AMD’s Virtualized Automotive Stack, Robot Operating System (ROS), Multimedia analytics pipelines, AI models, and Vision‑Language Models (VLMs) and Large Language Models (LLMs)
  • Evaluate and communicate system‑level tradeoffs and architectural decisions required to deploy AI in real‑time, deterministic, and safety‑constrained environments
What we offer
What we offer
  • Benefits offered are described: AMD benefits at a glance
  • Fulltime
Read More
Arrow Right

Ai application engineer

WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great prod...
Location
Location
China , Shanghai;Shenzhen;Beijing
Salary
Salary:
Not provided
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Developer enablement with leading open-source communities and AI frameworks, including PyTorch, vLLM, SGLang, Unsloth, PaddlePaddle, Mooncake, TileLang, LangChain, VERL, and LLaMA-Factory, across both training and inference workflows
  • Strong experience with LLMs and Generative AI, including transformer architectures, attention mechanisms, MoE models, and end-to-end AI pipelines
  • Solid understanding of GPU-accelerated computing
  • familiarity with the ROCm AI software stack is strongly preferred
  • Proven ability to collaborate effectively with open-source software communities to drive developer enablement and ecosystem activities
  • Excellent communication and presentation skills, with the ability to clearly articulate architectural proposals, technical trade-offs, and value propositions to diverse stakeholders
  • Bachelor's degree required
  • Master's degree preferred
Job Responsibility
Job Responsibility
  • Capture and prioritize developer and customer requirements to shape AMD's AI software feature planning and solutions roadmap
  • Lead and contribute to collaboration with AI open-source projects, strengthening the developer community and broader ecosystem
  • Partner with internal AI software engineering teams to drive developer enablement through performance optimization, OSS contributions, Discord/GitHub support, AI Academy initiatives, solutions, reference designs, blogs, tutorials, and user guides
  • Work closely with internal AI software teams to ensure the success of AI developers, communities, and customer proof-of-concepts (PoCs)
  • Provide actionable feedback and requirements for AI software across cloud, client, and edge deployments
  • Fulltime
Read More
Arrow Right