CrawlJobs Logo

Software Engineer, Inference – AMD GPU Enablement

openai.com Logo

OpenAI

Location Icon

Location:
United States , San Francisco

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

295000.00 - 555000.00 USD / Year

Job Description:

We’re hiring engineers to scale and optimize OpenAI’s inference infrastructure across emerging GPU platforms. You’ll work across the stack - from low-level kernel performance to high-level distributed execution - and collaborate closely with research, infra, and performance teams to ensure our largest models run smoothly on new hardware. This is a high-impact opportunity to shape OpenAI’s multi-platform inference capabilities from the ground up with a particular focus on advancing inference performance on AMD accelerators.

Job Responsibility:

  • Own bring-up, correctness and performance of the OpenAI inference stack on AMD hardware
  • Integrate internal model-serving infrastructure (e.g., vLLM, Triton) into a variety of GPU-backed systems
  • Debug and optimize distributed inference workloads across memory, network, and compute layers
  • Validate correctness, performance, and scalability of model execution on large GPU clusters
  • Collaborate with partner teams to design and optimize high-performance GPU kernels for accelerators using HIP, Triton, or other performance-focused frameworks
  • Collaborate with partner teams to build, integrate and tune collective communication libraries (e.g., RCCL) used to parallelize model execution across many GPUs

Requirements:

  • Experience writing or porting GPU kernels using HIP, CUDA, or Triton
  • Familiarity with communication libraries like NCCL/RCCL
  • Experience working on distributed inference systems
  • Ability to solve end-to-end performance challenges across hardware, system libraries, and orchestration layers
  • Ability to thrive in a small, fast-moving team building new infrastructure from first principles

Nice to have:

  • Contributions to open-source libraries like RCCL, Triton, or vLLM
  • Experience with GPU performance tools (Nsight, rocprof, perf) and memory/comms profiling
  • Prior experience deploying inference on other non-NVIDIA GPU environments
  • Knowledge of model/tensor parallelism, mixed precision, and serving 10B+ parameter models
What we offer:
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends

Additional Information:

Job Posted:
February 21, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer, Inference – AMD GPU Enablement

New

Software Engineer II and Senior Software Engineer - Performance

The Artificial Intelligence Performance team at Microsoft develops AI software t...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs
  • Measure, benchmark performance on Nvidia/AMD GPUs and first party Microsoft silicon
  • Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level to improve customer experience and reduce the footprint of the computing fleet
  • Enable fast time to market of LLMs/models and their deployments at scale by building SW tools that afford velocity in porting models on new Nvidia and AMD GPUs
  • Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Communicate and collaborate with our partners both internal and external
  • Embody Microsoft's Culture and Values
  • Fulltime
Read More
Arrow Right
New

Security Engineer, Privacy

As Ramp’s founding Privacy engineer, you will build a privacy program that power...
Location
Location
United States , New York, NY (HQ), San Francisco, CA
Salary
Salary:
184800.00 - 374900.00 USD / Year
ramp.com Logo
Ramp
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 4 years of experience building software
  • Minimum of 2 years of experienced focused on platform, privacy, and/or security
  • Desire to work in a fast-paced environment, continuously grow, and master your craft
  • Ability to turn business and product ideas into engineering solutions
Job Responsibility
Job Responsibility
  • Build privacy-focused application primitives and integrate them into our existing products
  • Partner with other engineering teams to design and deploy solutions which are inherently privacy-centric and secure
  • Improve, implement, and deploy data retention and anonymization strategies across our environment
  • Track shifting legal standards (alongside with Ramp’s Privacy Counsel) and update Ramp systems and processes to match
What we offer
What we offer
  • 100% medical, dental & vision insurance coverage for you
  • Partially covered for your dependents
  • One Medical annual membership
  • 401k (including employer match on contributions made while employed by Ramp)
  • Flexible PTO
  • Fertility HRA (up to $10,000 per year)
  • Parental Leave
  • Unlimited AI token usage
  • Pet insurance
  • Centralized home-office equipment ordering for all employees
  • Fulltime
Read More
Arrow Right
New

Customer Success Manager

At Alleviate Health we’re building AI Agents that drastically accelerate clinica...
Location
Location
United States , San Francisco
Salary
Salary:
Not provided
Alleviate Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of experience in a Success, Account Management, Consulting, Investment Banking, or BizOps
  • Able to effectively multitask across multiple accounts while knowing when to dive deep into specific customer needs, maintaining the right balance to deliver both scalable and personalized success
  • You thrive in an unstructured start-up environment (lack of process does not frustrate you)
  • You’re comfortable selling into messy, operational environments and can talk with both executive leadership and front-line clinical staff
  • Proven experience leading complex, cross-functional projects and distilling intricate details into clear, actionable requirements for both technical and non-technical teams
Job Responsibility
Job Responsibility
  • Owning the end-to-end customer relationship — from implementation through renewal and expansion — ensuring fast time-to-value and durable outcomes across customers
  • Lead onboarding and training with a clear, outcome-driven strategy that drives adoption and aligns Alleviate to customer goals
  • Collaborate with Product and Engineering to translate customer insights into roadmap priorities and shape future platform improvements
  • Building trusted relationships: Develop and nurture relationships with the customer stakeholders (both execs and clinicians)
  • Fulltime
Read More
Arrow Right
New

Car Delivery Driver

As a Car Delivery Driver, you’ll be the face of Domino’s in your local community...
Location
Location
United Kingdom
Salary
Salary:
Not provided
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Full, valid UK or International driving licence
  • Own a reliable, roadworthy car with valid MOT, tax, and insurance
  • Smartphone for delivery app use
  • Good knowledge of the local area
  • Friendly, reliable, and able to work independently
  • Able to work flexible hours, including evenings and weekends
Job Responsibility
Job Responsibility
  • Deliver pizzas and menu items to customers promptly and safely
  • Provide excellent customer service at every doorstep
  • Operate your vehicle in accordance with road safety regulations
  • Use the Domino’s Delivery App on your smartphone to manage orders
  • Support the in-store team during quieter delivery periods (e.g. cleaning, restocking, folding boxes)
  • Represent Domino’s positively in the community
What we offer
What we offer
  • Competitive hourly pay + per-delivery payment + tips
  • 28 days paid holiday per year (includes BH, pro rata for part time)
  • Flexible working hours to suit your lifestyle
  • Staff discount on our delicious food
  • Occasional Business Use insurance provided whilst out driving (store can provide more details)
  • Staff meals (conditions apply)
  • Company pension scheme (where eligible)
  • Family Leave policies in place
  • Paid training and clear career progression pathway with linked pay increases
  • Supportive, inclusive, and fun team environment
Read More
Arrow Right
New

Project Manager - Compliance Operations

This is a high-visibility, standalone delivery role reporting into the Head of C...
Location
Location
United Kingdom , London
Salary
Salary:
80000.00 - 100000.00 GBP / Year
apollo-solutions.com Logo
Apollo Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A background in business analysis within a regulated environment, now operating as a project manager
  • Experience within the UK regulatory landscape (including familiarity with frameworks such as MiFID and SMCR)
  • Strong hands-on project delivery experience (formal qualifications such as PRINCE2 advantageous but not essential)
  • Exposure to both larger institutions and more agile environments
  • An individual who combines strong project delivery capability with commercial awareness and adaptability
  • An understanding of how regulation influences operating model design and change delivery
Job Responsibility
Job Responsibility
  • End-to-end delivery of compliance transformation and optimisation projects
  • Enhancing management information, data capture, and reporting consistency
  • Supporting business acquisitions and assessing operating model impacts
  • Identifying risks, managing issues, and implementing mitigation plans
  • Proactively identifying opportunities for process and control improvements
  • Engaging and influencing senior stakeholders across multiple jurisdictions
  • Fulltime
Read More
Arrow Right
New

Software Engineer, FedRAMP Infrastructure

This role is a cross-functional position within the Infrastructure organization,...
Location
Location
United States , Washington, D.C.
Salary
Salary:
265600.00 - 365200.00 USD / Year
ramp.com Logo
Ramp
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 6 years of experience shipping high-quality architectures for critical systems preferred
  • Production experience in AWS, GCP, or Azure
  • An ability to think through customer requirements and come up with high-impact ways to quickly solve their problems
  • Expertise in a production deployment of Infrastructure-as-Code i.e. Terraform
  • Proficiency in an object-oriented programing language
  • Proven experience designing and operating cloud infrastructure (AWS) compliant with FedRAMP security standards
  • Expertise implementing secure Infrastructure-as-Code (Terraform) solutions aligned with FedRAMP controls and audits
  • Deep understanding of secure data handling, encryption, logging, and access controls required under FedRAMP guidelines
  • Strong experience building, scaling, and securing database infrastructure and container orchestration systems to meet FedRAMP compliance
Job Responsibility
Job Responsibility
  • Influence the evolution of Ramp’s infrastructure to support our government environments
  • Work across infra domains to contribute to the next generation of Ramp's database, real-time queue, or container orchestration infrastructure, and ensure proposed changes are viable within our secure environments
  • Collaborate across our engineering organization to introduce and scale best practices with cloud-native technologies like Cloudflare, Amazon ALB, Service Discovery, ECS/EKS, Celery, Kafka, Amazon Aurora PostgreSQL, Elasticache Redis, and S3
  • Build abstractions within Terraform to simplify architecture and increase developer velocity and ownership
  • Find solutions to Ramp's toughest scaling, performance, and low-latency problems
  • Participate in an on-call rotation to address critical production events
  • Mentor other engineers and contribute to a high-performing, inclusive engineering culture
What we offer
What we offer
  • 100% medical, dental & vision insurance coverage for you
  • Partially covered for your dependents
  • One Medical annual membership
  • 401k (including employer match on contributions made while employed by Ramp)
  • Flexible PTO
  • Fertility HRA (up to $10,000 per year)
  • Parental Leave
  • Unlimited AI token usage
  • Pet insurance
  • Centralized home-office equipment ordering for all employees
  • Fulltime
Read More
Arrow Right
New

Store Manager in Training

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Pasadena
Salary
Salary:
18.50 - 28.67 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
April 12, 2026
Flip Icon
Requirements
Requirements
  • High School diploma or GED
  • Bachelor's Degree
  • Retail management experience, or experience as a CVS Supervisor
  • Willingness to accept a promotion to Store Manager role at any location in the designated market
  • Ability to transfer to other CVS Pharmacy stores located within the designated market
  • Ability to work a schedule that may vary based on business needs
Job Responsibility
Job Responsibility
  • Communicate well verbally and in writing to support and lead your team
  • Perform customer care duties to provide high levels of service
  • Execute merchandising strategies to support store sales growth
  • Manage the store inventory and assets to maintain profitability
  • Actively engage with your leader in Key Learning Experiences to support you on your path to promotion during the structured program
  • Support your store as management team member and lead in a manner that is consistent with CVS values and policies
  • Engage your colleagues in support of the company's purpose of "helping people on their path to better health."
  • Be willing to accept promotion roles with the market that you work in
What we offer
What we offer
  • Affordable medical plan options
  • 401(k) plan (including matching company contributions)
  • Employee stock purchase plan
  • No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
  • Paid time off
  • Flexible work schedules
  • Family leave
  • Dependent care resources
  • Colleague assistance programs
  • Tuition assistance
  • Fulltime
Read More
Arrow Right
New

Assistant Meetings and Events Manager

Muckross Park Hotel & Spa are currently looking for an enthusiastic and experien...
Location
Location
Ireland , Killarney
Salary
Salary:
Not provided
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 2 years of experience in a supervisory role within a bar or hospitality environment
  • Excellent customer service skills with the ability to build rapport and handle guest requests efficiently
  • Proven ability to manage team effectively, including scheduling, training, and performance reviews
  • Strong organisational skills with a keen eye for detail and accuracy
  • Excellent communication and interpersonal skills
  • Ability to work independently and as part of a team in a fast-paced environment
Job Responsibility
Job Responsibility
  • Assist the C&B Manager in all aspects of departmental operations, including scheduling, staffing, inventory control, and maintaining a clean and hygienic environment
  • Ensure team members are knowledgeable about the beverage menu, daily specials, and provide excellent customer service following all company standards and procedures
  • Oversee bar setup before opening and close down procedures after service
  • Maintain accurate stock levels, handle ordering, and ensure all drinks are prepared according to recipes
  • Manage cash drawers, reconcile takings, and adhere to all cash handling procedures
  • Motivate, train, and develop the bar team, fostering a positive and productive work environment
  • Address guest concerns and complaints promptly and professionally, ensuring their satisfaction
  • Monitor and oversee the weekly running of the M&E department for the Hotel and support C&B Manager
  • Conduct weekly inspections of M&E to ensure all areas are kept in the best condition, and recommends preventive maintenance to the C&B Manager
  • Support C&B Manager in reviewing the M&E service and quality on a regular basis and develop and implement strategies to improve results
What we offer
What we offer
  • Career development and training opportunities within a growing hospitality company
  • Competitive salary
  • Pension and Health Insurance contributions
  • Paid Maternity, Adoptive and Paternity Leave - we recognise the importance of family and provide paid leave for new parents
  • Team members discounts on hotel stays, dining, and amenities
  • iNua discounts
  • Quality Employer 2026
  • Great Places to work 2026
  • Employer Excellence Outstanding Employer 2026
Read More
Arrow Right