CrawlJobs Logo

Senior Researcher - GPU Performance

United States, Redmond 119800.00 - 234700.00 USD / Year · Job Posted January 29, 2026
Apply Position
Job Link Share

Job Description

Generative AI is transforming how people create, collaborate, and communicate - redefining productivity across Microsoft 365 and our customers globally. At Microsoft, we run the biggest platform for collaboration and productivity in the world with hundreds of millions of consumer/enterprise users. Tackling AI efficiency challenges is crucial for delivering these experiences at scale. Within our Microsoft wide Systems Innovation initiative, we are working to advance efficiency across AI systems, where we look at novel designs and optimizations across AI stacks: models, AI frameworks, cloud infrastructure, and hardware. We are an Applied Research team driving mid- and long-term product innovations. We closely collaborate with multiple research teams and product groups across the globe who bring a multitude of technical knowledge in cloud systems, machine learning and software engineering. We communicate our research both internally and externally through academic publications, open-source releases, blog posts, patents, and industry conferences. Further, we also collaborate with academic and industry partners to advance the state of the art and target material product impact that will affect 100s of millions of customers. We are looking for a Senior Researcher - GPU Performance – Hardware/Software Codesign researcher to explore hardware/kernel-level optimizations to deliver significant efficiency gains for Large Language Models and Generative AI experiences.

Job Responsibility

  • Design, implement, and optimize GPU kernels for complex computational workloads such as AI inferencing
  • Research and develop novel optimization techniques for generation of GPU kernels
  • Profile and analyze kernel performance using advanced diagnostic tools
  • Generate automated solutions for kernel optimization and tuning
  • Collaborate with other researchers to improve model performance
  • Document optimization strategies and maintain performance benchmarks
  • Contribute to the development of internal GPU computing frameworks

Requirements

  • Doctorate in relevant field OR equivalent experience
  • 2+ years of experience in GPU architecture, memory hierarchies, parallel computing and algorithm optimization
  • 2+ years of experience in GPU programming, including performance profiling and optimization tools
  • Reliable C++ programming skills
  • Ability to meet Microsoft, customer and/or government security screening requirements

Nice to have

  • 5+ years of experience in GPU programming and optimization, expert knowledge of CUDA, ROCm, Triton, PTX, CUTLASS, or similar GPU programming frameworks
  • Experience with machine learning frameworks (PyTorch, TensorFlow)
  • Familiarity with compiler optimization techniques and background in auto-tuning and automated code generation
  • Publication record in relevant conferences or journals (MLSys, NeurIPS, ICML, ICLR, AISTATS, ACL, EMNLP, NAACL, ISCA, MICRO, ASPLOS, HPCA, SOSP, OSDI, NSDI, etc.)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Researcher - GPU Performance

8 matching positions

Senior Researcher - Efficient AI

Generative AI is transforming how people create, collaborate, and communicate—re...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Doctorate in relevant field OR Master's Degree in relevant field AND 3+ years related research experience OR Bachelor's Degree in relevant field AND 4+ years related research experience OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Demonstrated experience in designing and optimizing efficient inference systems, combining foundations in algorithmic optimization, parallel computing, and request orchestration under strict SLO constraints with deep knowledge of attention and KV‑cache optimizations, batching and scheduling strategies, and cost‑aware deployment
  • 3+ years of experience with machine learning frameworks (e.g., PyTorch, TensorFlow) and inference serving frameworks (e.g., vLLM, Triton Inference Server, TensorRT-LLM, ONNX Runtime, Ray Serve, DeepSpeed-MII)
  • 3+ years of experience in GPU programming and optimization, with expert knowledge of CUDA, ROCm, Triton, PTX, CUTLASS, or similar GPU programming frameworks
  • Proficiency in C++ and Python for high-performance systems, with code quality and profiling/debugging skills
  • Research impact through publications and/or patents, coupled with hands‑on experience taking research ideas through execution and delivery in production
Job Responsibility
Job Responsibility
  • Formulate, develop, and evaluate new algorithmic and system-level approaches for end-to-end AI serving, using analytical modeling and large-scale measurement to study token-level latency, tail latency (p95/p99), throughput-per-dollar, cold-start behavior, warm pool strategies, and capacity planning under multi-tenant SLOs and variable sequence lengths
  • Design and experimentally evaluate endpoint configuration and execution policies, including batching, routing, and scheduling strategies, tensor and pipeline parallelism, quantization and precision profiles, speculative decoding, and chunked or streaming generation, and drive the most promising approaches through robust rollout and validation into production
  • Perform hardware- and kernel-aware optimization by collaborating closely with model, kernel, compiler, and hardware teams to align serving algorithms with attention/KV innovations and accelerator capabilities
  • Build and benchmark experimental prototypes and large-scale measurements to validate research ideas and drive them toward production readiness
  • produce clear technical documentation, design reviews, and operational playbooks
  • Publish research results, file patents, and, where appropriate, contribute to open-source systems and serving frameworks
  • Fulltime
Read More
Arrow Right

Senior Researcher - Efficient AI

Generative AI is transforming how people create, collaborate, and communicate—re...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Doctorate in relevant field
  • OR Master's Degree in relevant field AND 3+ years related research experience
  • OR Bachelor's Degree in relevant field AND 4+ years related research experience
  • OR equivalent experience
  • Demonstrated expertise in areas of algorithmic optimization, parallel computing, queuing and scheduling theory, and practical request orchestration under strict SLO constraints
  • Strong understanding of GPU architecture and memory hierarchies
  • Proficiency in C++ and Python for high-performance systems, with strong code quality and profiling/debugging skills
  • Proven record of research impact through publications and/or patents, and experience carrying ideas through to systems that operate at scale in real production environments
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Formulate, develop, and evaluate new algorithmic and system-level approaches for end-to-end AI serving, using analytical modeling and large-scale measurement to study token-level latency, tail latency (p95/p99), throughput-per-dollar, cold-start behavior, warm pool strategies, and capacity planning under multi-tenant SLOs and variable sequence lengths
  • Design and experimentally evaluate endpoint configuration and execution policies, including batching, routing, and scheduling strategies, tensor and pipeline parallelism, quantization and precision profiles, speculative decoding, and chunked or streaming generation, and drive the most promising approaches through robust rollout and validation into production
  • Perform hardware- and kernel-aware optimization by collaborating closely with model, kernel, compiler, and hardware teams to align serving algorithms with attention/KV innovations and accelerator capabilities
  • Build and benchmark experimental prototypes and large-scale measurements to validate research ideas and drive them toward production readiness
  • produce clear technical documentation, design reviews, and operational playbooks
  • Publish research results, file patents, and, where appropriate, contribute to open-source systems and serving frameworks
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Performance Tooling

The Artificial Intelligence (AI) Frameworks team at Microsoft develops AI softwa...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C++, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. This includes passing the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C++, or Python OR equivalent experience
  • 4+ years’ practical experience working on high performance applications and performance debugging and optimization on CPUs/GPUs
  • Experience in DNN/LLM inference and experience in one or more DL frameworks such as PyTorch, Tensorflow, or ONNX Runtime and familiarity with CUDA, ROCm, Triton
  • Technical background and solid foundation in software engineering principles, computer architecture, GPU architecture, hardware neural net acceleration
  • Experience in end-to-end performance analysis and optimization of state of the art LLMs and HPC applications, including proficiency using GPU profiling tools
  • Cross-team collaboration skills and the desire to collaborate in a team of researchers and developers
  • Ability to independently lead projects
Job Responsibility
Job Responsibility
  • Work across multiple layers of the AI software stack (abstractions, programming models, compilers, runtimes, libraries, and APIs) to enable large-scale model training and inference
  • Benchmark OpenAI and other LLMs for performance on GPUs and Microsoft hardware
  • Debug, profile, and optimize performance for training/inference workloads on Central Processing Units (CPUs)/Graphics Processing Units (GPUs)
  • Monitor performance regressions and drive continuous improvements to reduce time-to-deploy and hardware footprint
  • Collaborate across teams of researchers and engineers to deliver scalable, production-ready AI performance improvements
  • Fulltime
Read More
Arrow Right

Senior Platform Engineer – AV Cloud Engineering

We are hiring a Senior Platform Engineer to join the Autonomous Vehicle (AV) Clo...
Location
Location
United States , Austin;Sunnyvale
Salary
Salary:
170000.00 - 230000.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Fully qualified proficiency in Kubernetes (GKE) and the Google Cloud Platform (GCP) ecosystem, including VPC, IAM, etc.
  • Hands-on experience implementing high-availability systems and managing the lifecycle of production-grade clusters
  • Strong proficiency in software engineering and DevOps principles, specifically using Golang/Python and Terraform
  • Ability to operate independently in an ambiguous environment and translate high-level requirements into clear technical tasks
  • A 'Growth-based Mindset' with a commitment to continuous upskilling and a belief that team capacities are developed through effort and coaching
  • Professional experience managing the trade-offs between hardware-level performance (GPU passthrough) and clean cloud abstractions
  • 5+ years of experience or proven record of defining and executing technical strategy that required coordination across multiple teams, senior executives, and front-line engineers
  • Bachelors Degree in Computer Science or related field OR equivalent work experience
  • Hands-on experience with Kubernetes in production and strong familiarity with at least one major cloud ecosystem such as GCP, AWS, or Azure
  • Strong software engineering skills in Go, Python, or similar languages, with the ability to build reusable automation, services, APIs, or controllers
Job Responsibility
Job Responsibility
  • Build and evolve internal platform capabilities, self-service workflows, APIs, and automation that make the right path the easiest path for AV engineering teams
  • Design clean abstractions that allow product and research teams to consume complex infrastructure, including specialized hardware such as GPUs, without deep infrastructure expertise
  • Improve platform primitives across traffic, service mesh, runtime configuration, and connectivity for distributed AV workloads
  • Reduce toil and improve reliability through reusable platform tooling, declarative automation, strong service ownership, observability, and SLIs/SLOs
  • Take ownership of complex platform initiatives from problem definition through design, implementation, and adoption
  • Partner with adjacent AV infrastructure teams to reduce developer friction and improve the reliability of the platform AV engineers depend on
  • Contribute to a healthy engineering culture through design reviews, code reviews, mentorship, and clear technical communication
What we offer
What we offer
  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • tuition assistance programs
  • Fulltime
Read More
Arrow Right

Distinguished Engineer

As a Distinguished Engineer at Capital One, you will be a part of a community of...
Location
Location
United States , San Jose, California; McLean, Virginia; New York, New York; San Francisco, California
Salary
Salary:
Not provided
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 7 years of experience in Software engineering
Job Responsibility
Job Responsibility
  • Articulate and evangelize a bold technical vision for your domain
  • Decompose complex problems into practical and operational solutions
  • Ensure the quality of technical design and implementation
  • Serve as an authoritative expert on non-functional system characteristics, such as performance, scalability and operability
  • Continue learning and injecting advanced technical knowledge into our community
  • Handle several projects simultaneously, balancing your time to maximize impact
  • Act as a role model and mentor within the tech community, helping to coach and strengthen the technical expertise and know-how of our engineering and product community
  • Design and drive the long-term technical roadmap for our Foundation Model Hosting platform, ensuring high throughput, ultra-low latency, and optimal GPU utilization across massive, multi-tenant workloads
  • Lead performance engineering across both the platform and model layers
  • You will pioneer the implementation of advanced techniques such as speculative decoding, continuous batching, kv-cache optimization (PagedAttention), and custom quantization strategies (FP8, INT4, AWQ)
What we offer
What we offer
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Senior Machine Learning Engineer, ML Training Platform

Location
Location
United States
Salary
Salary:
216700.00 - 303400.00 USD / Year
Reddit
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software engineering experience, with a focus on Platform Engineering, ML Infrastructure, or Backend Systems
  • Deep Kubernetes Expertise: You know K8s beyond just 'deploying pods.' You understand CRDs, Controllers and the Operator pattern
  • Jupyter Ecosystem Knowledge: Experience customizing JupyterHub, JupyterLab extensions, or building similar interactive computing platforms
  • Strong Coding Skills: Proficiency in Python (for the ML ecosystem) and Go (for Kubernetes controllers/infrastructure tooling)
  • GPU Experience: Hands-on practice with CUDA environments, GPU virtualization/containerization, and doing it all within Kubernetes
  • Cloud Provider Experience: Familiarity with both managed ML offerings (Vertex AI, Sagemaker, etc) and building custom ML components in AWS and/or GCP
  • Experience working with distributed training frameworks, including Ray and Kubernetes
  • Comfortable with distributed systems, big data (Petabyte scale) and data-intensive systems
  • Strong focus on scalability, reliability, performance, and ease of use. You are an undying advocate for platform users and have a deep intuition for the machine learning development lifecycle
  • Strong organizational & communication skills
Job Responsibility
Job Responsibility
  • Lead the building, testing, and maintenance of ML training infrastructure at Reddit
  • Play a pivotal role in designing, building, and optimizing the infrastructure and tooling required to support large-scale machine learning workflows
  • Evolve the MLE experience, from provisioning interactive GPU environments through large-scale training, supporting on-demand and self-service workflows
  • Kubernetes Automation: Write custom Kubernetes Controllers and Operators to manage the lifecycle of interactive Jupyter workspaces and long-running ML training jobs, handle auto-idling, and ensure fault tolerance
  • GPU Orchestration: Work with the underlying compute team to ensure MLEs have efficient access to training hardware resources and handle resource contention gracefully
  • Developer Experience (DevX): Treat internal MLEs as your customers. Conduct user research, reduce friction in the 'Idea-to-Prototype' loop, and standardize software environments (Docker images, Python dependency management)
What we offer
What we offer
  • Comprehensive Healthcare Benefits and Income Replacement Programs
  • 401k Match
  • Family Planning Support
  • Gender-Affirming Care
  • Mental Health & Coaching Benefits
  • Flexible Vacation & Reddit Global Days off
  • Generous paid Parental Leave
  • Paid Volunteer time off
  • Fulltime
Read More
Arrow Right

Senior Supply Chain Specialist

This position is responsible managing the end-to-end supply planning for Data Ce...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Relevant work experience in Industrial Engineering, Supply Chain or Operations Research
  • Growth mindset, team player, collaborative, solid deductive reasoning
  • Must have strong analytical and quantitative skills, proficient at Microsoft Excel and PowerPoint
  • Effective verbal and written communication skills
  • Pro-active, resourceful, able to multitask in dynamic conditions and handle pressure
  • Solid understanding of the semiconductor supply chain and manufacturing flow desired
  • Able to work well with cross functional teams and in a matrix organization
  • Strong experience with SAP, Rapid Response a plus.
Job Responsibility
Job Responsibility
  • Accountable to meet KPI for SCM: meet program milestone, on-time-delivery, revenue attainment
  • Collaborate with other functions to communicate priorities, strategies, and close operational gaps
  • Performs analysis to proactively identify potential shortages and drives expedites to close the gap
  • Manage and position supply to meet new product milestones & demand ramp and manage risk
  • Responsible for continuous supply and demand tracking and analysis and action as needed
  • Manages and converts demand to a master schedule to meet customer deliveries
  • Collaborate with stakeholders to resolve issues or identify innovative solutions
  • Lead resolution of issues to meet customer success or enable decision
  • Drive robust tool development to manage complex planning, BOM, and inventory flows
  • Advocate and drive continuous improvement & change management process design to increase productivity and scale
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Search

We are looking for a Senior Software Engineer dedicated to the core development ...
Location
Location
Finland , Helsinki
Salary
Salary:
Not provided
aiven.io Logo
Aiven Deutschland GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Search Mastery: Deep technical knowledge of OpenSearch or Elasticsearch internals, particularly in resource management, indexing strategies, and query optimization.
  • Reliability & Operations: A passion for building highly available, resilient distributed systems and a proven track record of solving complex operational challenges.
  • Hardware: Interest or experience in hardware acceleration, specifically deploying and managing GPU-based instances for data services.
  • Automation Mindset: Proven experience in designing automated recovery systems and performance-tuning algorithms.
  • Modern Search Patterns: A strong interest in the evolving landscape, including Vector Database implementations, hybrid search and RAG (Retrieval-Augmented Generation).
Job Responsibility
Job Responsibility
  • Autonomic Systems: Design and implement new and improve existing automated management, self-healing recovery mechanisms, and performance-tuning logic for OpenSearch clusters.
  • Next-Gen Infrastructure: Research, design, and deploy the first GPU-powered instances within the Aiven ecosystem to support intensive search and AI workloads.
  • AI Node Development: Develop and integrate specialized AI node types to enhance OpenSearch's capability in handling modern machine learning tasks.
  • Engineering Ownership: Own the health, reliability, and availability metrics of our OpenSearch platform.
What we offer
What we offer
  • Participate in Aiven’s equity plan.
  • Balance work and life with our hybrid work policy.
  • Choose the equipment you need to set yourself up for success.
  • Use your Professional Development Plan budget for learning opportunities.
  • Receive holistic wellbeing support through our global Employee Assistance Program.
  • Inquire about our Global Time Off Commitment (Parental and Sick Leave, as well as Personal Time)
  • Enjoy country-specific benefits for our global cast.
  • Fulltime
Read More
Arrow Right