CrawlJobs Logo

Software Engineer, Systems ML - Compilers / Backend

United States, Sunnyvale 181000.00 USD / Year · Job Posted March 04, 2026
Apply Position
Job Link Share

Job Description

We are seeking a software engineer to support the development of the compiler tool-chain for state-of-the-art deep learning hardware components optimized for AR/VR systems. You will be part of our efforts to architect, design and implement a clean slate compiler for this activity and will be part of a team that includes compiler, machine learning algorithms and software, firmware and ASIC experts. You will contribute to a full stack development effort compiling PyTorch models down to binaries for custom hardware accelerator blocks.

Job Responsibility

  • Analyze and design effective compiler passes and optimizations. Implement and/or enhance code generation targeting machine learning accelerators
  • Work with algorithm research teams to support the co-design of hardware features mapping ML graphs to hardware implementations, modeling data-flows, creating cost-benefit analysis and estimating silicon power and performance
  • Work with hardware architects to co-design hardware features that maximize performance, power efficiency and programmability
  • Contribute to the development of machine-learning libraries, intermediate representations, export formats, and analysis tools
  • Collaborate with the team to enhance the efficiency, scalability, and stability of our toolchains by focusing on kernel optimization and tuning
  • Conduct design and code reviews. Evaluate code performance, debug, diagnose and drive resolution of compiler and cross-disciplinary system issues
  • Interface with other compiler-focused teams to evaluate and incorporate their innovations and vice versa

Requirements

  • Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
  • Experience in software design and programming experience in Python and/or C/C++ for development, debugging, testing and performance analysis
  • Experience in AI framework development or accelerating models on hardware architectures (GPU, TPU, custom AI ASICs)
  • Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment

Nice to have

  • 1+ years experience developing compilers or similar code optimization software
  • Experience working and communicating cross functionally in a team environment
  • Experience with machine-code generation or compiler back-ends for on-device inference workloads
  • Experience working on and contributing to an active compiler toolchain codebase, such as LLVM, MLIR, GCC, MSVC, Glow
  • Experience in deep learning algorithms and techniques, e.g., convolutional neural networks, recurrent networks, etc
  • Experience developing high-performance kernels or runtime components and tuning them for inference specific accelerator platforms
  • Experience of developing in a mainstream machine-learning framework, e.g. PyTorch, MLIR, Tensorflow or Caffe

What we offer

  • bonus
  • equity
  • benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer, Systems ML - Compilers / Backend

8 matching positions

Software Engineer, Systems ML - Compilers / Backend

We are seeking a software engineer to support the development of the compiler to...
Location
Location
United States , Sunnyvale
Salary
Salary:
217000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 2+ years experience developing compilers, toolchains, runtime, or similar code optimization software
  • Experience in software design and programming experience in Python and/or C/C++ for development, debugging, testing and performance analysis
  • Experience in AI framework development or accelerating models on hardware architectures (GPU, TPU, custom AI ASICs)
Job Responsibility
Job Responsibility
  • Analyze and design effective compiler passes and optimizations. Implement and/or enhance code generation targeting machine learning accelerators
  • Work with algorithm research teams to map ML graphs to hardware implementations, model data-flows, create cost-benefit analysis and estimate silicon power and performance
  • Work with hardware architects to co-design hardware features that maximize performance, power efficiency and programmability
  • Contribute to the development of machine-learning libraries, intermediate representations, export formats, and analysis tools
  • Analyze and improve the efficiency, scalability, and stability of our toolchains. Optimize and tune kernels and compiled code to achieve latency targets for ML inference
  • Conduct design and code reviews. Evaluate code performance, debug, diagnose and drive resolution of compiler and cross-disciplinary system issues
  • Interface with other compiler-focused teams to evaluate and incorporate their innovations and vice versa
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

Member of Technical Staff, AI Systems Engineer

We are building next-generation customized AI silicon designed to accelerate AI ...
Location
Location
Switzerland , Zürich
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS, MS, or PhD in Computer Science, Computer Engineering, or a related field
  • Software engineering experience focusing on systems programming, ML infrastructure, or AI compilers
  • Expertise in Python: Deep understanding of memory management, concurrent programming
  • Experience with LLM Inference Engines: Hands-on experience modifying or extending frameworks like SGLang, vLLM, DeepSpeed-FastGen, or TensorRT-LLM
  • PyTorch Internals: Strong experience writing PyTorch C++ extensions and custom operators
  • Hardware Interfacing: Proven track record of integrating machine learning workloads with hardware accelerators (GPUs, TPUs, NPUs) using custom SDKs, APIs, or low-level drivers
Job Responsibility
Job Responsibility
  • Framework Integration: Architect and develop the backend integration to make our custom AI chip a first-class citizen in SGLang
  • Custom Operator Development: Write custom C++ / PyTorch extensions that map SGLang’s primitive operations (e.g., RadixAttention, FlashAttention, matrix multiplications) to our custom chip's proprietary software layer
  • Performance Optimization: Profile and optimize end-to-end LLM inference latency, throughput, and memory utilization (Paged Attention) on our hardware
  • Cross-Functional Collaboration: Work closely with our hardware architecture and compiler teams to provide feedback on our custom software stack and silicon design based on framework-level bottlenecks
  • Testing & Deployment: Build robust testing pipelines to validate model accuracy and performance parity against standard GPU baselines
  • Fulltime
Read More
Arrow Right

Software Engineer, Triton Compiler

As a Software Engineer, you will help build AI systems that achieve levels of pe...
Location
Location
United States , San Francisco
Salary
Salary:
266000.00 - 445000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of relevant engineering experience, ideally in systems, compilers, ML frameworks, or performance engineering
  • Owning problems end-to-end, including learning new hardware and software domains as needed
Job Responsibility
Job Responsibility
  • help build AI systems that achieve levels of performance that were previously impossible
  • designing and optimizing core ML systems
  • writing highly reliable low-level code
  • advancing the algorithms and infrastructure that power our models
  • design and build the compilers, languages, and high-performance kernels that allow researchers to fully exploit our first-party accelerators
  • advancing Triton and its backend
  • developing new compiler passes
  • creating the tooling needed to write fast, correct, and deeply optimized kernels for brand-new hardware
  • partner closely with the hardware team to unlock new capabilities and ensure our custom silicon can support the next generation of frontier models
What we offer
What we offer
  • Offers Equity
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Fulltime
Read More
Arrow Right

Senior ML Accelerator Engineer - GPU

About the Mission: GM’s vision of Zero Crashes, Zero Emissions, and Zero Congest...
Location
Location
United States , Austin
Salary
Salary:
128700.00 - 261300.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3+ years of relevant industry experience or equivalent experience
  • BS, MS or PhD in CS, or related technical field
  • Excellent GPU programming skills in CUDA, with a thorough understanding of parallel programming patterns and GPU architecture
  • Hands-on experience benchmarking, profiling, debugging and optimizing accelerator libraries and kernels to extract optimal performance using the NSight suite of tools or similar
  • Strong background in software architecture, library design, and design patterns
  • Strong C++ programming skills with the ability to feel comfortable in large codebases
  • Solid background in system performance, high performance computing and/or architecture-aware optimizations
  • Strong communication skills and the ability to work collaboratively within a team
  • Excellent analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Design, implement, benchmark, and iterate on CUDA-based kernels and custom operators to squeeze every last drop of performance out of on-vehicle inference workloads
  • Build and improve tooling and infrastructure that make it easier to profile, debug, and validate CUDA kernels and accelerator-backend code across the AV stack
  • Partner with AI Solutions, Compilers, and Architecture to translate model and system requirements into concrete kernel roadmaps, priorities, and project plans
  • Collaborate with cross-functional teams (compiler, performance tooling, runtime, deployment solutions) to deliver reusable, reliable, high-performance libraries into production
  • Maintain high technology standards, methodologies, processes, and guidelines for GPU kernel development and performance engineering through code review
  • Manage relationships with internal customers to ensure our kernels and libraries meet real-world needs
What we offer
What we offer
  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • tuition assistance programs
  • Fulltime
Read More
Arrow Right

Store Associate

We're building a world of health around every individual — shaping a more connec...
Location
Location
United States , Newport Beach
Salary
Salary:
17.40 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 22, 2026
Flip Icon
Requirements
Requirements
  • At least 16 years of age
  • Remaining upright on the feet, particularly for sustained periods of time
  • Lifting and exerting up to 35 lbs of force occasionally, up to 10 lbs of force frequently, and a negligible amount of force regularly to move objects to and from, including overhead lifting
  • Visual Acuity - Having close visual acuity to perform activities such as: viewing a computer terminal, reading, visual inspection involving small parts/details
Job Responsibility
Job Responsibility
  • Providing differentiated customer service by anticipating customer needs, demonstrating compassion and care in all interactions, and actively identifying and resolving potential service issues
  • Focusing on the customer by giving a warm and friendly greeting, maintaining eye contact and offering help locating additional items, when needed
  • Accurately perform cashier duties - handling cash, checks and credit card transactions with precision while following company policies and procedures
  • Maintaining the sales floor by restocking shelves, checking in vendors, updating pricing information and completing inventory management tasks as directed by store manager
  • Supporting opening and closing store activities, when needed
  • Providing customer support to all departments, including photo and beauty, ensuring departments are fully stocked and operational while remaining current with all updated services and tools
  • Assisting pharmacy personnel when needed, including working regular shifts in the pharmacy as part of opportunities for growth and career development
  • Embracing and advocating for new CVS services and loyalty programs that support our purpose of helping people on their path to better health
What we offer
What we offer
  • dental
  • vision
  • wellness resources
  • employee discounts
  • access to certain voluntary benefits
  • other programs
  • Parttime
Read More
Arrow Right

Dual Branded Front Desk Supervisor

You will be at the center of the hotel's universe - the front office. You will h...
Location
Location
United States , Ewa Beach
Salary
Salary:
24.00 USD / Hour
pmhotelgroup.com Logo
PM Hotel Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School diploma (or equivalent) and one to three years of related experience
  • ability to contribute to a collaborative and diverse team dynamic
  • quickly assessing situations and creating effective resolutions to problems
  • passion for customer service
Job Responsibility
Job Responsibility
  • Ensure effective collaboration and teamwork among front desk staff
  • staffing, scheduling, and expense management
  • communicate clearly and demonstrate a high level of professionalism
  • provide training and guidance for front desk staff on hotel standard operating procedures and departmental standards
  • step in to complete daily hotel front desk tasks
  • assist Guest Services Manager with monitoring performance and attendance
  • balance daily paperwork: Cash drawer, deposits, reconciling credit cards and submitting batches
What we offer
What we offer
  • Excellent pay
  • hotel discounts
  • F&B discounts
  • Fulltime
Read More
Arrow Right

Team Leader-Housekeeping

Enter status of rooms cleaned. Complete checklists to report cleanliness and con...
Location
Location
China , Shanghai
Salary
Salary:
Not provided
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Education: High school diploma or G.E.D. equivalent
  • Related Work Experience: At least 1 year of related work experience
  • Supervisory Experience: No supervisory experience
  • License or Certification: None
Job Responsibility
Job Responsibility
  • Enter status of rooms cleaned
  • Complete checklists to report cleanliness and condition of each assigned area
  • Complete required Housekeeping paperwork
  • Identify room assignments and type of cleaning required for each room
  • Inspect guest rooms after being cleaned by Housekeeper
  • Respond promptly to requests from guests and other departments
  • Enter guest rooms following procedures for gaining access and ensuring vacancy before entering
  • Assist management in hiring, training, scheduling, evaluating, counseling, disciplining, and motivating and coaching employees
  • serve as a role model
  • Follow all company and safety and security policies and procedures
  • Fulltime
Read More
Arrow Right
New

Store Associate

Retail Store Associates play a meaningful role within the CVS Health family. At ...
Location
Location
United States , Ridgefield Park
Salary
Salary:
15.92 - 22.92 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
August 11, 2026
Flip Icon
Requirements
Requirements
  • At least 16 years of age
Job Responsibility
Job Responsibility
  • Providing differentiated customer service by anticipating customer needs, demonstrating compassion and care in all interactions, and actively identifying and resolving potential service issues
  • Focusing on the customer by giving a warm and friendly greeting, maintaining eye contact and offering help locating additional items, when needed
  • Accurately perform cashier duties - handling cash, checks and credit card transactions with precision while following company policies and procedures
  • Maintaining the sales floor by restocking shelves, checking in vendors, updating pricing information and completing inventory management tasks as directed by store manager
  • Supporting opening and closing store activities, when needed
  • Providing customer support to all departments, including photo and beauty, ensuring departments are fully stocked and operational while remaining current with all updated services and tools
  • Assisting pharmacy personnel when needed, including working regular shifts in the pharmacy as part of opportunities for growth and career development
  • Embracing and advocating for new CVS services and loyalty programs that support our purpose of helping people on their path to better health
What we offer
What we offer
  • dental
  • vision
  • wellness resources
  • employee discounts
  • access to certain voluntary benefits
  • Parttime
Read More
Arrow Right