CrawlJobs Logo

Software Engineer, Systems ML - Compilers / Backend

United States, Sunnyvale 217000.00 USD / Year · Job Posted February 17, 2026
Apply Position
Job Link Share

Job Description

We are seeking a software engineer to support the development of the compiler tool-chain for state-of-the-art deep learning hardware components optimized for AR/VR systems. You will be part of our efforts to architect, design and implement a clean slate compiler for this activity and will be part of a team that includes compiler, machine learning algorithms and software, firmware and ASIC experts. You will contribute to a full stack development effort compiling PyTorch models down to binaries for custom hardware accelerator blocks.

Job Responsibility

  • Analyze and design effective compiler passes and optimizations. Implement and/or enhance code generation targeting machine learning accelerators
  • Work with algorithm research teams to map ML graphs to hardware implementations, model data-flows, create cost-benefit analysis and estimate silicon power and performance
  • Work with hardware architects to co-design hardware features that maximize performance, power efficiency and programmability
  • Contribute to the development of machine-learning libraries, intermediate representations, export formats, and analysis tools
  • Analyze and improve the efficiency, scalability, and stability of our toolchains. Optimize and tune kernels and compiled code to achieve latency targets for ML inference
  • Conduct design and code reviews. Evaluate code performance, debug, diagnose and drive resolution of compiler and cross-disciplinary system issues
  • Interface with other compiler-focused teams to evaluate and incorporate their innovations and vice versa

Requirements

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 2+ years experience developing compilers, toolchains, runtime, or similar code optimization software
  • Experience in software design and programming experience in Python and/or C/C++ for development, debugging, testing and performance analysis
  • Experience in AI framework development or accelerating models on hardware architectures (GPU, TPU, custom AI ASICs)

Nice to have

  • Experience working and communicating cross functionally in a team environment
  • Experience with machine-code generation or compiler back-ends for on-device inference workloads
  • Experience working on and contributing to an active compiler toolchain codebase, such as LLVM, MLIR, GCC, MSVC, Glow
  • Experience in deep learning algorithms and techniques, e.g., convolutional neural networks, recurrent networks, etc
  • Experience developing high-performance kernels or runtime components and tuning them for inference specific accelerator platforms
  • Experience of developing in a mainstream machine-learning framework, e.g. PyTorch, MLIR, Tensorflow or Caffe

What we offer

  • bonus
  • equity
  • benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer, Systems ML - Compilers / Backend

8 matching positions

Software Engineer, Systems ML - Compilers / Backend

We are seeking a software engineer to support the development of the compiler to...
Location
Location
United States , Sunnyvale
Salary
Salary:
181000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
  • Experience in software design and programming experience in Python and/or C/C++ for development, debugging, testing and performance analysis
  • Experience in AI framework development or accelerating models on hardware architectures (GPU, TPU, custom AI ASICs)
  • Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
Job Responsibility
Job Responsibility
  • Analyze and design effective compiler passes and optimizations. Implement and/or enhance code generation targeting machine learning accelerators
  • Work with algorithm research teams to support the co-design of hardware features mapping ML graphs to hardware implementations, modeling data-flows, creating cost-benefit analysis and estimating silicon power and performance
  • Work with hardware architects to co-design hardware features that maximize performance, power efficiency and programmability
  • Contribute to the development of machine-learning libraries, intermediate representations, export formats, and analysis tools
  • Collaborate with the team to enhance the efficiency, scalability, and stability of our toolchains by focusing on kernel optimization and tuning
  • Conduct design and code reviews. Evaluate code performance, debug, diagnose and drive resolution of compiler and cross-disciplinary system issues
  • Interface with other compiler-focused teams to evaluate and incorporate their innovations and vice versa
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

Member of Technical Staff, AI Systems Engineer

We are building next-generation customized AI silicon designed to accelerate AI ...
Location
Location
Switzerland , Zürich
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS, MS, or PhD in Computer Science, Computer Engineering, or a related field
  • Software engineering experience focusing on systems programming, ML infrastructure, or AI compilers
  • Expertise in Python: Deep understanding of memory management, concurrent programming
  • Experience with LLM Inference Engines: Hands-on experience modifying or extending frameworks like SGLang, vLLM, DeepSpeed-FastGen, or TensorRT-LLM
  • PyTorch Internals: Strong experience writing PyTorch C++ extensions and custom operators
  • Hardware Interfacing: Proven track record of integrating machine learning workloads with hardware accelerators (GPUs, TPUs, NPUs) using custom SDKs, APIs, or low-level drivers
Job Responsibility
Job Responsibility
  • Framework Integration: Architect and develop the backend integration to make our custom AI chip a first-class citizen in SGLang
  • Custom Operator Development: Write custom C++ / PyTorch extensions that map SGLang’s primitive operations (e.g., RadixAttention, FlashAttention, matrix multiplications) to our custom chip's proprietary software layer
  • Performance Optimization: Profile and optimize end-to-end LLM inference latency, throughput, and memory utilization (Paged Attention) on our hardware
  • Cross-Functional Collaboration: Work closely with our hardware architecture and compiler teams to provide feedback on our custom software stack and silicon design based on framework-level bottlenecks
  • Testing & Deployment: Build robust testing pipelines to validate model accuracy and performance parity against standard GPU baselines
  • Fulltime
Read More
Arrow Right

Software Engineer, Triton Compiler

As a Software Engineer, you will help build AI systems that achieve levels of pe...
Location
Location
United States , San Francisco
Salary
Salary:
266000.00 - 445000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of relevant engineering experience, ideally in systems, compilers, ML frameworks, or performance engineering
  • Owning problems end-to-end, including learning new hardware and software domains as needed
Job Responsibility
Job Responsibility
  • help build AI systems that achieve levels of performance that were previously impossible
  • designing and optimizing core ML systems
  • writing highly reliable low-level code
  • advancing the algorithms and infrastructure that power our models
  • design and build the compilers, languages, and high-performance kernels that allow researchers to fully exploit our first-party accelerators
  • advancing Triton and its backend
  • developing new compiler passes
  • creating the tooling needed to write fast, correct, and deeply optimized kernels for brand-new hardware
  • partner closely with the hardware team to unlock new capabilities and ensure our custom silicon can support the next generation of frontier models
What we offer
What we offer
  • Offers Equity
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Fulltime
Read More
Arrow Right

Senior ML Accelerator Engineer - GPU

About the Mission: GM’s vision of Zero Crashes, Zero Emissions, and Zero Congest...
Location
Location
United States , Austin
Salary
Salary:
128700.00 - 261300.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3+ years of relevant industry experience or equivalent experience
  • BS, MS or PhD in CS, or related technical field
  • Excellent GPU programming skills in CUDA, with a thorough understanding of parallel programming patterns and GPU architecture
  • Hands-on experience benchmarking, profiling, debugging and optimizing accelerator libraries and kernels to extract optimal performance using the NSight suite of tools or similar
  • Strong background in software architecture, library design, and design patterns
  • Strong C++ programming skills with the ability to feel comfortable in large codebases
  • Solid background in system performance, high performance computing and/or architecture-aware optimizations
  • Strong communication skills and the ability to work collaboratively within a team
  • Excellent analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Design, implement, benchmark, and iterate on CUDA-based kernels and custom operators to squeeze every last drop of performance out of on-vehicle inference workloads
  • Build and improve tooling and infrastructure that make it easier to profile, debug, and validate CUDA kernels and accelerator-backend code across the AV stack
  • Partner with AI Solutions, Compilers, and Architecture to translate model and system requirements into concrete kernel roadmaps, priorities, and project plans
  • Collaborate with cross-functional teams (compiler, performance tooling, runtime, deployment solutions) to deliver reusable, reliable, high-performance libraries into production
  • Maintain high technology standards, methodologies, processes, and guidelines for GPU kernel development and performance engineering through code review
  • Manage relationships with internal customers to ensure our kernels and libraries meet real-world needs
What we offer
What we offer
  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • tuition assistance programs
  • Fulltime
Read More
Arrow Right

Machine Learning Engineer 2

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers...
Location
Location
United States , New York
Salary
Salary:
126147.20 - 189220.80 USD / Year
comcastadvertising.com Logo
Comcast Advertising
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field of study
  • 1-2 years of relevant professional experience
  • Strong understanding of software development principles, data structures, and algorithms
  • Proficient in Python, with a good grasp of common design patterns and backend system design principles, experience with C++ is a bonus
  • Solid understanding of testing methodologies, with hands-on experience in backend testing tools such as pytest, etc., to ensure code quality and system reliability
  • Strong problem-solving and debugging skills in backend systems
  • Good communication and writing skills, coupled with the ability to thrive in a fast-paced, dynamic environment
  • Familiarity with the Scrum Agile collaboration framework and experience using Jira are a plus
  • Familiarity with CI/CD tools, Git, and understanding of DevOps principles, experience with Jenkins is a plus
  • Experience with Docker, Kubernetes, or cloud computing platforms is a plus
Job Responsibility
Job Responsibility
  • Implementing, refining, and validating machine learning algorithms tailored for company products and applications
  • Training machine learning models, validating their accuracy, and manage the deployment of these models into production environments
  • Designing and developing data pipelines, ensuring proper data ingestion, validation, cleaning, and monitoring
  • Researching and authoring documentation and technical requirements, including white papers, test results, and formal recommendations
  • Innovating by contributing to the creation of patents, Application Programming Interfaces (APIs), and other intellectual property
  • Testing and evaluating machine learning solutions from internal and external sources, providing detailed assessments
  • Conducting case studies and compile reports to inform testing strategies and results
  • Designing proof of concept solutions, contributing to research studies that underpin future product or application development
  • Consistent exercise of independent judgment and discretion in matters of significance
  • Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary
What we offer
What we offer
  • Paid Time off
  • Physical Wellbeing
  • Financial Wellbeing
  • Emotional Wellbeing
  • Life Events + Family Support
  • Bonus
  • Fulltime
Read More
Arrow Right

H & S Manager

Locum Health & Safety Manager Local Authority – Midlands Part-Time (3 Days Per W...
Location
Location
United Kingdom , East Midlands
Salary
Salary:
Not provided
vividresourcing.com Logo
Vivid Resourcing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience working as a Health & Safety Manager within a public sector or similar environment
  • Strong knowledge of UK H&S legislation and best practice
  • Relevant qualifications (e.g. NEBOSH or equivalent)
  • Ability to work independently and manage priorities effectively
  • Strong communication and stakeholder engagement skills
Job Responsibility
Job Responsibility
  • Leading on health and safety strategy, policy and compliance across the organisation
  • Providing expert advice to officers and managers on H&S matters and risk management
  • Reviewing and updating policies, procedures and risk assessments
  • Supporting incident investigations and ensuring appropriate follow-up actions
  • Promoting a positive health and safety culture across departments
  • Ensuring compliance with relevant UK health and safety legislation
What we offer
What we offer
  • Competitive daily rate (dependent on experience)
  • Flexible start date
  • Parttime
Read More
Arrow Right

IT Project Manager IV

Primary accountability is to manage a portfolio of complex IT and OT (Operationa...
Location
Location
United States , Houston
Salary
Salary:
Not provided
airswift.com Logo
Airswift Sweden
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • An undergraduate degree in Engineering or Computer Science from a recognized post-secondary institution
  • An equivalent combination of education and experience, such as Technologist or similar accreditation may be accepted
  • Project Management Professional (PMP) is an asset
  • Demonstrated strong understanding of IT, OT, Data Centres, Application Development, Network Infrastructure, Control Systems, best practices, standards, as well as control and operating procedures
  • Proven ability to balance priorities, constraints, and objectives of multiple simultaneous projects
  • 10+ years of progressive project management experience, depending on technical education, accreditations, and competency development
  • Demonstrated technical competence
  • Excellent oral and written communications skills
  • Well-developed problem solving, decision-making, organization, planning, and leadership skills
  • A collaborative, team, and service-oriented work style
Job Responsibility
Job Responsibility
  • Provide full-time project management for a portfolio of projects valued at up to $10MM
  • Manage all PMBOK knowledge areas and process groups to maximize stakeholder value while controlling cost, scope, and schedule
  • Deliver projects in accordance with corporate standards using waterfall and/or agile methods, as appropriate
  • Ensure PMO processes are followed and required PMO documentation is completed
  • Develop clear project mandates and supporting documentation, including schedules, budgets, and ongoing performance analysis
  • Develop and implement change management processes, procedures, and tools to support seamless deployments and prevent disruption to critical systems
  • Develop business case budget estimates for new projects and operational initiatives
  • Apply project and organizational knowledge, leadership, and facilitation to enable effective execution of project activities
  • Continuously evaluate internal processes to ensure efficient, priority-based delivery
  • identify and recommend improvements as required
Read More
Arrow Right

Application Support Engineer

We are looking for an Application Support Engineer to provide hands-on support f...
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Technology, or equivalent practical experience
  • At least 5 years of experience in IT engineering, with the ability to operate at a senior support level
  • Strong background supporting Windows enterprise environments and modern endpoint management practices
  • Hands-on experience with Microsoft Intune for device administration, policy enforcement, and compliance oversight
  • Working knowledge of Microsoft Azure, especially in the areas of identity, device management, and security services
  • Experience administering both Active Directory and Azure AD / Entra ID, including troubleshooting and access management
  • Familiarity with IT security principles related to endpoint protection, identity controls, and Zero Trust practices
  • Basic networking knowledge covering TCP/IP, VLANs, and general connectivity troubleshooting, along with strong communication and problem-solving skills
Job Responsibility
Job Responsibility
  • Oversee the deployment, configuration, and ongoing support of Windows 10 and Windows 11 endpoints across the organization
  • Administer Microsoft Intune to manage device policies, software updates, patching schedules, and compliance standards
  • Support Azure-based services with an emphasis on identity management, endpoint administration, and platform security
  • Maintain both on-premises Active Directory and Azure AD / Entra ID, including user access, directory synchronization, and account lifecycle processes
  • Contribute to security operations by supporting endpoint protection, identity safeguards, and access governance measures
  • Manage and support network access control solutions such as Portnox or comparable platforms
  • Configure and monitor Azure security and compliance capabilities, including Conditional Access, Defender, security baselines, and policy controls
  • Troubleshoot basic network and connectivity issues affecting user access, endpoint communication, and general infrastructure services
  • Serve as an advanced escalation resource for technical support issues, delivering effective resolution for complex end-user problems
  • Partner with IT, Security, and Infrastructure teams to refine documentation, strengthen operational practices, and improve the overall security posture
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right