CrawlJobs Logo
Cohere Logo Cohere · IT - Software Development

Member of Technical Staff, Model Efficiency

United States; Canada; France; South Korea; United Kingdom, New York · Job Posted February 20, 2026
Apply Position
Job Link Share

Job Description

Our team is a fast-growing group of researchers and engineers focused on building reliable ML systems and pushing the boundaries of LLM inference efficiency. We develop techniques that improve how models execute in production, driving lower latency, higher throughput, and consistent quality across diverse workloads.

Job Responsibility

  • Work across the inference stack to improve core performance metrics by diving deep into model execution, identifying bottlenecks, and developing innovative optimizations
  • Collaborate closely with modeling and systems teams to experiment, measure, and ship improvements that meaningfully accelerate inference
  • Build expertise in advanced performance techniques, including GPU/CUDA optimizations, kernel-level improvements, and model execution strategies for MoE and large-scale architectures

Requirements

  • 5+ years of experience writing high-performance, production-quality code
  • Strong programming skills in C++ or Python (Rust/Go also welcome)
  • Experience working with large language models and familiarity with the LLM inference ecosystem (e.g., vLLM, SGLang, etc.)
  • Ability to diagnose and resolve performance bottlenecks across the model execution stack
  • A strong bias for action — you ship fast, measure impact, and iterate

Nice to have

  • GPU programming, CUDA, or low-level systems optimization
  • Language modeling with transformers (MoE, speculative decoding, KV-cache optimizations)
  • Scaling performance-critical distributed systems (e.g., computation, search, storage)

What we offer

  • An open and inclusive culture and work environment
  • Work closely with a team on the cutting edge of AI research
  • Weekly lunch stipend, in-office lunches & snacks
  • Full health and dental benefits, including a separate budget to take care of your mental health
  • 100% Parental Leave top-up for up to 6 months
  • Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
  • Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
  • 6 weeks of vacation (30 working days!)
Cohere - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Member of Technical Staff, Model Efficiency

8 matching positions

Member of Technical Staff, Capacity & Efficiency Infrastructure

Microsoft AI is looking for a Member of Technical Staff – Capacity & Efficiency ...
Location
Location
United States , Mountain View
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Deep understanding of the fundamentals of GPU architectures and DL/LLM architectures
  • Deep experience in profiling and analyzing performance in large-scale distributed computing systems
  • Deep experience in profiling and analyzing performance in ML models especially GenAI models
  • Experience with low-level GPU programming (CUDA, Triton, NCCL) and frameworks such as PyTorch or JAX
  • Experience in leading technical projects and supporting architectural decisions with data
  • Experience building infrastructure for large-scale machine learning or generative AI workloads
  • Experience in networking (InfiniBand, NVLink), storage systems, or distributed training parallelisms
  • Track record of contributing to high-performance computing or large-scale AI infrastructure projects
Job Responsibility
Job Responsibility
  • Design, implement, test, and optimize distributed training infrastructure in Python and C++ for large-scale GPU clusters
  • Build and evolve telemetry systems to provide visibility into infrastructure & ML model performance, utilization, and cost related metrics
  • Profile, benchmark, and debug performance bottlenecks across compute, memory, networking, and storage subsystems
  • Drive architectural improvements across various ML services which deliver measurable efficiency improvements
  • Build and evolve tools to automatically provide insights and recommendations to improve fleet-wide efficiency
  • Optimize collective communication libraries (e.g., NCCL) for emerging NVLink and InfiniBand topologies
  • Partner with ML researchers and infrastructure engineers to understand their plans and future needs and develop plans to balance growth with efficiency
  • Collaborate with hardware teams to optimize for next-generation accelerators (NVIDIA, MAIA, and beyond)
  • Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

Member of Technical Staff, Full Stack - ML Efficiency & Observability

Microsoft AI is looking for a Member of Technical Staff - Full Stack Engineer, M...
Location
Location
United States , Mountain View
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work
  • OR Master’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ year(s) experience in business analytics, data science, software development, or data engineering work
  • OR equivalent experience.
  • Experience with Capacity Management, Efficiency Management, ML Training and/or Inference
  • Solid expertise in JavaScript / TypeScript, React, HTML, CSS and browser internals
  • Solid understanding of web performance, accessibility, and cross‑browser compatibility
  • Experience with Development & Debugging with dev environments like Visual Studio or Visual Studio Code
  • Software development experience with Generative AI tools
  • Experience in leading technical projects and supporting architectural decisions with data.
Job Responsibility
Job Responsibility
  • Design and develop features for our capacity management portal
  • Design and develop features to provide visibility into model performance and quality across our fleet
  • Partner with ML researchers and PMs to translate functional requirements into highly functional, intuitive and appealing interfaces
  • Integrate with backend APIs from schedulers to training frameworks to build visibility across the training life cycle
  • Explore, develop, and adapt new innovations to the software development process
  • Contribute to the development of internal tooling and infrastructure
  • Implement best software development practices to ensure code quality. Hold a high quality bar.
  • Embody our culture and values.
  • Fulltime
Read More
Arrow Right

Member of Technical Staff, Microsoft Robotics

Overview Microsoft’s Discovery and Quantum (MDQ) division develops and delivers...
Location
Location
United States , Redmond
Salary
Salary:
165600.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements is required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Own the multi-year technical architecture for the Microsoft Robotics platform, setting the direction the broader engineering organization, partners, and customers build on, and holding that architecture coherent as it scales across teams and deployments.
  • Make the foundational design decisions that determine how robotics software, AI models, and cloud and edge components fit together, defining the core interfaces and engineering contracts other teams depend on.
  • Architect systems that meet demanding real-world constraints, balancing latency, throughput, compute efficiency, reliability, and cost across cloud and on-robot edge environments.
  • Lead the evaluation and validation strategy that gates what ships, establishing the benchmarks, test approach, and quality bar for autonomy, safety, and task performance across simulation, lab, and field, including safe-autonomy boundaries and human-in-the-loop fallback.
  • Drive the hardest cross-stack technical problems personally, taking on the integration failure modes that emerge where AI models meet production robots, and resolving them through rigorous root-cause analysis of system behavior and field data.
  • Connect classical robotics engineering with modern AI, partnering across foundation-model, perception, manipulation, locomotion, and simulation teams to bring learned capabilities into a common, production-grade platform rather than one-off integrations.
  • Establish the engineering bar for the team, owning design standards and review practices, leading the consequential technical reviews, and lifting the quality, testability, and operability of the systems that matter most.
  • Influence direction across MDQ, Microsoft Research, Azure, hardware and silicon partners, and customers without relying on formal authority, building technical consensus and aligning many teams on a single coherent platform strategy, including representing the platform in the open-source and standards community.
  • Multiply the team's output through technical leadership, mentoring senior and principal engineers and raising the technical ceiling of the organization rather than only its headcount.
  • Track the state of the art across embodied AI, robot learning, robotics middleware, and simulation, and decide deliberately how and when new techniques are incorporated into the platform.
  • Fulltime
Read More
Arrow Right

Member Of Technical Staff, Microsoft Robotics (Perception)

Microsoft's Discovery and Quantum (MDQ) division develops and delivers advanced ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Lead the design, development, and integration of perception and navigation systems for robotic platforms, including SLAM, localization, mapping, sensor fusion, obstacle detection, semantic scene understanding, and motion planning interfaces
  • Develop robust state estimation and localization pipelines using data from cameras, depth sensors, LiDAR, IMUs, wheel odometry, proprioception, GPS, force/torque sensors, or other robot sensor modalities
  • Build spatial representations for navigation and planning, including occupancy maps, semantic maps, costmaps, 3D scene representations, traversability maps, object-level representations, and dynamic environment models
  • Integrate perception outputs with planning, control, simulation, and fleet operations systems to support safe and reliable robot autonomy in real-world environments
  • Architect perception-navigation pipelines that meet practical constraints for latency, bandwidth, compute efficiency, reliability, calibration drift, sensor degradation, and environmental variability
  • Develop evaluation frameworks, benchmarks, and telemetry-driven analysis methods to measure perception, localization, mapping, and navigation performance across simulation, lab, and field deployments
  • Partner with learning engineers, spatial AI engineers, simulation engineers, and platform engineers to connect classical robotics pipelines with modern AI models, including learned perception, physical world models, and data-driven navigation approaches
  • Analyze field logs, sensor data, planner behavior, and failure cases to identify root causes, improve system robustness, and drive cross-stack improvements across perception, planning, controls, and hardware integration
  • Lead technical design reviews, establish engineering patterns, and mentor other engineers on production-quality robotics autonomy development, testing, debugging, and deployment practices
  • Stay current with state-of-the-art research and industry practice in robotics perception, SLAM, VIO, sensor fusion, semantic mapping, spatial AI, navigation, and physical AI, assessing how new techniques should be incorporated into Microsoft's robotics platform.
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation.
  • Fulltime
Read More
Arrow Right

Member Of Technical Staff, Microsoft Robotics (Robotics Data)

Microsoft’s Discovery and Quantum (MDQ) division develops and delivers advanced ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience
  • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience
  • OR Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Define and implement data collection strategies for robot learning, including specifying demonstration coverage requirements, environmental diversity targets, task distribution plans, and quality acceptance criteria for teleoperation, egocentric, and autonomous data collection campaigns
  • Build and maintain data curation pipelines that ingest, clean, validate, label, and version robotics datasets (manipulation demonstrations, navigation trajectories, sensor logs, simulation rollouts), ensuring data integrity and provenance tracking
  • Develop data analysis frameworks that quantify dataset characteristics (coverage, diversity, balance, quality scores), identify data gaps and biases, and provide recommendations for targeted data collection to improve model performance
  • Create interactive data visualization tools and dashboards (using tools such as Power BI, Plotly, or custom web applications) that enable researchers, engineers, and leadership to explore dataset properties, model training metrics, evaluation results, and fleet operational telemetry
  • Collaborate with ML researchers and learning engineers to design and execute experiments that measure the impact of data quantity, quality, and diversity on model performance, producing statistical analyses that guide data investment decisions
  • Formulate and maintain a roadmap of data science project activity that leads to measurable improvement in model performance metrics, data pipeline efficiency, and data quality over time
  • Develop and apply statistical techniques (hypothesis testing, causal inference, regression analysis, clustering) to analyze robot performance data, identify failure modes, and uncover patterns that inform model architecture and training strategy decisions
  • Write efficient, readable, extensible code in Python (including Pandas, NumPy, scikit-learn, matplotlib) for data processing, analysis, and visualization, building professional-grade documentation for knowledge transfer
  • Adhere and contribute to ethics and privacy policies related to collecting and preparing robotics data, providing guidance on responsible data practices including bias detection, consent, and data governance
  • Present results and findings to senior stakeholders, using compelling visualizations and storytelling to influence data investment priorities and model development strategy
What we offer
What we offer
  • Benefits and other compensation may be eligible
  • Fulltime
Read More
Arrow Right

Member of Technical Staff, Microsoft Robotics (Spatial AI)

Microsoft’s Discovery and Quantum (MDQ) division develops and delivers advanced ...
Location
Location
United States , Redmond
Salary
Salary:
102100.00 - 202200.00 USD / Year ▼
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 2+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
  • OR Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) or consulting experience
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Design, develop, and evaluate physical world models that capture 3D spatial structure, object geometry and pose, physics dynamics, material properties, and semantic scene understanding for robotic applications
  • Build and train world models (e.g., video prediction models, neural physics simulators, 3D generative models, scene graph representations) that predict future states of physical environments conditioned on robot actions, enabling model-based planning and policy learning
  • Develop spatial AI capabilities including 3D scene reconstruction, object detection and pose estimation, spatial relationship reasoning, occupancy prediction, and dense 3D feature representations for robot perception and planning
  • Implement and maintain evaluation frameworks for world models and spatial AI systems, including prediction accuracy metrics, planning performance benchmarks, and generalization testing across environments and object categories
  • Collaborate with robotics researchers, learning engineers, and simulation engineers to integrate world models into robot planning and control pipelines, enabling model-predictive control, imagination-based planning, and data-augmented training
  • Build data pipelines for training world models, including multi-sensor data fusion (RGB, depth, LiDAR, proprioception), scene annotation, and dataset curation for diverse physical environments and interaction scenarios
  • Write efficient, readable, extensible code in Python (including PyTorch, JAX, or TensorFlow) for model development, training, and evaluation, leveraging GPU computing infrastructure for large-scale experiments
  • Contribute to the formulation of the team's world modeling research and development roadmap, identifying high-impact technical directions and collaborating with leadership to prioritize investments
  • Present research findings and model evaluation results clearly and efficiently to internal stakeholders and external partners, contributing to technical publications, blog posts, and conference presentations
  • Stay current with state-of-the-art research in world models, spatial AI, 3D vision, neural physics simulation, and foundation models for physical understanding, actively contributing to the body of thought leadership in these areas
  • Fulltime
Read More
Arrow Right

Member of Technical Staff, Microsoft Robotics (Navigation)

Microsoft’s Discovery and Quantum (MDQ) division develops and delivers advanced ...
Location
Location
United States , Redmond
Salary
Salary:
102100.00 - 202200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Develop algorithms that translate mission objectives, task assignments, spatial constraints, and robot state into safe, dynamically feasible trajectories for mobile robots, manipulators, or multi-robot systems.
  • Integrate navigation and planning modules with localization, mapping, perception, control, simulation, and fleet operations systems to support end-to-end autonomy workflows.
  • Build and improve real-time planning systems that operate under practical constraints such as limited compute, noisy sensors, dynamic obstacles, intermittent connectivity, and changing environmental conditions.
  • Develop costmaps, traversability models, spatial constraints, route-planning logic, and safety-aware decision policies that enable robots to operate in human-populated and operationally complex environments.
  • Use simulation, log replay, field testing, and automated regression suites to evaluate navigation performance, identify failure modes, and improve robustness across diverse scenarios.
  • Collaborate with perception, spatial AI, simulation, platform, and field test teams to validate navigation behavior across real and simulated environments, ensuring consistent performance from lab development through deployment.
  • Analyze robot telemetry, navigation logs, planner traces, and field test results to debug autonomy issues, tune planning parameters, and drive measurable improvements in success rate, safety, latency, and mission efficiency.
  • Write production-quality software in Python, C++, or equivalent languages, following engineering best practices for testing, maintainability, observability, and operational readiness.
  • Stay current with advances in robotics navigation, motion planning, model-predictive control, multi-agent planning, foundation models for robotics, and embodied AI, evaluating new techniques for adoption into Microsoft's robotics platform.
What we offer
What we offer
  • Benefits and other compensation
  • Fulltime
Read More
Arrow Right

Member of Technical Staff, Infrastructure

The Infra team at LlamaIndex owns the foundations that our product is built upon...
Location
Location
United States , San Francisco
Salary
Salary:
Not provided
llamaindex.ai Logo
LlamaIndex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of engineering experience
  • Worked on Platform or Infrastructure teams on significant projects involving infrastructure components (Terraform/CDKTF, Kubernetes, Helm, test infrastructure, release management, observability, etc.)
  • Experience in optimizing cloud resource utilization
  • Proficient in tuning Kubernetes clusters and cloud resources for cost and performance efficiency
  • Willing to build LlamaIndex's engineering culture as we grow
  • You can balance speed and pragmatism and build the appropriate solutions for each stage of the company's growth
Job Responsibility
Job Responsibility
  • Collaborate with other engineering teams to build and maintain foundational systems that empower developers and support the company's rapid growth
  • Design and implement scalable infrastructure solutions for various deployment models, including SaaS, single-tenant, and private deployments
  • Manage and optimize cloud resources and Kubernetes clusters for cost-effectiveness and performance
  • Enable external customer deployment success through maintaining clear infrastructure boundaries and principles
  • Optimize and improve the release and deployment processes to enhance efficiency and reliability
  • Ensure compliance with relevant regulations and implement robust security measures across different deployment environments
What we offer
What we offer
  • Competitive base salary and equity compensation
  • Comprehensive medical/dental/vision coverage for you and your family
  • Unlimited paid time off policy
  • Daily catered lunch and snacks in the San Francisco office
  • Fulltime
Read More
Arrow Right