CrawlJobs Logo

Software Engineer, Collective Communication

United States, San Francisco 380000.00 - 555000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

The Workload Networking team is responsible for the collective communication stack used in our largest training jobs. Using a combination of C++ and CUDA we work on novel collective communication techniques that enable efficient training of our flagship models on our largest custom built supercomputers. The models we train are key ingredients to the AI research progress at OpenAI and the field as a whole, and we continually incorporate learnings from our entire research org into our training platform.

Job Responsibility

  • Collaborate closely with ML researchers to design and implement efficient collective operations in C++ and CUDA
  • Ensure that our largest training jobs take full advantage of the different network transports used in our supercomputers
  • Work on simulations to inform our future supercomputer network designs

Requirements

  • Background in low level performance critical software
  • Experience with collective communication is a bonus
  • Have written distributed algorithms using RDMA in the past
  • Are comfortable writing low level performance sensitive CPU and/or GPU code
  • Are familiar with network simulation techniques

What we offer

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided
  • Offers Equity

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer, Collective Communication

8 matching positions

Ai Software Engineer

Robert Half is seeking an innovative AI Software Engineer to join our client's t...
Location
Location
United States , Nashville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Software Engineer, AI Engineer, Machine Learning Engineer, or related role
  • Strong proficiency in Python and experience with at least one additional programming language such as C#, Java, or JavaScript/TypeScript
  • Experience working with AI/ML frameworks such as TensorFlow, PyTorch, Scikit-learn, LangChain, LlamaIndex, or similar technologies
  • Hands-on experience integrating and deploying Large Language Models (LLMs)
  • Experience building RESTful APIs and scalable cloud-native applications
  • Familiarity with vector databases such as Pinecone, Weaviate, Chroma, or Azure AI Search
  • Knowledge of data structures, algorithms, and software engineering best practices
  • Experience with cloud platforms including Azure, AWS, or GCP
  • Strong analytical, troubleshooting, and problem-solving skills
  • Excellent communication and collaboration abilities
Job Responsibility
Job Responsibility
  • Design, build, and maintain AI-powered applications, APIs, and services using modern software development practices
  • Develop solutions utilizing large language models (OpenAI, Anthropic, Gemini, Llama, etc.) through APIs, prompt engineering, fine-tuning, and retrieval-augmented generation (RAG) techniques
  • Build, train, evaluate, and deploy machine learning models to solve business challenges
  • Develop scalable backend systems and microservices using languages such as Python, C#, Java, or JavaScript/TypeScript
  • Design data pipelines and workflows for collecting, transforming, and preparing data used in AI applications
  • Deploy and manage AI workloads within cloud environments including AWS, Azure, or Google Cloud Platform
  • Monitor AI system performance, improve model accuracy, optimize inference costs, and implement guardrails for reliability and security
  • Partner with product managers, data engineers, data scientists, and business stakeholders to deliver AI solutions aligned with organizational goals
  • Create and maintain technical documentation for AI architectures, workflows, APIs, and deployment processes
  • Stay current on emerging AI technologies, frameworks, and industry best practices
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Enrollment in company 401(k) plan
Read More
Arrow Right

Senior Software Engineer - Payments

Harrington Starr has partnered with a leading global fintech organisation to hir...
Location
Location
United Kingdom , Greater London
Salary
Salary:
80000.00 - 100000.00 GBP / Year
harringtonstarr.com Logo
Harrington Starr
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience building and operating scalable, highly available backend systems
  • Background in payments, fintech, banking, or other transaction-heavy environments
  • Experience with distributed systems, APIs, asynchronous messaging, and relational databases
  • Passion for clean code, testing, observability, and continuous improvement
  • Excellent communication skills and ability to collaborate with technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Design, build, and scale mission-critical payment and fund collection services
  • Own solutions end-to-end, from architecture and development through to production support
  • Partner with Product and Operations teams to translate business requirements into technical solutions
  • Mentor engineers and contribute to engineering best practices and code quality
What we offer
What we offer
  • Competitive salary and performance-related bonus
  • Opportunity to work on large-scale, business-critical systems
  • International, collaborative engineering culture
  • Ongoing professional development, training and certification support
  • Fulltime
Read More
Arrow Right
New

Software Engineer - Observability

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
Ireland , Dublin
Salary
Salary:
63400.00 - 105700.00 EUR / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science or related discipline, or equivalent experience
  • Software development with demonstrated experience shipping products or services
  • Solid understanding of data structures, algorithms, and system design fundamentals
  • Strong problem-solving and analytical skills, with a structured approach to software design
  • Ability to collaborate effectively in a cross-functional team environment
  • Strong communication skills
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Design, develop, and operate large-scale, multi-tenant telemetry ingestion pipelines and services (real-time and batch) to handle massive data volumes
  • Build and enhance APIs, tools, and subsystems for telemetry collection, routing, storage, and efficient data access
  • Integrate advanced capabilities (e.g., machine learning–based anomaly detection and data validation) to enhance platform intelligence and insights
  • Own core components of the ingestion and observability platform, driving continuous improvements in reliability, scalability, performance, and data quality
  • Implement robust monitoring, alerting, and diagnostics and ensure production services run reliably, including participation in on-call rotations and incident response
  • Collaborate with partner teams to deliver end-to-end observability solutions and contribute to design reviews and best practices that uphold high engineering standards
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Lead C++ Software Engineer 5

Make your mark at Comcast -- a Fortune 30 global media and technology company. B...
Location
Location
United States , Chicago
Salary
Salary:
152828.79 - 229243.19 USD / Year
comcastadvertising.com Logo
Comcast Advertising
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree or above
  • 5 years or above relevant work experience
  • Abundant experience with C/C++, DB design, and network programming
  • Abundant experience with large system software design and development
  • Abundant experience with distributed systems and mission-critical systems
  • Strong project management skills, with the ability to prioritize tasks, manage timelines, and deliver results in a fast-paced environment
  • Ability to communicate complex technical concepts to non-technical stakeholders and Align engineering efforts with business objectives
  • Demonstrated expertise in problem-solving and technical innovation
  • Strong passion for learning/practicing new techniques
  • Knowledgeable about SDLC, Agile and Software Engineering Methodology
Job Responsibility
Job Responsibility
  • As a pivotal member of the Engineering team to drive the End2End capabilities' complete software development lifecycle, including designing, prototyping, implementation, testing, integration, maintenance, and technical support
  • Produce technical specifications and determine operational feasibility
  • Write well-designed, testable, efficient code
  • Develop software verification plans and quality assurance procedures
  • Document and maintain software functionality
  • Tailor and deploy engineering tools, processes, and metrics
  • Support overall business
  • Technically solve issues
  • Collaborate with Product Managers (PMs) to build capabilities for business needs and ensure technical specifications align with operational feasibility
  • Lead and mentor a group of software engineers, providing technical guidance, code reviews, and best practices to ensure high-quality deliverables
What we offer
What we offer
  • Paid Time off
  • Physical Wellbeing
  • Financial Wellbeing
  • Emotional Wellbeing
  • Life Events + Family Support
  • Fulltime
Read More
Arrow Right

Sr. C++ Software Engineer 4

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers...
Location
Location
United States , Chicago; Englewood
Salary
Salary:
129515.93 - 203525.03 USD / Year
comcastadvertising.com Logo
Comcast Advertising
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • In-depth understanding of cloud, containerization and other related technologies, familiar with distributed architecture and commonly-used middleware such as cache, message queue, Nginx, etc.
  • Experience in large-scale online service design, development and operation and maintenance is preferred
  • Good understanding of Linux/Unix, with excellent data structure and algorithm foundation
  • Proficiency in C/C++ or Golang and network programming.
  • Experience with large system software design and development.
  • Experience with distributed systems and mission-critical systems is preferred.
  • Demonstrated expertise in problem solving and technical innovation.
  • Strong passion with learning/practicing new technics.
  • Knowledgeable about SDLC, Agile and Software Engineering Methodology.
  • Team working skills, Good communication skills, Willingness to work under pressure.
Job Responsibility
Job Responsibility
  • Construct and optimize the infrastructure of the ad delivery system with high concurrency, high availability, and low latency ad delivery.
  • Continuous optimization and reconstruction of existing systems to support rapid business development.
  • Responsible for end-to-end software development, Assists with the software update process for existing applications and roll-outs of software releases.
  • Collaborates with project stakeholders to identify product and technical requirements. Conducts analysis to determine integration needs.
  • Researches, writes and edits documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals and formal recommendations and reports.
  • Provides technical leadership throughout the design process and guidance with regards to practices, procedures and techniques. Serves as a guide and mentor for junior-level Software Development Engineers.
  • Displays in-depth knowledge of engineering methodologies, concepts, skills and their application in the area of specified engineering specialty.
  • Displays in-depth knowledge of and ability to apply, process design and redesign skills. Presents and defends architectural, design and technical choices to internal audiences.
  • Design, architect, and implement solutions utilizing AWS services, Kubernetes, and containerization technologies.
  • Develop and manage highly scalable and reliable infrastructure on AWS, ensuring optimal performance and cost efficiency.
What we offer
What we offer
  • Paid Time off
  • Physical Wellbeing
  • Financial Wellbeing
  • Emotional Wellbeing
  • Life Events + Family Support
  • Fulltime
Read More
Arrow Right

Software Engineer, SystemML - AI Networking

In this role, you will be a member of the AI Networking Software team and part o...
Location
Location
United States , Bellevue
Salary
Salary:
183997.00 - 257000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Proven C/C++ and Python programming skills
  • Proven track record of leading successful projects
  • Effective leadership and communication skills
  • Specialized experience in one or more of the following machine learning/deep learning domains: Distributed ML Training, GPU architecture, ML systems, AI infrastructure, high performance computing, performance optimizations, or Machine Learning frameworks (e.g. PyTorch)
Job Responsibility
Job Responsibility
  • Tech-leading the collective communication library development on Meta's large-scale GPU training infra with a focus on GenAI/LLM scaling
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Software Engineer - Data

We founded iamproperty to do the things no one else was doing, but we’ve grown b...
Location
Location
United Kingdom
Salary
Salary:
Not provided
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A minimum of three years' experience in software development using C#, ASP.NET Core and ASP.NET MVC
  • Strong experience working with SQL Server and high-volume data processing environments
  • Experience developing and supporting applications within Microsoft Azure cloud environments
  • Proficiency in Python and/or other technologies used to collect and process data from web-based applications
  • Experience using GitHub for version control and collaborative software development
  • Strong understanding of software development best practices and engineering principles
  • Experience working within Agile software development environments
  • Excellent problem-solving and analytical skills with a methodical approach to development
  • Strong written and verbal communication skills
  • Ability to work effectively both independently and as part of a collaborative team
Job Responsibility
Job Responsibility
  • Designing, developing and implementing scalable software and data processing solutions using C#, ASP.NET Core, SQL Server, Azure and Python
  • Writing clean, efficient and maintainable code in line with engineering best practice and coding standards
  • Collaborating with cross-functional teams to deliver new features, enhancements and product improvements
  • Building and supporting high-volume data processing applications and services
  • Troubleshooting, testing and maintaining software applications to ensure performance, reliability and functionality
  • Participating in code reviews and contributing to a culture of continuous improvement and technical excellence
  • Developing and maintaining technical documentation to support ongoing development and knowledge sharing
  • Contributing to software engineering standards, processes and best practices across the technology team
  • Supporting the optimisation of databases, applications and cloud-based services
  • Keeping up to date with emerging technologies and industry trends to help drive innovation across the business
What we offer
What we offer
  • Enhanced flexibility and working from anywhere
  • Birthday off
  • Annual wellbeing allowance
  • Discounts portal
  • Private Counselling with a weekly confidential helpline
  • SimplyHealth private healthcare plan
  • £150 Wellbeing Allowance per year
  • Working elsewhere policy (4 weeks per year)
  • Buy and sell annual leave scheme (upto 3 days per year)
  • Fulltime
Read More
Arrow Right

Software Engineer II

Rapid7 is seeking a Software Engineer II to join our Labs team within the Securi...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
rapid7.com Logo
Rapid7
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years working in a professional software engineering environment
  • Proficiency in one or more industry standard languages such as Python, Go, Java, C#, or Ruby
  • Familiarity with modern engineering tools including Kubernetes, Terraform, Jenkins, and Spinnaker
  • Understanding of internet protocols and the related cybersecurity implications
  • Experience working with AWS services such as S3, EC2, IAM, and RDS (PostgreSQL)
  • Ability to collaborate with cross-functional teams regardless of location to drive impact and positive customer outcomes
  • Commitment to holding self and others responsible for driving outcomes and meeting commitments
  • Passion for developing your craft and continuous learning to elevate personal and professional impact
  • Clear communication of objectives and rationale to foster commitment from teammates
  • Experience with data-driven workflows using tools like Airflow, EMR, Glue, or Spark
Job Responsibility
Job Responsibility
  • Monitor and improve core research projects including our vulnerability intelligence service, Project Sonar, and Project Lorelei
  • Maintain and enhance RESTful APIs that back internet telemetry research tools
  • Contribute to the evolution of overall telemetry research effort to develop richer data generation capabilities
  • Partner with the Manager of Software Engineering to develop long-term vision and strategy for core projects
  • Execute technical improvements across the stack using Python, Django, and other object-oriented languages
  • Manage cloud-based infrastructures utilizing Kubernetes (EKS), Terraform, and various AWS services
  • Develop and refine presentation layers for internet telemetry to ensure high-quality data visualization
  • Drive agile software development principles including high test coverage and CI/CD workflows
  • Fulltime
Read More
Arrow Right