CrawlJobs Logo

Software Engineer, Collective Communication

openai.com Logo

OpenAI

Location Icon

Location:
United States , San Francisco

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

380000.00 - 555000.00 USD / Year

Job Description:

The Workload Networking team is responsible for the collective communication stack used in our largest training jobs. Using a combination of C++ and CUDA we work on novel collective communication techniques that enable efficient training of our flagship models on our largest custom built supercomputers. The models we train are key ingredients to the AI research progress at OpenAI and the field as a whole, and we continually incorporate learnings from our entire research org into our training platform.

Job Responsibility:

  • Collaborate closely with ML researchers to design and implement efficient collective operations in C++ and CUDA
  • Ensure that our largest training jobs take full advantage of the different network transports used in our supercomputers
  • Work on simulations to inform our future supercomputer network designs

Requirements:

  • Background in low level performance critical software
  • Experience with collective communication is a bonus
  • Have written distributed algorithms using RDMA in the past
  • Are comfortable writing low level performance sensitive CPU and/or GPU code
  • Are familiar with network simulation techniques
What we offer:
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided
  • Offers Equity

Additional Information:

Job Posted:
February 21, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer, Collective Communication

Software Engineer - Data Engineering

Akuna Capital is a leading proprietary trading firm specializing in options mark...
Location
Location
United States , Chicago
Salary
Salary:
130000.00 USD / Year
akunacapital.com Logo
AKUNA CAPITAL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/MS/PhD in Computer Science, Engineering, Physics, Math, or equivalent technical field
  • 5+ years of professional experience developing software applications
  • Java/Scala experience required
  • Highly motivated and willing to take ownership of high-impact projects upon arrival
  • Prior hands-on experience with data platforms and technologies such as Delta Lake, Spark, Kubernetes, Kafka, ClickHouse, and/or Presto/Trino
  • Experience building large-scale batch and streaming pipelines with strict SLA and data quality requirements
  • Must possess excellent communication, analytical, and problem-solving skills
  • Recent hands-on experience with AWS Cloud development, deployment and monitoring necessary
  • Demonstrated experience working on an Agile team employing software engineering best practices, such as GitOps and CI/CD, to deliver complex software projects
  • The ability to react quickly and accurately to rapidly changing market conditions, including the ability to quickly and accurately respond and/or solve math and coding problems are essential functions of the role
Job Responsibility
Job Responsibility
  • Work within a growing Data Engineering division supporting the strategic role of data at Akuna
  • Drive the ongoing design and expansion of our data platform across a wide variety of data sources, supporting an array of streaming, operational and research workflows
  • Work closely with Trading, Quant, Technology & Business Operations teams throughout the firm to identify how data is produced and consumed, helping to define and deliver high impact projects
  • Build and deploy batch and streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK and Databricks/Spark
  • Mentor junior engineers in software and data engineering best practices
  • Produce clean, well-tested, and documented code with a clear design to support mission critical applications
  • Build automated data validation test suites that ensure that data is processed and published in accordance with well-defined Service Level Agreements (SLA’s) pertaining to data quality, data availability and data correctness
  • Challenge the status quo and help push our organization forward, as we grow beyond the limits of our current tech stack
What we offer
What we offer
  • Discretionary performance bonus
  • Comprehensive benefits package that may encompass employer-paid medical, dental, vision, retirement contributions, paid time off, and other benefits
  • Fulltime
Read More
Arrow Right

Lead Software Engineer Scientific Engine

Lead Software Engineer to manage a team of 4. As team lead, you will oversee: Th...
Location
Location
France , Paris
Salary
Salary:
Not provided
descartesunderwriting.com Logo
Descartes Underwriting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 1 year or more of technical management experience
  • Handling human interactions between tech and business
  • Experience mentoring a team of software engineers by unblocking complex situations and sharing best practices (code reviews, pair programming..)
  • Scoping and defining tech priorities according to roadmap and maintenance
  • Excellent communication skills, in both formal and informal settings, and in English and French
  • 3 years of experiences as a software engineer or data scientist
  • Solid knowledge in Python
  • Solid engineering background: master in computer science, mathematics, physics or earth science
  • Experience optimizing and profiling python code
  • Experience in a microservices architecture
Job Responsibility
Job Responsibility
  • Contribute directly on the code base either individually, in pairs or more
  • Organize REX sessions to share the knowledge received with the rest of the team
  • Ensure compliance to internal standards and practices
  • Present the progress and goals
  • Contribute to the technical roadmap through architecture meetings, design documents
  • Lead & coach your engineer team to consistently deliver according to their roadmap
  • Provide expertise to help your team: Develop, optimize and update software for: Calculation of risk models
  • Data collection, preparation and visualization
  • Export of outputs adapted to users
  • Testing and validation of existing solutions
What we offer
What we offer
  • Opportunity to work and learn with teams from the most prestigious schools and research labs in the world
  • Commitment from Descartes to its staff of continued learning and development (think annual seminars, training etc.)
  • Work in a collaborative & professional environment
  • Be part of an international team, passionate about diversity
  • Join a company with a true purpose – help us help our clients be more resilient towards climate risks
  • A competitive salary, bonus and benefits
  • You can benefit from a punctual home office days
Read More
Arrow Right

Intermediate / Senior Software Engineer Scientific Engine (Python)

Due to our consistent growth, we are seeking to expand our Data, Software and De...
Location
Location
France , Paris
Salary
Salary:
Not provided
descartesunderwriting.com Logo
Descartes Underwriting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Coaching or mentoring experience
  • Scoping and identifying solutions with business team
  • Handling human interactions between tech and business
  • Excellent communication skills, in both formal and informal settings, and in English and French
  • 3 years or more of experiences as a software engineer or data scientist
  • Solid knowledge in Python
  • Solid engineering background: master in computer science, mathematics, physics or earth science
  • Experience optimizing and profiling python code
  • Experience in a microservices architecture
  • Good knowledge with Docker
Job Responsibility
Job Responsibility
  • Contribute directly on the code base either individually, in pairs or more
  • Organize REX sessions to share the knowledge received with the rest of the team
  • Ensure compliance to internal standards and practices
  • Present the progress and goals
  • Contribute to the technical roadmap through architecture meetings, design documents
  • Coach your collaborators to consistently deliver according to their roadmap
  • Provide expertise to help your team: Develop, optimize and update software for: Calculation of risk models
  • Data collection, preparation and visualization
  • Export of outputs adapted to users
  • Testing and validation of existing solutions
What we offer
What we offer
  • Opportunity to work and learn with teams from the most prestigious schools and research labs in the world, allowing you to progress towards technical excellence
  • Commitment from Descartes to its staff of continued learning and development (think annual seminars, training etc.)
  • Work in a collaborative & professional environment
  • Be part of an international team, passionate about diversity
  • Join a company with a true purpose – help us help our clients be more resilient towards climate risks
  • A competitive salary, bonus and benefits
  • You can benefit from a punctual home office days
Read More
Arrow Right

Software Engineer Staff

This Software Engineer Staff will be engaged in data science-related research an...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Utilize analytical and programming skills and open-source systems, such as Apache Storm, Apache Spark, Elasticsearch, Cassandra, Graph DB etc. develop data processing pipeline required efficacy and latency
  • Require good knowledge and experience of the big data tool sets and techniques of distributed storage and computation engine
  • Require the experience to develop the reusable and highly scalable data processing component
  • Require good knowledge and experience to work with cloud based CICD tools and cloud devops teams to collect stats and create monitors for our data processing pipelines
  • Develop good quality python APIs to support micro services
  • Require the knowledge of APIs to various No SQL storage systems, Elasticsearch, Cassandra, and Redis, etc.
  • Good understanding Python Flask web service and be able to develop good quality code
  • Troubleshoot production environment and customer reported issues
  • Require the knowledge of the multi-cloud production environment
  • Require the agility to troubleshoot open-source data processing engine, such as Apache Spark, Apache Storm and Apache Flink
Job Responsibility
Job Responsibility
  • Designs, develops, troubleshoots and debugs software programs for software enhancements and new products
  • Develops software including operating systems, compilers, routers, networks, utilities, databases and Internet-related tools
  • Determines hardware compatibility and/or influences hardware design
  • Engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology and autonomous platform to provide an unprecedented visibility into the user experience
  • Collaborate with other engineers and product managers to build the next generation of autonomous Wi-Fi networks leveraging big data and predictive models
  • Use knowledge of wireless communication networks, machine learning and software engineering to develop and implement scalable algorithms to process a large amount of streaming data to detect anomalies, predict problems, and classify them in real-time
  • Leverage the data collected from the Wi-Fi network to empower the inference engine of our Mist platform and systems, including the Mist virtual assistant chat bot
  • Determine the likelihood of failures across the Wi-Fi network and performing failure scope analysis
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Software Engineer, Full Stack - Risk Engineering

The Risk Engineering (RENG) team aims to measure the portfolio risk of both our ...
Location
Location
United States , New York
Salary
Salary:
170000.00 - 240000.00 USD / Year
clearstreet.io Logo
Clear Street
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least five (5) years of experience implementing scalable backend services with a statically-typed language (Go / Java preferred)
  • BS degree in Computer Science, Computer Engineering or similar discipline
  • Experience building efficient user-interfaces using Typescript and React
  • Strong communication skills to collaborate effectively with non-technical business stakeholders, product managers, and engineers
  • Excited to explore new technologies and become an expert in our tech stack
Job Responsibility
Job Responsibility
  • Implement efficient user-interfaces for both internal and external users
  • Architect new backend services and storage layers for risk based metrics
  • Collect and break down requirements to produce technical designs
  • Collaborate with other tech teams, as well as business, operations, and compliance team members
What we offer
What we offer
  • Competitive compensation packages
  • Company equity
  • 401k matching
  • Gender neutral parental leave
  • Full medical, dental and vision insurance
  • Lunch stipends
  • Fully stocked kitchens
  • Happy hours
  • Great location
  • Amazing views
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Data Integration & JVM Ecosystem

The Connectors team is the bridge between ClickHouse and the entire data ecosyst...
Location
Location
Germany
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of software development experience focusing on building and delivering high-quality, data-intensive solutions
  • Proven experience with the internals of at least one of the following technologies: Apache Spark, Apache Flink, Kafka Connect, or Apache Beam
  • Experience developing or extending connectors, sinks, or sources for at least one big data processing framework such as Apache Spark, Flink, Beam, or Kafka Connect
  • Strong understanding of database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases
  • A track record of building scalable data integration systems (beyond simple ETL jobs)
  • Strong proficiency in Java and the JVM ecosystem, including deep knowledge of memory management, garbage collection tuning, and performance profiling
  • Solid experience with concurrent programming in Java, including threads, executors, and reactive or asynchronous patterns
  • Outstanding written and verbal communication skills to collaborate effectively within the team and across engineering functions
  • Understanding of JDBC, network protocols (TCP/IP, HTTP), and techniques for optimizing data throughput over the wire
  • Passion for open-source development
Job Responsibility
Job Responsibility
  • Own and maintain critical parts of ClickHouse's Data engineering ecosystem
  • Own the full lifecycle of data framework integrations - from the core database driver to SDKs and connectors
  • Build the foundation that thousands of Data engineers rely on for their most critical data workloads
  • Collaborate closely with the open-source community, internal teams, and enterprise users to ensure our JVM integrations set the standard for performance, reliability, and developer experience
What we offer
What we offer
  • Flexible work environment - ClickHouse is a globally distributed company and remote-friendly
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – opportunities to engage with colleagues at company-wide offsites
Read More
Arrow Right

Senior Software Engineer - Data Integration & JVM Ecosystem

The Connectors team is the bridge between ClickHouse and the entire data ecosyst...
Location
Location
United Kingdom
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of software development experience focusing on building and delivering high-quality, data-intensive solutions
  • Proven experience with the internals of at least one of the following technologies: Apache Spark, Apache Flink, Kafka Connect, or Apache Beam
  • Experience developing or extending connectors, sinks, or sources for at least one big data processing framework such as Apache Spark, Flink, Beam, or Kafka Connect
  • Strong understanding of database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases
  • A track record of building scalable data integration systems (beyond simple ETL jobs)
  • Strong proficiency in Java and the JVM ecosystem, including deep knowledge of memory management, garbage collection tuning, and performance profiling
  • Solid experience with concurrent programming in Java, including threads, executors, and reactive or asynchronous patterns
  • Outstanding written and verbal communication skills to collaborate effectively within the team and across engineering functions
  • Understanding of JDBC, network protocols (TCP/IP, HTTP), and techniques for optimizing data throughput over the wire
  • Passion for open-source development
Job Responsibility
Job Responsibility
  • Serve as a core contributor, owning and maintaining critical parts of ClickHouse's Data engineering ecosystem
  • Own the full lifecycle of data framework integrations - from the core database driver that handles billions of records per second, to SDKs and connectors that make ClickHouse feel native in JVM-based applications
  • Build the foundation that thousands of Data engineers rely on for their most critical data workloads
  • Collaborate closely with the open-source community, internal teams, and enterprise users to ensure our JVM integrations set the standard for performance, reliability, and developer experience
What we offer
What we offer
  • Flexible work environment - ClickHouse is a globally distributed company and remote-friendly. We currently operate in 20 countries
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites
  • Fulltime
Read More
Arrow Right

Software Engineer

Location
Location
Canada , Toronto
Salary
Salary:
Not provided
advancedtechsearch.com Logo
Advanced Technology Search Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science or related Engineering field from an accredited university
  • 8 to 10 years of software development experience using various languages such as C++ (C++11 or C++17), C, Python, Java
  • C++ and C are required
  • Minimum of 4 years of experience as a Software Architect or similar role
  • GPU programming experience is required
  • Work with software frameworks, for example – QT, and/or experience with developing own framework
  • Strong understanding and familiarity with JSON and XML
  • Experience designing and developing user interfaces
  • Knowledgeable or experience with embedded software design, Linux, real-time operating systems, network protocols and industrial communication protocols MODBUS, PROFINET and PROFIBUS
  • Work collaboratively with cross-functional teams and management to collect requirements, identify tasks, provide estimates and meet deadlines
Job Responsibility
Job Responsibility
  • Responsible for creating scalable and sustainable software architecture, design, and implementation to guide the development team and collaborating with other professionals to determine functional and non-functional requirements for systems and applications
  • Lead software development projects and provides software design support and guidance on development of new and existing products, evaluates, reviews, and supports customer, sales, and production design requests
  • Develop and implement product specifications
  • Document all aspects of the system or application
  • Identify solutions to new application opportunities
  • Identify designs to support new product enhancements
  • Support design maintenance projects such as: product quality, continuous improvement, and obsolescence (integration with new HW platforms, CPUs, Operating systems, etc.)
  • Train engineering staff in support of optimizing the operation and application of new and existing products
  • Provide technical assistance/support, dealing with software design
  • Provide sales training on all new and/or existing products, when assigned
  • Fulltime
Read More
Arrow Right