Alternatives and similar repositories for NCCL:

Users that are interested in NCCL are comparing it to the libraries listed below

• intel / onnxruntime
  ONNX Runtime: cross-platform, high performance scoring engine for ML models
  ☆61Updated this week
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• ROCm / AMDMIGraphX
  AMD's graph optimization engine.
  ☆215Updated this week
• OpenPPL / CuAssembler
  An unofficial cuda assembler, for all generations of SASS, hopefully ：）
  ☆82Updated 2 years ago
• NVlabs / cub
  THIS REPOSITORY HAS MOVED TO github.com/nvidia/cub, WHICH IS AUTOMATICALLY MIRRORED HERE.
  ☆84Updated last year
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆62Updated last week
• bdhirsh / pytorch_open_registration_example
  Example of using pytorch's open device registration API
  ☆29Updated 2 years ago
• daquexian / faster-rwkv
  ☆124Updated last year
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆91Updated 6 years ago
• NVIDIA / nsight-training
  Training material for Nsight developer tools
  ☆156Updated 8 months ago
• DeepLink-org / CVFusion
  CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.
  ☆29Updated 2 years ago
• XiaoMi / nnlib
  Fork of https://source.codeaurora.org/quic/hexagon_nn/nnlib
  ☆57Updated 2 years ago
• deepspeedai / DeepSpeed-Kernels
  ☆68Updated 3 weeks ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆62Updated last month
• JieRen98 / SGEMM-SASS-Annotation
  ☆20Updated 4 years ago
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆69Updated last year
• ROCm / TransformerEngine
  ☆29Updated this week
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆43Updated 2 years ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆108Updated 7 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆94Updated 2 weeks ago
• masahi / torchscript-to-tvm
  ☆69Updated 2 years ago
• BBuf / how-to-optimize-gemm
  ☆96Updated 3 years ago
• ROCm / MISA
  Machine Intelligence Shader Autogen. AMDGPU ML shader code generator. (previously iGEMMgen)
  ☆34Updated this week
• amd / UIF
  ☆60Updated last year
• Oneflow-Inc / oneflow-lite
  ☆18Updated last year
• XiuYuLi / flexible-gemm
  flexible-gemm conv of deepcore
  ☆17Updated 5 years ago
• Intel-tensorflow / tensorflow
  Computation using data flow graphs for scalable machine learning
  ☆67Updated this week
• BBuf / tensorrt-llm-moe
  ☆28Updated 2 months ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆57Updated last week
• mmperf / mmperf
  MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.
  ☆130Updated last year