Alternatives and similar repositories for pytorch_distributed

Users that are interested in pytorch_distributed are comparing it to the libraries listed below

• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆87Updated last year
• yester31 / Cutlass_EX
  study of cutlass
  ☆22Updated 9 months ago
• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆230Updated 2 years ago
• L1aoXingyu / llm-infer-bench
  ☆11Updated 2 years ago
• DeepLink-org / CVFusion
  CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.
  ☆31Updated 3 years ago
• Crisescode / distributed-training-dl
  各种深度学习（DL）框架分布式训练，包括：Tensorflow、Tensorflow2、Pytorch、Chainer、Caffe、Mxnet ...
  ☆21Updated 5 years ago
• li199603 / sgemm_with_cuda
  SGEMM optimization with cuda step by step
  ☆20Updated last year
• xcyuyuyu / My-First-CUDA-Code
  The introduction to cuda, a simple and easy cuda project
  ☆22Updated 3 years ago
• Azure-Vision / SuperDebug
  SuperDebug，debug如此简单！
  ☆17Updated 3 years ago
• HFAiLab / hfai-models
  HFAI deep learning models
  ☆150Updated 2 years ago
• bojone / softtopk
  differentiable top-k operator
  ☆22Updated 8 months ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆121Updated last year
• JieRen98 / SGEMM-SASS-Annotation
  ☆21Updated 4 years ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆130Updated 2 years ago
• chncwang / InsNet
  InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
  ☆66Updated 3 years ago
• yuandong-tian / scheduler2
  ☆100Updated 3 years ago
• attention-survey / Efficient_Attention_Survey
  A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention
  ☆172Updated last week
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆17Updated 9 months ago
• PaddlePaddle / PaDiff
  Paddle Automatically Diff Precision Toolkits.
  ☆50Updated this week
• microsoft / AttentionEngine
  ☆92Updated 3 months ago
• feifeibear / PyTorchMemTracer
  Depict GPU memory footprint during DNN training of PyTorch
  ☆11Updated 2 years ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated 2 years ago
• sharonzhou / ICLR2021-Stats
  ICLR 2021 Stats & Graphs
  ☆31Updated 3 years ago
• Syencil / Programming_Massively_Parallel_Processors
  CUDA 6大并行计算模式 代码与笔记
  ☆60Updated 5 years ago
• Oneflow-Inc / oneflow-lite
  ☆18Updated last year
• lvyufeng / easy_mindspore_bk
  ☆18Updated 2 years ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated 2 years ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆25Updated 3 years ago