Alternatives and similar repositories for pytorch_distributed

Users that are interested in pytorch_distributed are comparing it to the libraries listed below

• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆90Updated 2 years ago
• lvyufeng / easy_mindspore_bk
  ☆18Updated 3 years ago
• L1aoXingyu / llm-infer-bench
  ☆12Updated 2 years ago
• yester31 / Cutlass_EX
  study of cutlass
  ☆22Updated last year
• HFAiLab / BEVFormer
  ☆19Updated 3 years ago
• Azure-Vision / SuperDebug
  SuperDebug，debug如此简单！
  ☆17Updated 3 years ago
• HFAiLab / hfai-models
  HFAI deep learning models
  ☆156Updated 2 years ago
• li199603 / sgemm_with_cuda
  SGEMM optimization with cuda step by step
  ☆21Updated last year
• DeepLink-org / CVFusion
  CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.
  ☆33Updated 3 years ago
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 3 years ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆134Updated 2 years ago
• bojone / softtopk
  differentiable top-k operator
  ☆22Updated last year
• marsggbo / NAS-LID
  [AAAI2023] NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension
  ☆17Updated 3 years ago
• Syencil / Programming_Massively_Parallel_Processors
  CUDA 6大并行计算模式 代码与笔记
  ☆61Updated 5 years ago
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆18Updated last year
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated 2 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• JerryYin777 / Cross-Layer-Attention
  Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)
  ☆18Updated last year
• Crisescode / distributed-training-dl
  各种深度学习（DL）框架分布式训练，包括：Tensorflow、Tensorflow2、Pytorch、Chainer、Caffe、Mxnet ...
  ☆22Updated 5 years ago
• DeepVAC / TorchPod
  跨平台的容器化Linux桌面环境
  ☆73Updated 10 months ago
• Oneflow-Inc / oneflow-lite
  ☆18Updated 2 years ago
• wangsiping97 / GPU-Tutorials
  Tutorials to GPU programming. Reading notes.
  ☆18Updated 2 years ago
• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆238Updated 3 years ago
• UoS-EEC / DynamicOFA
  [CVPRW 2021] Dynamic-OFA: Runtime DNN Architecture Switching for Performance Scaling on Heterogeneous Embedded Platforms
  ☆30Updated 3 years ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆16Updated 5 months ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated 2 years ago
• suquark / llm4phd
  Examples and instructions about use LLMs (especially ChatGPT) for PhD
  ☆107Updated 2 years ago
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆123Updated 2 years ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆41Updated last year
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆133Updated 2 years ago