Alternatives and similar repositories for pytorch-distributed-training

Users that are interested in pytorch-distributed-training are comparing it to the libraries listed below

• BIGBALLON / distribuuuu
  The pure and clear PyTorch Distributed Training Framework.
  ☆276Updated last year
• serend1p1ty / core-pytorch-utils
  Yet another PyTorch Trainer and some core components for deep learning.
  ☆217Updated last year
• Link-Li / Balanced-DataParallel
  这里是改进了pytorch的DataParallel, 用来平衡第一个GPU的显存使用量
  ☆232Updated 4 years ago
• tczhangzhi / pytorch-distributed
  A quickstart and benchmark for pytorch distributed training.
  ☆1,661Updated 9 months ago
• lartpang / PyTorchTricks
  Some tricks of pytorch...
  ☆1,189Updated 10 months ago
• MegEngine / RepLKNet
  Official MegEngine implementation of RepLKNet
  ☆275Updated 3 years ago
• Mountchicken / Efficient-Deep-Learning
  A bag of tricks to speed up your deep learning process
  ☆160Updated last year
• louis-she / torchscript-demos
  A brief of TorchScript by MNIST
  ☆111Updated 2 years ago
• FlyEgle / MAE-pytorch
  Masked Autoencoders Are Scalable Vision Learners
  ☆249Updated 2 years ago
• DeepVAC / deepvac
  PyTorch Project Specification.
  ☆679Updated 3 years ago
• DingXiaoH / RepMLP
  RepMLPNet: Hierarchical Vision MLP with Re-parameterized Locality (CVPR 2022)
  ☆306Updated 2 years ago
• simtony / mlrunner
  A light-weight script for maintaining a LOT of machine learning experiments.
  ☆91Updated 2 years ago
• xyupeng / ContrastiveCrop
  [CVPR 2022 Oral] Crafting Better Contrastive Views for Siamese Representation Learning
  ☆286Updated 2 years ago
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆99Updated last year
• Alpha-VL / ConvMAE
  ConvMAE: Masked Convolution Meets Masked Autoencoders
  ☆504Updated 2 years ago
• Meituan-AutoML / CPVT
  ☆190Updated 2 years ago
• Gsunshine / Enjoy-Hamburger
  [ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?
  ☆332Updated 2 years ago
• jia-zhuang / pytorch-multi-gpu-training
  整理 pytorch 单机多 GPU 训练方法与原理
  ☆822Updated 3 years ago
• raoyongming / DynamicViT
  [NeurIPS 2021] [T-PAMI] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification
  ☆604Updated last year
• Meituan-AutoML / Twins
  Two simple and effective designs of vision transformer, which is on par with the Swin transformer
  ☆601Updated 2 years ago
• ucasligang / awesome-MIM
  Reading list for research topics in Masked Image Modeling
  ☆333Updated 5 months ago
• Atten4Vis / DemystifyLocalViT
  Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight
  ☆184Updated 2 years ago
• changlin31 / DS-Net
  (CVPR 2021, Oral) Dynamic Slimmable Network
  ☆229Updated 3 years ago
• zihangJiang / TokenLabeling
  Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers"
  ☆427Updated last year
• godweiyang / GrabGPU
  一款便捷的抢占显卡脚本
  ☆330Updated 3 months ago
• lucidrains / FLASH-pytorch
  Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
  ☆362Updated last year
• rentainhe / visualization
  a collection of visualization function
  ☆432Updated 3 years ago
• tczhangzhi / awesome-normalization-techniques
  Papers for normalization techniques, released codes collections.
  ☆226Updated 4 years ago
• irfanICMLL / TorchDistiller
  ☆191Updated 3 years ago
• dvlab-research / ReviewKD
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆270Updated 2 years ago