Alternatives and similar repositories for pytorch-distributed-training

Users that are interested in pytorch-distributed-training are comparing it to the libraries listed below

• BIGBALLON / distribuuuu
  The pure and clear PyTorch Distributed Training Framework.
  ☆274Updated last year
• serend1p1ty / core-pytorch-utils
  Yet another PyTorch Trainer and some core components for deep learning.
  ☆223Updated last year
• Link-Li / Balanced-DataParallel
  这里是改进了pytorch的DataParallel, 用来平衡第一个GPU的显存使用量
  ☆232Updated 4 years ago
• FlyEgle / MAE-pytorch
  Masked Autoencoders Are Scalable Vision Learners
  ☆250Updated 2 years ago
• DingXiaoH / RepMLP
  RepMLPNet: Hierarchical Vision MLP with Re-parameterized Locality (CVPR 2022)
  ☆306Updated 2 years ago
• Mountchicken / Efficient-Deep-Learning
  A bag of tricks to speed up your deep learning process
  ☆162Updated last year
• open-mmlab / awesome-vit
  ☆428Updated 3 years ago
• raoyongming / DynamicViT
  [NeurIPS 2021] [T-PAMI] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification
  ☆626Updated 2 years ago
• sisrfeng / n_gpu
  📊 A simple command-line utility for querying and monitoring GPU status
  ☆92Updated 2 years ago
• Yutong-Zhou-cv / Awesome-Transformer-in-CV
  A Survey on Transformer in CV.
  ☆192Updated 2 years ago
• Gsunshine / Enjoy-Hamburger
  [ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?
  ☆338Updated 2 years ago
• lartpang / PyTorchTricks
  Some tricks of pytorch...
  ☆1,194Updated last year
• seefun / TorchUtils
  (WIP) TorchUtils is a pytorch library with several useful tools and training tricks.
  ☆88Updated 2 years ago
• tczhangzhi / awesome-normalization-techniques
  Papers for normalization techniques, released codes collections.
  ☆227Updated 5 years ago
• godweiyang / GrabGPU
  一款便捷的抢占显卡脚本
  ☆356Updated 7 months ago
• HongxinXiang / pytorch-multi-GPU-training-tutorial
  ☆69Updated 2 years ago
• rentainhe / visualization
  a collection of visualization function
  ☆441Updated 3 years ago
• MegEngine / RepLKNet
  Official MegEngine implementation of RepLKNet
  ☆279Updated 3 years ago
• ucasligang / awesome-MIM
  Reading list for research topics in Masked Image Modeling
  ☆336Updated 9 months ago
• louis-she / torchscript-demos
  A brief of TorchScript by MNIST
  ☆113Updated 3 years ago
• dvlab-research / ReviewKD
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆276Updated 2 years ago
• szq0214 / FKD
  Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
  ☆188Updated last year
• WangFeng18 / Swin-Transformer
  Implementation of Swin Transformer with Pytorch
  ☆113Updated 4 years ago
• zhihou7 / BatchFormer
  CVPR2022, BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learning, https://arxiv.org/abs/2203.01522
  ☆251Updated 2 years ago
• OpenNLPLab / cosFormer
  [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
  ☆196Updated 2 years ago
• xyupeng / ContrastiveCrop
  [CVPR 2022 Oral] Crafting Better Contrastive Views for Siamese Representation Learning
  ☆288Updated 3 years ago
• Alpha-VL / ConvMAE
  ConvMAE: Masked Convolution Meets Masked Autoencoders
  ☆513Updated 2 years ago
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆119Updated last year
• blackfeather-wang / GFNet-Pytorch
  A general framework for inferring CNNs efficiently. Reduce the inference latency of MobileNet-V3 by 1.3x on an iPhone XS Max without sac…
  ☆184Updated 2 years ago
• lehduong / torch-warmup-lr
  Warmup learning rate wrapper for Pytorch Scheduler
  ☆41Updated 5 years ago