Alternatives and similar repositories for pytorch-distributed-training:

Users that are interested in pytorch-distributed-training are comparing it to the libraries listed below

• BIGBALLON / distribuuuu
  The pure and clear PyTorch Distributed Training Framework.
  ☆275Updated last year
• serend1p1ty / core-pytorch-utils
  Yet another PyTorch Trainer and some core components for deep learning.
  ☆211Updated 8 months ago
• Link-Li / Balanced-DataParallel
  这里是改进了pytorch的DataParallel, 用来平衡第一个GPU的显存使用量
  ☆230Updated 4 years ago
• FlyEgle / MAE-pytorch
  Masked Autoencoders Are Scalable Vision Learners
  ☆247Updated last year
• godweiyang / GrabGPU
  一款便捷的抢占显卡脚本
  ☆298Updated last week
• simtony / mlrunner
  A light-weight script for maintaining a LOT of machine learning experiments.
  ☆91Updated 2 years ago
• tczhangzhi / pytorch-distributed
  A quickstart and benchmark for pytorch distributed training.
  ☆1,650Updated 6 months ago
• raoyongming / DynamicViT
  [NeurIPS 2021] [T-PAMI] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification
  ☆589Updated last year
• lartpang / PyTorchTricks
  Some tricks of pytorch...
  ☆1,178Updated 7 months ago
• Gsunshine / Enjoy-Hamburger
  [ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?
  ☆330Updated 2 years ago
• KaiiZhang / DDP-Tutorial
  ☆60Updated 2 years ago
• xyupeng / ContrastiveCrop
  [CVPR 2022 Oral] Crafting Better Contrastive Views for Siamese Representation Learning
  ☆286Updated 2 years ago
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆87Updated 10 months ago
• MegEngine / RepLKNet
  Official MegEngine implementation of RepLKNet
  ☆273Updated 2 years ago
• zhihou7 / BatchFormer
  CVPR2022, BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learning, https://arxiv.org/abs/2203.01522
  ☆248Updated last year
• louis-she / torchscript-demos
  A brief of TorchScript by MNIST
  ☆107Updated 2 years ago
• clovaai / attention-feature-distillation
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆118Updated 3 years ago
• MrYxJ / calculate-flops.pytorch
  The calflops is designed to calculate FLOPs、MACs and Parameters in all various neural networks, such as Linear、 CNN、 RNN、 GCN、Transformer…
  ☆667Updated 7 months ago
• open-mmlab / awesome-vit
  ☆423Updated 2 years ago
• ylsung / Ladder-Side-Tuning
  PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"
  ☆234Updated 2 years ago
• Alpha-VL / ConvMAE
  ConvMAE: Masked Convolution Meets Masked Autoencoders
  ☆490Updated last year
• tczhangzhi / awesome-normalization-techniques
  Papers for normalization techniques, released codes collections.
  ☆224Updated 4 years ago
• rentainhe / visualization
  a collection of visualization function
  ☆399Updated 3 years ago
• ucasligang / awesome-MIM
  Reading list for research topics in Masked Image Modeling
  ☆331Updated last month
• yuanli2333 / Teacher-free-Knowledge-Distillation
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆583Updated last year
• irfanICMLL / TorchDistiller
  ☆193Updated 3 years ago
• szq0214 / FKD
  Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
  ☆182Updated 9 months ago
• ziplab / SN-Net
  [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".
  ☆247Updated last year
• WeiHongLee / Awesome-Multi-Task-Learning
  An up-to-date list of works on Multi-Task Learning
  ☆325Updated 2 months ago
• sisrfeng / n_gpu
  📊 A simple command-line utility for querying and monitoring GPU status
  ☆88Updated 2 years ago