Alternatives and similar repositories for distribuuuu

Users that are interested in distribuuuu are comparing it to the libraries listed below

• rentainhe / pytorch-distributed-training
  Simple tutorials on Pytorch DDP training
  ☆279Updated 2 years ago
• Link-Li / Balanced-DataParallel
  这里是改进了pytorch的DataParallel, 用来平衡第一个GPU的显存使用量
  ☆232Updated 4 years ago
• serend1p1ty / core-pytorch-utils
  Yet another PyTorch Trainer and some core components for deep learning.
  ☆217Updated last year
• simtony / mlrunner
  A light-weight script for maintaining a LOT of machine learning experiments.
  ☆91Updated 2 years ago
• Lyken17 / pytorch-memonger
  Sublinear memory optimization for deep learning. https://arxiv.org/abs/1604.06174
  ☆598Updated 5 years ago
• godweiyang / GrabGPU
  一款便捷的抢占显卡脚本
  ☆334Updated 4 months ago
• tczhangzhi / pytorch-distributed
  A quickstart and benchmark for pytorch distributed training.
  ☆1,666Updated 10 months ago
• louis-she / torchscript-demos
  A brief of TorchScript by MNIST
  ☆112Updated 2 years ago
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆100Updated last year
• lartpang / PyTorchTricks
  Some tricks of pytorch...
  ☆1,191Updated 11 months ago
• PaddlePaddle / PASSL
  PASSL包含 SimCLR，MoCo v1/v2，BYOL，CLIP，PixPro，simsiam, SwAV, BEiT，MAE 等图像自监督算法以及 Vision Transformer，DEiT，Swin Transformer，CvT，T2T-ViT，MLP-…
  ☆281Updated last year
• OpenNLPLab / cosFormer
  [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
  ☆193Updated 2 years ago
• PhilJd / contiguous_pytorch_params
  Accelerate training by storing parameters in one contiguous chunk of memory.
  ☆291Updated 4 years ago
• DeepVAC / deepvac
  PyTorch Project Specification.
  ☆679Updated 3 years ago
• lucidrains / FLASH-pytorch
  Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
  ☆363Updated last year
• seefun / TorchUtils
  (WIP) TorchUtils is a pytorch library with several useful tools and training tricks.
  ☆87Updated 2 years ago
• tczhangzhi / awesome-normalization-techniques
  Papers for normalization techniques, released codes collections.
  ☆226Updated 4 years ago
• demuxin / pytorch_tricks
  some tircks for PyTorch
  ☆576Updated 5 years ago
• Oldpan / Pytorch-Memory-Utils
  pytorch memory track code
  ☆1,018Updated 4 years ago
• open-mmlab / awesome-vit
  ☆428Updated 3 years ago
• dvlab-research / ReviewKD
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆272Updated 2 years ago
• pzhren / Awesome-NAS
  ☆196Updated 10 months ago
• sisrfeng / n_gpu
  📊 A simple command-line utility for querying and monitoring GPU status
  ☆89Updated 2 years ago
• thuml / LogME
  Code release for "LogME: Practical Assessment of Pre-trained Models for Transfer Learning" (ICML 2021) and Ranking and Tuning Pre-trained…
  ☆209Updated last year
• yuanli2333 / Teacher-free-Knowledge-Distillation
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆585Updated 2 years ago
• NUS-HPC-AI-Lab / InfoBatch
  Lossless Training Speed Up by Unbiased Dynamic Data Pruning
  ☆334Updated 8 months ago
• xyupeng / ContrastiveCrop
  [CVPR 2022 Oral] Crafting Better Contrastive Views for Siamese Representation Learning
  ☆287Updated 2 years ago
• DingXiaoH / RepMLP
  RepMLPNet: Hierarchical Vision MLP with Re-parameterized Locality (CVPR 2022)
  ☆306Updated 2 years ago
• jia-zhuang / pytorch-multi-gpu-training
  整理 pytorch 单机多 GPU 训练方法与原理
  ☆833Updated 3 years ago
• Gsunshine / Enjoy-Hamburger
  [ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?
  ☆332Updated 2 years ago