BIGBALLON / distribuuuu

Related projects ⓘ

Alternatives and complementary repositories for distribuuuu

• rentainhe / pytorch-distributed-training
  Simple tutorials on Pytorch DDP training
  ☆262Updated 2 years ago
• Link-Li / Balanced-DataParallel
  这里是改进了pytorch的DataParallel, 用来平衡第一个GPU的显存使用量
  ☆231Updated 4 years ago
• serend1p1ty / core-pytorch-utils
  Yet another PyTorch Trainer and some core components for deep learning.
  ☆205Updated 6 months ago
• simtony / mlrunner
  A light-weight script for maintaining a LOT of machine learning experiments.
  ☆89Updated last year
• godweiyang / GrabGPU
  Grab GPU whenever available
  ☆278Updated 2 years ago
• tczhangzhi / pytorch-distributed
  A quickstart and benchmark for pytorch distributed training.
  ☆1,634Updated 3 months ago
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆75Updated 7 months ago
• Lyken17 / pytorch-memonger
  Sublinear memory optimization for deep learning. https://arxiv.org/abs/1604.06174
  ☆589Updated 4 years ago
• lartpang / PyTorchTricks
  Some tricks of pytorch...
  ☆1,156Updated 4 months ago
• dvlab-research / ReviewKD
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆261Updated last year
• DeepVAC / deepvac
  PyTorch Project Specification.
  ☆665Updated 3 years ago
• FlyEgle / MAE-pytorch
  Masked Autoencoders Are Scalable Vision Learners
  ☆247Updated last year
• Gsunshine / Enjoy-Hamburger
  [ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?
  ☆325Updated 2 years ago
• zihangJiang / TokenLabeling
  Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers"
  ☆426Updated last year
• demuxin / pytorch_tricks
  some tircks for PyTorch
  ☆578Updated 4 years ago
• lucidrains / FLASH-pytorch
  Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
  ☆347Updated last year
• louis-she / torchscript-demos
  A brief of TorchScript by MNIST
  ☆105Updated 2 years ago
• DingXiaoH / RepMLP
  RepMLPNet: Hierarchical Vision MLP with Re-parameterized Locality (CVPR 2022)
  ☆302Updated last year
• xyupeng / ContrastiveCrop
  [CVPR 2022 Oral] Crafting Better Contrastive Views for Siamese Representation Learning
  ☆284Updated 2 years ago
• sisrfeng / n_gpu
  📊 A simple command-line utility for querying and monitoring GPU status
  ☆88Updated last year
• OpenNLPLab / cosFormer
  [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
  ☆179Updated last year
• CYang828 / transformer-all-in-one
  ☆262Updated 3 years ago
• ziplab / SN-Net
  [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".
  ☆243Updated last year
• MegEngine / RepLKNet
  Official MegEngine implementation of RepLKNet
  ☆267Updated 2 years ago
• scilearner / papernotclear
  蜻蜓点论文 Think不Clear， 论文解读视频上传B站， youtube， 西瓜视频（同步到抖音）
  ☆239Updated 11 months ago
• WangHuiNEU / Transformer_Knowlegde
  从底层机理了解Transformer
  ☆25Updated 2 years ago
• Mountchicken / Efficient-Deep-Learning
  A bag of tricks to speed up your deep learning process
  ☆150Updated 6 months ago
• tczhangzhi / awesome-normalization-techniques
  Papers for normalization techniques, released codes collections.
  ☆226Updated 4 years ago
• zeke-xie / adaptive-inertia-adai
  [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Dise…
  ☆141Updated last year
• zhihou7 / BatchFormer
  CVPR2022, BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learning, https://arxiv.org/abs/2203.01522
  ☆248Updated last year