Alternatives and similar repositories for DDP-Tutorial:

Users that are interested in DDP-Tutorial are comparing it to the libraries listed below

• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆87Updated 10 months ago
• chunhuizhang / pytorch_distribute_tutorials
  pytorch distribute tutorials
  ☆101Updated 3 months ago
• rickyang1114 / DDP-practice
  A demo of image classification with PyTorch DDP (DistributedDataParallel) and AMP (Automatic Mixed Precision) modules.
  ☆59Updated 10 months ago
• wangxiao5791509 / MultiModal_BigModels_Survey
  [MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models
  ☆284Updated 2 weeks ago
• WillDreamer / Aurora
  [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model
  ☆85Updated last year
• hhaAndroid / awesome-mm-chat
  多模态 MM +Chat 合集
  ☆238Updated 3 weeks ago
• rentainhe / pytorch-distributed-training
  Simple tutorials on Pytorch DDP training
  ☆272Updated 2 years ago
• jianghaojun / Awesome-Parameter-Efficient-Transfer-Learning
  A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.
  ☆396Updated 4 months ago
• godweiyang / GrabGPU
  一款便捷的抢占显卡脚本
  ☆298Updated last week
• wdndev / mllm_interview_note
  主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识
  ☆118Updated 8 months ago
• serend1p1ty / core-pytorch-utils
  Yet another PyTorch Trainer and some core components for deep learning.
  ☆211Updated 8 months ago
• Berry-Wu / Visualization
  visualization：filter、feature map、attention map、image-mask、grad-cam、human keypoint、guided-backpro
  ☆106Updated last year
• Tramac / paper-reading-note
  和李沐一起读论文
  ☆147Updated 3 weeks ago
• wanng-ide / VQA_to_multimodal_survey
  Update 2020
  ☆75Updated 2 years ago
• BIGBALLON / distribuuuu
  The pure and clear PyTorch Distributed Training Framework.
  ☆275Updated last year
• yzd-v / cls_KD
  'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)
  ☆223Updated last year
• HongxinXiang / pytorch-multi-GPU-training-tutorial
  ☆65Updated 2 years ago
• bobo0810 / LearnDeepSpeed
  DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
  ☆146Updated last year
• wilmerwang / GPUSnatcher
  抢占显卡
  ☆63Updated 3 months ago
• ziplab / SN-Net
  [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".
  ☆247Updated last year
• WeiHongLee / Awesome-Multi-Task-Learning
  An up-to-date list of works on Multi-Task Learning
  ☆325Updated 2 months ago
• zhengli97 / PromptKD
  [CVPR 2024] Official PyTorch Code for "PromptKD: Unsupervised Prompt Distillation for Vision-Language Models"
  ☆263Updated last month
• GeWu-Lab / OGM-GE_CVPR2022
  The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)
  ☆252Updated 3 weeks ago
• yfzhang114 / Awesome-Multimodal-Large-Language-Models
  Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models
  ☆238Updated 3 weeks ago
• yueyang2000 / CKA_minibatch_pytorch
  Pytorch implementation of Centered Kernel Alignment(CKA) and its minibatch version.
  ☆11Updated 2 years ago
• Link-Li / Balanced-DataParallel
  这里是改进了pytorch的DataParallel, 用来平衡第一个GPU的显存使用量
  ☆230Updated 4 years ago
• luo3300612 / Visualizer
  assistant tools for attention visualization in deep learning
  ☆1,080Updated 2 years ago
• YiLunLee / missing_aware_prompts
  Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23
  ☆189Updated last year
• hirl-team / HCSC
  [CVPR 2022] PyTorch implementation of Hierarchical Contrastive Selective Coding (HCSC) (https://arxiv.org/abs/2202.00455)
  ☆130Updated 2 years ago
• CupidJay / Training-Vision-Transformers-with-only-2040-images
  Official PyTorch implementation of training vision transformers with only 2040 images.
  ☆52Updated 2 years ago