Alternatives and similar repositories for pytorch_distributed_training

Users that are interested in pytorch_distributed_training are comparing it to the libraries listed below

• luxuantao / advanced_LLM_interview_notes
  大模型进阶面经
  ☆72Updated 4 months ago
• cnstark / gputasker
  An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star
  ☆191Updated 3 years ago
• FengHZ / mixupfamily
  The implementation of mixup and mainfold mixup method with standard models(PreActRes, WideRes, Dense) in Cifar10, Cifar100 and SVHN datas…
  ☆48Updated 3 years ago
• Joining-AI / LLM_Interview_Prepare
  本仓库是关于大模型面试中常见面试试题和面试经验的整理。这里收集了各类与大模型相关的面试题目，并提供详细的解答和分析。本仓库由上海交大交影社区维护
  ☆103Updated last year
• KaiiZhang / DDP-Tutorial
  ☆65Updated 3 years ago
• scilearner / papernotclear
  蜻蜓点论文 Think不Clear， 论文解读视频上传B站， youtube， 西瓜视频（同步到抖音）
  ☆249Updated last year
• zhxchd / SDAR_SplitNN
  Code for NDSS '25 paper "Passive Inference Attacks on Split Learning via Adversarial Regularization"
  ☆11Updated last year
• OPTML-Group / Robust-MoE-CNN
  [ICCV23] Robust Mixture-of-Expert Training for Convolutional Neural Networks by Yihua Zhang, Ruisi Cai, Tianlong Chen, Guanhua Zhang, Hua…
  ☆62Updated 2 years ago
• junfish / Awesome-Multitask-Learning
  This repository periodicly updates the MTL paper and resources
  ☆65Updated 2 months ago
• Chivier / YA-PapersWithCode
  Yet Another Papers With Code
  ☆31Updated 3 weeks ago
• SilenceEagle / paper_downloader
  Download papers and supplemental materials from open-access paper website, such as AAAI, AAMAS, AISTATS, COLT, CORL, CVPR, ECCV, ICCV, IC…
  ☆277Updated 2 months ago
• liujunwen23 / MIRE
  WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge
  ☆125Updated 10 months ago
• ascetic-monk / Homework_in_UCAS
  包含在中国科学院大学雁栖湖校区研一上半学期课程作业，共四个课程
  ☆41Updated 5 years ago
• MLNLP-World / Academic-Resume-Template
  学术双语简历模板，涵盖教育背景、论文发表、项目经历、竞赛经历和个人陈述等关键部分，可适用于申请研究生项目、学术职位或相关行业岗位。
  ☆127Updated 3 months ago
• wilmerwang / GPUSitter
  Watch for idle GPUs and run your jobs: launches jobs in tmux, keeps logs/status and sends start/finish emails..
  ☆79Updated 2 weeks ago
• owenliang / bpe-tokenizer
  LLM Tokenizer with BPE algorithm
  ☆39Updated last year
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory
  ☆188Updated 2 months ago
• OvJat / DeepSpeedTutorial
  DeepSpeed Tutorial
  ☆102Updated last year
• IvanaXu / TianChiProj
  🏆🥈🥉 TianChi/天池 AIStudio Kaggle iFLYTEKAI...
  ☆74Updated last year
• jeffrey86 / 100-interview-for-deeplearning-learning
  百面深度学习-学习
  ☆85Updated 4 years ago
• atuannguyen / FedSR
  ☆28Updated 2 years ago
• ccfddl / ccfddl.github.io
  ☆37Updated this week
• TUDB-Labs / Awesome-LLM-LoRA
  ☆16Updated last year
• wdndev / mllm_interview_note
  主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识
  ☆246Updated last year
• rickyang1114 / DDP-practice
  A demo of image classification with PyTorch DDP (DistributedDataParallel) and AMP (Automatic Mixed Precision) modules.
  ☆70Updated last year
• ZJU-LLMs / Awesome-LoRAs
  ☆214Updated last year
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆64Updated last year
• MLGroup-JLU / LLM-data-aug-survey
  The official GitHub page for the survey paper "A Survey on Data Augmentation in Large Model Era"
  ☆128Updated last year
• SamuelGong / grad_attacks
  Self-Teaching Notes on Gradient Leakage Attacks against GPT-2 models.
  ☆12Updated last year
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆222Updated 10 months ago