lunan0320 / pytorch_distributed_trainingLinks
最新pytorch分布式训练,单机多卡,多机多卡整理(多GPU)
☆16Updated last year
Alternatives and similar repositories for pytorch_distributed_training
Users that are interested in pytorch_distributed_training are comparing it to the libraries listed below
Sorting:
- DeepSpeed Tutorial☆97Updated 9 months ago
- repo in several methods FedAvg, FedMD, FedProto, FedProx, FedHKD.☆21Updated last year
- ☆105Updated 11 months ago
- [ACM EuroSys'24] Dordis: Efficient Federated Learning with Dropout-Resilient Differential Privacy☆24Updated last month
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆123Updated 6 months ago
- "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.☆34Updated last year
- 该仓库主要记录 大模型(LLMs) 算法工程师相关的面试题与我写的答案☆24Updated last year
- ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory☆95Updated last month
- ☆62Updated 3 years ago
- 大模型进阶面经☆51Updated last month
- ☆35Updated this week
- ☆28Updated 2 years ago
- LLM Tokenizer with BPE algorithm☆31Updated last year
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆125Updated last year
- 和李沐一起读论文☆196Updated this week
- ☆17Updated 3 months ago
- 这是我的博客《不用框架,使用Python搭建基于numpy的卷积神经网络来进行cifar-10分类的深度学习系统》的代码实现。☆10Updated 5 years ago
- FInetuning CLIP for Few Shot Learning☆42Updated 3 years ago
- ☆78Updated 8 months ago
- [ICCV23] Robust Mixture-of-Expert Training for Convolutional Neural Networks by Yihua Zhang, Ruisi Cai, Tianlong Chen, Guanhua Zhang, Hua…☆56Updated last year
- 百面深度学习-学习☆81Updated 4 years ago
- [SIGIR'24] The official implementation code of MOELoRA.☆167Updated 10 months ago
- ☆49Updated 3 years ago
- A model demo which uses ResNet18 as the backbone to do image recognition tasks.Using Pytorch.☆60Updated 4 years ago
- 动手训练一个简单的CLIP模型,加深对CLIP的理解。☆11Updated 2 weeks ago
- [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model☆86Updated last year