rickyang1114 / DDP-practice
A demo of image classification with PyTorch DDP (DistributedDataParallel) and AMP (Automatic Mixed Precision) modules.
☆65Updated last year
Alternatives and similar repositories for DDP-practice:
Users that are interested in DDP-practice are comparing it to the libraries listed below
- ☆62Updated 3 years ago
- ☆221Updated last month
- pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用☆98Updated last year
- visualization：filter、feature map、attention map、image-mask、grad-cam、human keypoint、guided-backpro☆117Updated 2 years ago
- ☆83Updated last year
- 蜻蜓点论文 Think不Clear， 论文解读视频上传B站， youtube， 西瓜视频（同步到抖音）☆243Updated last year
- The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)☆46Updated last month
- DeepSpeed Tutorial☆95Updated 8 months ago
- Quality-aware multimodal fusion on ICML 2023☆98Updated last month
- GroupMixAttention and GroupMixFormer☆115Updated last year
- CVPR2022, BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learning, https://arxiv.org/abs/2203.01522☆250Updated last year
- ☆122Updated last year
- [ICCV2023] This is an official implementation for "Scale-Aware Modulation Meet Transformer".☆200Updated last year
- [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model☆86Updated last year
- To be the world's best PyTorch project template.☆505Updated 2 years ago
- [ICML 2024] Official PyTorch implementation of "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-paramete…☆104Updated 8 months ago
- 这是一个DiT-pytorch的代码，主要用于学习DiT结构。☆75Updated last year
- ☆36Updated 9 months ago
- Implementation of AAAI 2022 Paper: Go wider instead of deeper☆32Updated 2 years ago
- A list of papers, codes and applications on multi-task learning.☆69Updated last month
- 多模态 MM +Chat 合集☆255Updated 2 months ago
- ☆146Updated last year
- 《Deep Learning Tuning Playbook》中文翻译版本☆125Updated last year
- How to use wandb?☆635Updated last year
- Vision Mamba: A Comprehensive Survey and Taxonomy☆90Updated 7 months ago
- AAAI 2022 papers with code☆37Updated 3 years ago
- Official repository of MLLA (NeurIPS 2024)☆312Updated 5 months ago
- 🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)☆75Updated 11 months ago
- This repository periodicly updates the MTL paper and resources☆52Updated this week
- The official repo for CVPR2023 highlight paper "Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization".☆82Updated last year