rickyang1114 / DDP-practice
A demo of image classification with PyTorch DDP (DistributedDataParallel) and AMP (Automatic Mixed Precision) modules.
☆60Updated 11 months ago
Alternatives and similar repositories for DDP-practice:
Users that are interested in DDP-practice are comparing it to the libraries listed below
- ☆62Updated 2 years ago
- visualization:filter、feature map、attention map、image-mask、grad-cam、human keypoint、guided-backpro☆108Updated last year
- DeepSpeed Tutorial☆95Updated 6 months ago
- [MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models☆286Updated this week
- How to use wandb?☆611Updated last year
- 蜻蜓点论文 Think不Clear, 论文解读视频上传B站, youtube, 西瓜视频(同步到抖音)☆242Updated last year
- ☆207Updated 5 months ago
- Implementation of Denoising Diffusion Probabilistic Model in MindSpore☆35Updated 2 years ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆114Updated 3 months ago
- 关于Transformer模型的最简洁pytorch实现,包含详细注释☆175Updated last year
- Quality-aware multimodal fusion on ICML 2023☆89Updated 2 months ago
- ☆18Updated 10 months ago
- [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)☆119Updated 11 months ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆121Updated 9 months ago
- 深度学习/计算机视觉/多模态/机器学习/人工智能零基础理论/实战教程汇总分享☆136Updated 2 years ago
- 这是一个DiT-pytorch的代码,主要用于学习DiT结构。☆72Updated 11 months ago
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆160Updated 2 months ago
- ☆117Updated last year
- [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model☆85Updated last year
- Implementation of AAAI 2022 Paper: Go wider instead of deeper☆32Updated 2 years ago
- ☆42Updated last month
- pytorch单精度、半精度、混合精度、单卡、多卡(DP / DDP)、FSDP、DeepSpeed模型训练代码,并对比不同方法的训练速度以及GPU内存的使用☆87Updated 11 months ago
- Some survey and tools of ChatGPT or ChatGPT-Style Model☆94Updated last year
- ☆274Updated last week
- 和李沐一起读论文☆167Updated last month
- ☆84Updated 2 years ago
- The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning☆39Updated 6 months ago
- ☆33Updated last year
- ICLR 2024 论文和开源项目合集☆161Updated 9 months ago
- ☆33Updated 6 months ago