rickyang1114 / DDP-practice
A demo of image classification with PyTorch DDP (DistributedDataParallel) and AMP (Automatic Mixed Precision) modules.
☆52Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for DDP-practice
- ☆56Updated 2 years ago
- ICLR 2024 论文和开源项目合集☆130Updated 6 months ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆59Updated last week
- DeepSpeed Tutorial☆89Updated 3 months ago
- pytorch distribute tutorials☆83Updated last month
- [MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models☆279Updated 3 weeks ago
- ☆220Updated 7 months ago
- How to use wandb?☆596Updated last year
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆86Updated 6 months ago
- ☆148Updated this week
- pytorch单精度、半精度、混合精度、单卡、多卡(DP / DDP)、FSDP、DeepSpeed模型训练代码,并对比不同方法的训练速度以及GPU内存的使用☆77Updated 8 months ago
- 个人总结的大模型、自然语言处理NLP、多模态、计算机视觉CV等方向paper的阅读笔记;收集到或者使用到的一些NLP、CV等领域的优秀开源仓库;其他:如数据集、评测leaderboard等☆31Updated last week
- ☆197Updated 2 months ago
- 这里用来存储做人工智能项目的代码和参加数据挖掘比赛的代码☆72Updated last month
- To be the world's best PyTorch project template.☆434Updated last year
- ☆26Updated 7 months ago
- 🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)☆72Updated 6 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆230Updated 6 months ago
- 通义千问的DPO训练☆27Updated 2 months ago
- This repository will be posting analytic continual learning series, including Analytic Class-Incremental Learning (ACIL), Gaussian Kernel…☆205Updated last month
- 该仓库主要记录 大模型(LLMs) 算法工程师相关的面试题与我写的答案☆18Updated last year
- 必要的计算机科学及软件开发知识☆23Updated this week
- visualization:filter、feature map、attention map、image-mask、grad-cam、human keypoint、guided-backpro☆94Updated last year
- [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model☆83Updated 11 months ago
- Build a daily academic subscription pipeline! Get daily Arxiv papers and corresponding chatGPT summaries with pre-defined keywords. It is…☆30Updated last year
- everything about llm & aigc☆42Updated last week
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆147Updated last month
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆74Updated this week
- 深度学习/计算机视觉/多模态/机器学习/人工智能零基础理论/实战教程汇总分享☆122Updated 2 years ago
- 蜻蜓点论文 Think不Clear, 论文解读视频上传B站, youtube, 西瓜视频(同步到抖音)☆240Updated last year