wxc971231 / ddp-tutorial-seriesLinks
Follow the pytorch tutorial tutorial to learn how to use nn.parallel.DistributedDataParallel to speed up training
☆10Updated last year
Alternatives and similar repositories for ddp-tutorial-series
Users that are interested in ddp-tutorial-series are comparing it to the libraries listed below
Sorting:
- Huggingface transformers的中文文档☆293Updated 2 years ago
- ☆414Updated last year
- 关于Transformer模型的最简洁pytorch实现,包含详细注释☆231Updated 2 years ago
- Qwen3 Fine-tuning: Medical R1 Style Chat☆277Updated 8 months ago
- Transformer是谷歌在17年发表的Attention Is All You Need 中使用的模型,经过这些年的大量的工业使用和论文验证,在深度学习领域已经占据重要地位。Bert就是从Transformer中衍生出来的语言模型。我会以中文翻译英文为例,来解释Tran…☆287Updated last year
- LLMs interview notes and answers:该仓库主要记录大模 型(LLMs)算法工程师相关的面试题和参考答案☆618Updated 2 years ago
- Train a 1B LLM with 1T tokens from scratch by personal☆788Updated 9 months ago
- ☆1,293Updated last month
- 和李沐一起读论文☆217Updated 7 months ago
- 将SmolVLM2的视觉头与Qwen3-0.6B模型进行了拼接微调☆526Updated 5 months ago
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆928Updated 2 months ago
- personal chatgpt☆406Updated last month
- 利用HuggingFace的官方下载工具从镜像网站进行高速下载。☆1,299Updated last year
- ☆129Updated last year
- 这是一个从头训练大语言模型的项目,包括预训练、微调和直接偏好优化,模型拥有1B参数,支持中英文。☆737Updated 11 months ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆495Updated 9 months ago
- ☆136Updated last year
- huggingface mirror download☆589Updated 10 months ago
- real Transformer TeraFLOPS on various GPUs☆917Updated 2 years ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆131Updated last year
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆925Updated last week
- Pure Pytorch Docker Images.☆482Updated last year
- 一些 LLM 方面的从零复现笔记☆243Updated 9 months ago
- 从零实现一个小参数量中文大语言模型。☆940Updated last year
- How to use wandb?☆694Updated 2 years ago
- 复现大模型相关算法及一些学习记录☆2,942Updated last week
- ☆61Updated last year
- Reproduce R1 Zero on Logic Puzzle☆2,432Updated 10 months ago
- A Transformer Framework Based Translation Task☆159Updated 8 months ago
- 多模态中文LLaMA&Alpaca大语言模型(VisualCLA)☆460Updated 2 years ago