chunhuizhang / pytorch_distribute_tutorialsLinks
pytorch distribute tutorials
☆161Updated 6 months ago
Alternatives and similar repositories for pytorch_distribute_tutorials
Users that are interested in pytorch_distribute_tutorials are comparing it to the libraries listed below
Sorting:
- ☆405Updated 10 months ago
- personal chatgpt☆402Updated last year
- Inference code for LLaMA models☆128Updated 2 years ago
- ☆81Updated 3 weeks ago
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆183Updated 2 years ago
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆159Updated last year
- llm & rl☆263Updated 2 months ago
- modern AI for beginners☆184Updated 3 months ago
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆358Updated last year
- MindSpore online courses: Step into LLM☆482Updated this week
- Train a 1B LLM with 1T tokens from scratch by personal☆778Updated 8 months ago
- 青稞Talk☆179Updated 2 weeks ago
- ☆130Updated last year
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆253Updated last year
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆910Updated 3 weeks ago
- Fast inference from large lauguage models via speculative decoding☆872Updated last year
- ☆350Updated 7 months ago
- 包含程序员面试大厂面试题和面试经验☆200Updated 7 months ago
- Cool Papers - Immersive Paper Discovery☆675Updated 4 months ago
- LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.☆857Updated 2 weeks ago
- My implementation of Stanford CS336 assignments.☆210Updated 5 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆391Updated last year
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,489Updated last week
- ☆149Updated 5 months ago
- Huggingface transformers的中文文档☆286Updated 2 years ago
- LLM大模型(重点)以及搜广推等 AI 算法中手写的面试题,(非 LeetCode),比如 Self-Attention, AUC等,一般比 LeetCode 更考察一个人的综合能力,又更贴近业务和基础知识一点☆458Updated 11 months ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆129Updated last year
- ☆123Updated last year
- from MHA, MQA, GQA to MLA by 苏剑林, with code☆35Updated 10 months ago
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆49Updated 4 months ago