chunhuizhang / pytorch_distribute_tutorialsLinks
pytorch distribute tutorials
☆147Updated 2 months ago
Alternatives and similar repositories for pytorch_distribute_tutorials
Users that are interested in pytorch_distribute_tutorials are comparing it to the libraries listed below
Sorting:
- personal chatgpt☆382Updated 8 months ago
- ☆366Updated 6 months ago
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆155Updated 10 months ago
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆176Updated last year
- Inference code for LLaMA models☆122Updated 2 years ago
- llm & rl☆194Updated this week
- ☆74Updated 3 months ago
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆335Updated last year
- Train a 1B LLM with 1T tokens from scratch by personal☆720Updated 3 months ago
- MindSpore online courses: Step into LLM☆477Updated this week
- Cool Papers - Immersive Paper Discovery☆599Updated this week
- modern AI for beginners☆154Updated last week
- Fast inference from large lauguage models via speculative decoding☆807Updated last year
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆845Updated last week
- ☆99Updated 10 months ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆227Updated last year
- Huggingface transformers的中文文档☆269Updated last year
- 一些 LLM 方面的从零复现笔记☆216Updated 3 months ago
- ☆143Updated last month
- ☆199Updated 4 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆366Updated last year
- LLMs interview notes and answers:该仓库主要记录大模型(LLMs)算法工程师相关的面试题和参考答案☆586Updated last year
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆42Updated last week
- LLM大模型(重点)以及搜广推等 AI 算法中手写的面试题,(非 LeetCode),比如 Self-Attention, AUC等,一般比 LeetCode 更考察一个人的综合能力,又更贴近业务和基础知识一点☆342Updated 7 months ago
- 青稞Talk☆69Updated 2 weeks ago
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,307Updated this week
- ☆113Updated 9 months ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆467Updated 3 months ago
- My implementation of Stanford CS336 assignments.☆106Updated last month
- DeepSeek Native Sparse Attention pytorch implementation☆90Updated 2 weeks ago