chunhuizhang / pytorch_distribute_tutorialsLinks
pytorch distribute tutorials
☆153Updated 4 months ago
Alternatives and similar repositories for pytorch_distribute_tutorials
Users that are interested in pytorch_distribute_tutorials are comparing it to the libraries listed below
Sorting:
- ☆392Updated 8 months ago
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆159Updated last year
- personal chatgpt☆387Updated 10 months ago
- Inference code for LLaMA models☆127Updated 2 years ago
- MindSpore online courses: Step into LLM☆477Updated 2 months ago
- llm & rl☆230Updated last month
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆179Updated 2 years ago
- ☆77Updated 5 months ago
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆347Updated last year
- modern AI for beginners☆170Updated last month
- ☆119Updated last year
- Fast inference from large lauguage models via speculative decoding☆841Updated last year
- Cool Papers - Immersive Paper Discovery☆631Updated 2 months ago
- Train a 1B LLM with 1T tokens from scratch by personal☆741Updated 6 months ago
- My implementation of Stanford CS336 assignments.☆180Updated 3 months ago
- 青稞Talk☆151Updated last week
- LLM大模型(重点)以及搜广推等 AI 算法中手写的面试题,(非 LeetCode),比如 Self-Attention, AUC等,一般比 LeetCode 更考察一个人的综合能力,又更贴近业务和基础知识一点☆402Updated 9 months ago
- from MHA, MQA, GQA to MLA by 苏剑林, with code☆29Updated 8 months ago
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆885Updated last week
- ☆148Updated 3 months ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆248Updated last year
- LLMs interview notes and answers:该仓库主要记录大模型(LLMs)算法工程师相关的面试题和参考答案☆601Updated 2 years ago
- Huggingface transformers的中文文档☆273Updated last year
- [TKDE'25] The official GitHub page for the survey paper "A Survey on Mixture of Experts in Large Language Models".☆440Updated 3 months ago
- 一些 LLM 方面的从零复现笔记☆226Updated 5 months ago
- Implementation of FlashAttention in PyTorch☆172Updated 9 months ago
- ☆110Updated last year
- DeepSeek Native Sparse Attention pytorch implementation☆106Updated 2 weeks ago
- ☆309Updated 5 months ago
- LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.☆829Updated last month