preacher-1 / MLA_tutorialLinks
from MHA, MQA, GQA to MLA by 苏剑林, with code
☆22Updated 4 months ago
Alternatives and similar repositories for MLA_tutorial
Users that are interested in MLA_tutorial are comparing it to the libraries listed below
Sorting:
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆154Updated 8 months ago
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆61Updated 9 months ago
- ☆82Updated 8 months ago
- Inference code for LLaMA models☆121Updated last year
- 一些 LLM 方面的从零复现笔记☆203Updated last month
- ☆137Updated last month
- LLM101n: Let's build a Storyteller 中文版☆131Updated 10 months ago
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆169Updated last year
- simplest online-softmax notebook for explain Flash Attention☆10Updated 5 months ago
- pytorch distribute tutorials☆138Updated last week
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆120Updated 7 months ago
- LLM Tokenizer with BPE algorithm☆32Updated last year
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆328Updated 11 months ago
- A light llama-like llm inference framework based on the triton kernel.☆128Updated last week
- 通过动画学强化学习笔记☆54Updated 4 months ago
- 怎么训练一个LLM分词器☆150Updated last year
- ☆72Updated last month
- qwen-nsa☆67Updated 2 months ago
- Implementation of FlashAttention in PyTorch☆151Updated 5 months ago
- DeepSeek Native Sparse Attention pytorch implementation☆71Updated 3 months ago
- ☆31Updated 10 months ago
- llm & rl☆151Updated this week
- 使用单个24G显卡,从0开始训练LLM☆55Updated last month
- ☆109Updated 7 months ago
- 从零到一实现一个 miniLLM~(动手学习LLM)☆74Updated last year
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆48Updated last year
- DeepSpeed Tutorial☆97Updated 10 months ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆57Updated 7 months ago
- Triton Documentation in Chinese Simplified / Triton 中文文档☆71Updated 2 months ago
- 从0开始,将chatgpt的技术路线跑一遍。☆241Updated 9 months ago