Alternatives and similar repositories for MLA_tutorial

Users that are interested in MLA_tutorial are comparing it to the libraries listed below

• chunhuizhang / pytorch_distribute_tutorials
  pytorch distribute tutorials
  ☆169Updated 7 months ago
• bobo0810 / LearnDeepSpeed
  DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
  ☆186Updated 2 years ago
• sunkx109 / llama
  Inference code for LLaMA models
  ☆128Updated 2 years ago
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆138Updated last year
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆180Updated last year
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆160Updated last year
• mdy666 / mdy_triton
  ☆152Updated 6 months ago
• qingkelab / qingketalk
  青稞Talk
  ☆190Updated last week
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆368Updated last year
• AI-Study-Han / Zero-Qwen-VL
  训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。
  ☆79Updated last year
• RethinkFun / trian_ppo
  ☆136Updated last year
• owenliang / bpe-tokenizer
  LLM Tokenizer with BPE algorithm
  ☆47Updated last year
• liangyuwang / Tiny-DeepSpeed
  Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library
  ☆49Updated 5 months ago
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆114Updated last month
• dhcode-cpp / easy-dualpipe
  Pipeline-Parallel Lecture: Simplest Dualpipe Implementation.
  ☆31Updated 4 months ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆160Updated 4 months ago
• LDLINGLINGLING / nano_vllm_note
  注释的nano_vllm仓库，并且完成了MiniCPM4的适配以及注册新模型的功能
  ☆155Updated 5 months ago
• pprp / ultrascale-playbook-zh
  UltraScale Playbook 中文版
  ☆125Updated 10 months ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆99Updated last month
• hengjiUSTC / learn-llm
  ☆115Updated last year
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆153Updated last month
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆169Updated 3 weeks ago
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆87Updated 3 months ago
• dhcode-cpp / online-softmax
  simplest online-softmax notebook for explain Flash Attention
  ☆13Updated last week
• liujunwen23 / MIRE
  WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge
  ☆130Updated last year
• owenliang / qwen2.5-0.5b-grpo
  Qwen2.5 0.5B GRPO
  ☆78Updated 11 months ago
• owenliang / qwen-dpo
  通义千问的DPO训练
  ☆60Updated last year
• chunhuizhang / llm_rl
  llm & rl
  ☆271Updated 3 months ago
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]
  ☆199Updated 6 months ago
• chunhuizhang / bert_t5_gpt
  ☆81Updated 2 months ago