Alternatives and similar repositories for llm-from-scratch

Users that are interested in llm-from-scratch are comparing it to the libraries listed below

• dhcode-cpp / easy-dualpipe
  Pipeline-Parallel Lecture: Simplest Dualpipe Implementation.
  ☆29Updated 3 months ago
• PKUFlyingPig / MIT6.5940_TinyML
  Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing
  ☆63Updated 11 months ago
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆109Updated last month
• firechecking / CleanParallel
  an implementation of parallel skills like amp, ddp, pp, tp for learning purposes
  ☆14Updated 2 years ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆137Updated last month
• phonism / genesis
  Gensis is a lightweight deep learning framework written from scratch in Python, with Triton as its backend for high-performance computing…
  ☆37Updated last month
• xiabingquan / distributed_pytorch_from_scratch
  PyTorch distributed training from scratch (for educational purposes only)
  ☆20Updated 8 months ago
• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆92Updated 3 months ago
• mdy666 / mdy_triton
  ☆149Updated 5 months ago
• InternLM / Awesome-LLM-Training-System
  ☆44Updated last year
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆66Updated last year
• ISEEKYAN / mbridge
  Bridge Megatron-Core to Hugging Face/Reinforcement Learning
  ☆173Updated last week
• liangyuwang / Tiny-Megatron
  Tiny-Megatron, a minimalistic re-implementation of the Megatron library
  ☆19Updated 3 months ago
• HarryWu99 / llm_kvcache_sparsity
  Implement some method of LLM KV Cache Sparsity
  ☆41Updated last year
• shishishu / LLM-Inference-Acceleration
  LLM Inference with Deep Learning Accelerator.
  ☆56Updated 10 months ago
• zcli-charlie / Awesome-KV-Cache
  ☆84Updated last year
• InfiniTensor / TinyInfiniTrain
  2025夏季训练营训练方向项目
  ☆16Updated 4 months ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆50Updated 3 months ago
• ifromeast / AI_analysis
  analyse problems of AI with Math and Code
  ☆27Updated 4 months ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆149Updated 2 months ago
• omni-ai-npu / omni-infer
  Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature se…
  ☆92Updated last week
• Strivin0311 / llms-learning
  A repository sharing the literatures about large language models
  ☆106Updated 5 months ago
• tonyzhao-jt / LLM-PQ
  Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …
  ☆35Updated 3 months ago
• LDLINGLINGLING / nano_vllm_note
  注释的nano_vllm仓库，并且完成了MiniCPM4的适配以及注册新模型的功能
  ☆118Updated 4 months ago
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆94Updated 6 months ago
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆116Updated 8 months ago
• DeepLink-org / DLSlime
  DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
  ☆84Updated this week
• qingkelab / qingketalk
  青稞Talk
  ☆175Updated last week
• kcxain / dlsys
  My solutions to the assignments of CMU 10-714 Deep Learning Systems 2022
  ☆43Updated last year
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆307Updated 11 months ago