Alternatives and similar repositories for llm-from-scratch

Users that are interested in llm-from-scratch are comparing it to the libraries listed below

• PKUFlyingPig / MIT6.5940_TinyML
  Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing
  ☆60Updated 10 months ago
• phonism / genesis
  Gensis is a lightweight deep learning framework written from scratch in Python, with Triton as its backend for high-performance computing…
  ☆38Updated last week
• firechecking / CleanParallel
  an implementation of parallel skills like amp, ddp, pp, tp for learning purposes
  ☆14Updated 2 years ago
• InfiniTensor / TinyInfiniTrain
  2025夏季训练营训练方向项目
  ☆15Updated 3 months ago
• liangyuwang / Tiny-Megatron
  Tiny-Megatron, a minimalistic re-implementation of the Megatron library
  ☆17Updated 2 months ago
• LDLINGLINGLING / nano_vllm_note
  注释的nano_vllm仓库，并且完成了MiniCPM4的适配以及注册新模型的功能
  ☆101Updated 3 months ago
• shishishu / LLM-Inference-Acceleration
  LLM Inference with Deep Learning Accelerator.
  ☆54Updated 10 months ago
• DeepLink-org / DLSlime
  DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
  ☆82Updated this week
• gogongxt / nano-sglang
  ☆44Updated last month
• HarryWu99 / llm_kvcache_sparsity
  Implement some method of LLM KV Cache Sparsity
  ☆42Updated last year
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆50Updated 2 months ago
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆90Updated 5 months ago
• xiabingquan / distributed_pytorch_from_scratch
  PyTorch distributed training from scratch (for educational purposes only)
  ☆19Updated 7 months ago
• Sunt-ing / stick
  A PyTorch-like deep learning framework. Just for fun.
  ☆156Updated 2 years ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆131Updated last month
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆64Updated last year
• ByteDance-Seed / StragglerAnalysis
  ☆45Updated 7 months ago
• InternLM / Awesome-LLM-Training-System
  ☆44Updated last year
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆112Updated 7 months ago
• mdy666 / mdy_triton
  ☆149Updated 4 months ago
• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆83Updated 3 months ago
• dhcode-cpp / easy-dualpipe
  Pipeline-Parallel Lecture: Simplest Dualpipe Implementation.
  ☆27Updated 2 months ago
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆108Updated 3 weeks ago
• RLsys-Foundation / APRIL
  APRIL: Active Partial Rollouts in Reinforcement Learning to Tame Long-tail Generation. A system-level optimization for scalable LLM tra…
  ☆44Updated last month
• ISEEKYAN / mbridge
  Bridge Megatron-Core to Hugging Face/Reinforcement Learning
  ☆164Updated this week
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆119Updated last year
• toyaix / TritonLLM
  LLM Inference via Triton (Flexible & Modular): Focused on Kernel Optimization using CUBIN binaries, Starting from gpt-oss Model
  ☆56Updated last month
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆113Updated 4 months ago
• tonyzhao-jt / LLM-PQ
  Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …
  ☆35Updated 3 months ago
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆123Updated last year