Alternatives and similar repositories for distributed_pytorch_from_scratch

Users that are interested in distributed_pytorch_from_scratch are comparing it to the libraries listed below

• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆109Updated last month
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆307Updated 11 months ago
• LDLINGLINGLING / nano_vllm_note
  注释的nano_vllm仓库，并且完成了MiniCPM4的适配以及注册新模型的功能
  ☆118Updated 4 months ago
• mdy666 / mdy_triton
  ☆149Updated 5 months ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆113Updated 5 months ago
• InternLM / Awesome-LLM-Training-System
  ☆44Updated last year
• DeepLink-org / DLSlime
  DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
  ☆84Updated this week
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆150Updated 3 weeks ago
• kwai / Megatron-Kwai
  LLM training technologies developed by kwai
  ☆66Updated 3 weeks ago
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆314Updated 2 months ago
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆94Updated 6 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆137Updated last month
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆282Updated 9 months ago
• Starmys / TritonStudyGroup
  ☆107Updated 2 months ago
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆116Updated 8 months ago
• fangpin / llm-from-scratch
  Build LLM from scratch
  ☆70Updated last month
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆149Updated 2 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆146Updated 11 months ago
• gogongxt / nano-sglang
  ☆78Updated 3 weeks ago
• omni-ai-npu / omni-infer
  Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature se…
  ☆92Updated last week
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆66Updated last year
• HarryWu99 / llm_kvcache_sparsity
  Implement some method of LLM KV Cache Sparsity
  ☆41Updated last year
• pprp / ultrascale-playbook-zh
  UltraScale Playbook 中文版
  ☆102Updated 9 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆297Updated 6 months ago
• shishishu / LLM-Inference-Acceleration
  LLM Inference with Deep Learning Accelerator.
  ☆56Updated 10 months ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆119Updated 7 months ago
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆571Updated 3 weeks ago
• ISEEKYAN / mbridge
  Bridge Megatron-Core to Hugging Face/Reinforcement Learning
  ☆173Updated last week
• xlite-dev / ffpa-attn
  🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.
  ☆239Updated last month
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆50Updated 3 months ago