Alternatives and similar repositories for llmsys_code_examples

Users that are interested in llmsys_code_examples are comparing it to the libraries listed below

• mit-han-lab / parallel-computing-tutorial
  ☆178Updated 2 years ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆289Updated 4 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆66Updated last year
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆130Updated last year
• hkproj / triton-flash-attention
  ☆235Updated last year
• hao-ai-lab / cse234-w25-PA
  ☆45Updated 10 months ago
• mdy666 / mdy_triton
  ☆152Updated 6 months ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆368Updated 6 months ago
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆121Updated 9 months ago
• osayamenja / FlashMoE
  Distributed MoE in a Single Kernel [NeurIPS '25]
  ☆188Updated this week
• mlc-ai / notebooks
  ☆219Updated last year
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆309Updated 7 months ago
• dlsyscourse / hw0
  ☆54Updated 4 months ago
• InternLM / turbomind
  ☆96Updated 10 months ago
• ByteDance-Seed / cudaLLM
  ☆128Updated 5 months ago
• madsys-dev / deepseekv2-profile
  ☆155Updated 10 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆273Updated this week
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…
  ☆81Updated 4 months ago
• flagos-ai / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆287Updated last year
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆147Updated last month
• gpu-mode / ring-attention
  ring-attention experiments
  ☆163Updated last year
• Equationliu / Kangaroo
  [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitin…
  ☆65Updated last year
• efeslab / Atom
  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
  ☆335Updated last year
• FMInference / H2O
  [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
  ☆502Updated last year
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆140Updated 7 months ago
• FasterDecoding / SnapKV
  ☆300Updated 6 months ago
• InternLM / Awesome-LLM-Training-System
  ☆47Updated last year
• thunlp / TritonBench
  TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators
  ☆111Updated 7 months ago
• mit-han-lab / tinychat-tutorial
  ☆77Updated last year
• EfficientMoE / MoE-Infinity
  PyTorch library for cost-effective, fast and easy serving of MoE models.
  ☆276Updated 3 months ago