Alternatives and similar repositories for llmsys_code_examples

Users that are interested in llmsys_code_examples are comparing it to the libraries listed below

• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆40Updated 9 months ago
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆87Updated 8 months ago
• InternLM / turbomind
  ☆84Updated last month
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆65Updated last month
• fanlai0990 / CS598
  Systems for GenAI
  ☆135Updated 3 weeks ago
• InternLM / Awesome-LLM-Training-System
  ☆36Updated 9 months ago
• Raincleared-Song / sparse_gpu_operator
  GPU operators for sparse tensor operations
  ☆32Updated last year
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆38Updated 2 months ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆69Updated last week
• microsoft / chunk-attention
  ☆75Updated last month
• d-matrix-ai / keyformer-llm
  ☆54Updated last year
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆124Updated this week
• shadowpa0327 / Palu
  [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection
  ☆109Updated 2 months ago
• mit-han-lab / tinychat-tutorial
  ☆65Updated 6 months ago
• dlsyscourse / hw0
  ☆32Updated last year
• flashinfer-ai / cutlass-viz
  ☆58Updated 3 weeks ago
• thunlp / TritonBench
  TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators
  ☆38Updated 2 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆174Updated 2 weeks ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆81Updated last month
• mdy666 / mdy_triton
  ☆125Updated 2 weeks ago
• WukLab / preble
  Stateful LLM Serving
  ☆68Updated 2 months ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆56Updated last year
• triton-lang / kernels
  ☆79Updated 6 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆69Updated 11 months ago
• hkproj / triton-flash-attention
  ☆163Updated 4 months ago
• stanford-futuredata / stk
  ☆104Updated 8 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆221Updated 4 months ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆36Updated last month
• Qualcomm-AI-research / gptvq
  ☆29Updated last year
• gpu-mode / ring-attention
  ring-attention experiments
  ☆142Updated 7 months ago