Alternatives and similar repositories for llmsys_code_examples

Users that are interested in llmsys_code_examples are comparing it to the libraries listed below

• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆122Updated last year
• mit-han-lab / parallel-computing-tutorial
  ☆172Updated 2 years ago
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆101Updated 5 months ago
• mdy666 / mdy_triton
  ☆143Updated 2 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆58Updated last year
• ByteDance-Seed / cudaLLM
  ☆107Updated last month
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆260Updated 2 weeks ago
• InternLM / turbomind
  ☆95Updated 6 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆264Updated 3 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆240Updated this week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆152Updated 11 months ago
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆135Updated 2 weeks ago
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Memory profiler that understands more low-level allocations such as NCCL)
  ☆55Updated 2 weeks ago
• mlc-ai / notebooks
  ☆210Updated 10 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆155Updated 5 months ago
• efeslab / Atom
  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
  ☆320Updated last year
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆228Updated this week
• microsoft / chunk-attention
  ☆78Updated 5 months ago
• FlagOpen / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆279Updated last year
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆113Updated 5 months ago
• mit-han-lab / tinychat-tutorial
  ☆72Updated 10 months ago
• madsys-dev / deepseekv2-profile
  ☆147Updated 6 months ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆107Updated 2 months ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆121Updated 3 months ago
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆518Updated this week
• InternLM / Awesome-LLM-Training-System
  ☆42Updated last year
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆335Updated 2 months ago
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆270Updated 6 months ago
• thunlp / TritonBench
  TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators
  ☆81Updated 3 months ago
• hao-ai-lab / cse234-w25-PA
  ☆40Updated 6 months ago