Alternatives and similar repositories for llmsys_code_examples

Users that are interested in llmsys_code_examples are comparing it to the libraries listed below

• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆60Updated last year
• InternLM / Awesome-LLM-Training-System
  ☆43Updated last year
• ByteDance-Seed / cudaLLM
  ☆120Updated 2 months ago
• mit-han-lab / parallel-computing-tutorial
  ☆176Updated 2 years ago
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆105Updated 6 months ago
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆125Updated last year
• hao-ai-lab / cse234-w25-PA
  ☆41Updated 7 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆263Updated last month
• Deep-Learning-Profiling-Tools / triton-viz
  ☆246Updated this week
• thunlp / TritonBench
  TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators
  ☆87Updated 4 months ago
• microsoft / chunk-attention
  ☆79Updated 6 months ago
• sgl-project / sgl-cookbook
  Make SGLang go brrr
  ☆37Updated last month
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Memory profiler that understands more low-level allocations such as NCCL)
  ☆62Updated last month
• hkproj / triton-flash-attention
  ☆210Updated 9 months ago
• InternLM / turbomind
  ☆97Updated 7 months ago
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆157Updated last week
• fanlai0990 / CS598
  Systems for GenAI
  ☆145Updated 6 months ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆125Updated 5 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆159Updated 6 months ago
• mdy666 / mdy_triton
  ☆148Updated 3 months ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆72Updated 5 months ago
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆301Updated 2 months ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆341Updated 3 months ago
• EfficientMoE / MoE-Infinity
  PyTorch library for cost-effective, fast and easy serving of MoE models.
  ☆252Updated 2 weeks ago
• sgl-project / sglang-jax
  JAX backend for SGL
  ☆101Updated this week
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆221Updated 2 years ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆109Updated 3 months ago
• xlite-dev / ffpa-attn
  🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.
  ☆226Updated 2 months ago
• shadowpa0327 / Palu
  [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection
  ☆143Updated 8 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆121Updated this week