Alternatives and similar repositories for llmsys_code_examples

Users that are interested in llmsys_code_examples are comparing it to the libraries listed below

• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆62Updated last year
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆127Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆277Updated 3 months ago
• mit-han-lab / parallel-computing-tutorial
  ☆176Updated 2 years ago
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆114Updated 8 months ago
• hkproj / triton-flash-attention
  ☆223Updated 11 months ago
• fanlai0990 / CS598
  Systems for GenAI
  ☆148Updated 7 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆294Updated 6 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆262Updated this week
• ByteDance-Seed / cudaLLM
  ☆124Updated 3 months ago
• thunlp / TritonBench
  TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators
  ☆98Updated 6 months ago
• microsoft / chunk-attention
  ☆82Updated 7 months ago
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆302Updated this week
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆113Updated 5 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆160Updated last year
• flagos-ai / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆286Updated last year
• InternLM / turbomind
  ☆97Updated 8 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆135Updated last month
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆309Updated 3 months ago
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆407Updated 3 weeks ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆173Updated 8 months ago
• InternLM / Awesome-LLM-Training-System
  ☆44Updated last year
• mdy666 / mdy_triton
  ☆150Updated 5 months ago
• shreyansh26 / Speculative-Sampling
  Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind
  ☆108Updated last year
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆227Updated 2 years ago
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆184Updated last week
• sgl-project / sglang-jax
  JAX backend for SGL
  ☆191Updated this week
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆282Updated 9 months ago
• Shenggan / awesome-distributed-ml
  A curated list of awesome projects and papers for distributed training or inference
  ☆258Updated last year
• hao-ai-lab / cse234-w25-PA
  ☆44Updated 8 months ago