Alternatives and similar repositories for MultiKernelBench

Users that are interested in MultiKernelBench are comparing it to the libraries listed below

• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆313Updated 7 months ago
• madsys-dev / deepseekv2-profile
  ☆155Updated 11 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆150Updated last year
• LoongServe / LoongServe
  ☆131Updated last year
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆216Updated 3 weeks ago
• sgl-project / SpecForge
  Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
  ☆676Updated this week
• InternLM / Awesome-LLM-Training-System
  ☆47Updated last year
• stepfun-ai / StepMesh
  ☆342Updated last week
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆283Updated 11 months ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆124Updated 4 months ago
• flashinfer-ai / flashinfer-bench
  Building the Virtuous Cycle for AI-driven LLM Systems
  ☆151Updated this week
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆219Updated 2 weeks ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆172Updated 2 months ago
• xinhao-luo / ClusterFusion
  [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive
  ☆66Updated last month
• tile-ai / tilelang-puzzles
  Learning TileLang with 10 puzzles!
  ☆118Updated last week
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆457Updated 8 months ago
• tile-ai / TileRT
  Tile-Based Runtime for Ultra-Low-Latency LLM Inference
  ☆564Updated last week
• kwai / Megatron-Kwai
  LLM training technologies developed by kwai
  ☆70Updated 2 weeks ago
• Tencent / hpc-ops
  High Performance LLM Inference Operator Library
  ☆695Updated this week
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆370Updated 6 months ago
• YaoJiayi / CacheBlend
  ☆164Updated 6 months ago
• nex-agi / NexVenusCL
  Nex Venus Communication Library
  ☆72Updated 2 months ago
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆347Updated last month
• EfficientLLMSys / MuxServe
  ☆15Updated last year
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆123Updated last month
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…
  ☆83Updated 4 months ago
• EfficientMoE / MoE-Infinity
  PyTorch library for cost-effective, fast and easy serving of MoE models.
  ☆279Updated this week
• sspec-project / SparseSpec
  Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding
  ☆87Updated 2 months ago
• LLMServe / DistServe
  Disaggregated serving system for Large Language Models (LLMs).
  ☆771Updated 10 months ago
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆161Updated 4 months ago