Alternatives and similar repositories for flashinfer-bench

Users that are interested in flashinfer-bench are comparing it to the libraries listed below

• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆72Updated 5 months ago
• google / iopddl
  Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning
  ☆23Updated 5 months ago
• tile-ai / tilescale
  Tile-based language built for AI computation across all scales
  ☆67Updated 3 weeks ago
• flashinfer-ai / cutlass-viz
  ☆65Updated 5 months ago
• apache / tvm-ffi
  TVM FFI
  ☆79Updated this week
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆181Updated 2 weeks ago
• nox-410 / tvm.tl
  An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.
  ☆51Updated last year
• toyaix / triton-runner
  Multi-Level Triton Runner supporting Python, IR, PTX, and cubin.
  ☆73Updated this week
• DeepLink-org / DLSlime
  DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
  ☆70Updated this week
• osayamenja / FlashMoE
  Distributed MoE in a Single Kernel [NeurIPS '25]
  ☆89Updated 3 weeks ago
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆60Updated 2 weeks ago
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆138Updated last month
• HPMLL / NVIDIA-Hopper-Benchmark
  ☆61Updated 4 months ago
• mlc-ai / mlc-python
  ☆38Updated 3 months ago
• HanGuo97 / hilt
  ☆33Updated 2 weeks ago
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆100Updated 3 months ago
• LeiWang1999 / Stream-k.tvm
  ☆19Updated last year
• TiledTensor / TiledLower
  TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.
  ☆14Updated 11 months ago
• triton-lang / kernels
  ☆92Updated 11 months ago
• xxyux / SpInfer
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆59Updated 7 months ago
• humuyan / Korch
  ASPLOS'24: Optimal Kernel Orchestration for Tensor Programs with Korch
  ☆37Updated 6 months ago
• tsinghua-ideal / Canvas
  Canvas: End-to-End Kernel Architecture Search in Neural Networks
  ☆27Updated 11 months ago
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆84Updated last month
• zhuohan123 / terapipe
  ☆75Updated 4 years ago
• parasailteam / coconet
  ☆83Updated 2 years ago
• facebookexperimental / triton
  Github mirror of trition-lang/triton repo.
  ☆86Updated this week
• xinhao-luo / ClusterFusion
  [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive
  ☆45Updated last month
• AlibabaPAI / FLASHNN
  ☆100Updated last year
• flashinfer-ai / debug-print
  Debug print operator for cudagraph debugging
  ☆14Updated last year
• thunlp / TritonBench
  TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators
  ☆87Updated 4 months ago