flashinfer-ai / flashinfer-benchLinks
Building the Virtuous Cycle for AI-driven LLM Systems
☆82Updated last week
Alternatives and similar repositories for flashinfer-bench
Users that are interested in flashinfer-bench are comparing it to the libraries listed below
Sorting:
- ☆65Updated 6 months ago
- Tile-based language built for AI computation across all scales☆78Updated this week
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆51Updated last year
- DeeperGEMM: crazy optimized version☆73Updated 6 months ago
- Multi-Level Triton Runner supporting Python, IR, PTX, and cubin.☆76Updated this week
- A lightweight design for computation-communication overlap.☆183Updated last month
- Github mirror of trition-lang/triton repo.☆98Updated this week
- Open ABI and FFI for Machine Learning Systems☆167Updated this week
- ☆63Updated 5 months ago
- A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆61Updated 3 weeks ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆91Updated last month
- ☆35Updated last week
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆142Updated last month
- Autonomous GPU Kernel Generation via Deep Agents☆82Updated last week
- ☆147Updated 10 months ago
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆48Updated last month
- ☆93Updated last year
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆23Updated 6 months ago
- ☆38Updated 3 months ago
- ☆158Updated last year
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆59Updated 7 months ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆100Updated 4 months ago
- Artifacts of EVT ASPLOS'24☆28Updated last year
- ☆31Updated 4 months ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 11 months ago
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆75Updated last week
- ☆19Updated last year
- ☆101Updated last year
- ☆32Updated last year
- nnScaler: Compiling DNN models for Parallel Training☆118Updated last month