flashinfer-ai / flashinfer-benchLinks
Building the Virtuous Cycle for AI-driven LLM Systems
☆92Updated 2 weeks ago
Alternatives and similar repositories for flashinfer-bench
Users that are interested in flashinfer-bench are comparing it to the libraries listed below
Sorting:
- Tile-based language built for AI computation across all scales☆82Updated this week
- ☆65Updated 7 months ago
- Multi-Level Triton Runner supporting Python, IR, PTX, and cubin.☆76Updated this week
- Autonomous GPU Kernel Generation via Deep Agents☆163Updated last week
- DeeperGEMM: crazy optimized version☆73Updated 6 months ago
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆51Updated last year
- A lightweight design for computation-communication overlap.☆188Updated last month
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆63Updated 2 weeks ago
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆144Updated 2 months ago
- Open ABI and FFI for Machine Learning Systems☆211Updated this week
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆59Updated 8 months ago
- Github mirror of trition-lang/triton repo.☆100Updated this week
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆102Updated 5 months ago
- ☆94Updated last year
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆24Updated 6 months ago
- ☆159Updated last year
- ☆38Updated last week
- Artifacts of EVT ASPLOS'24☆28Updated last year
- ☆148Updated 11 months ago
- ☆65Updated 6 months ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆149Updated last week
- ☆38Updated 4 months ago
- nnScaler: Compiling DNN models for Parallel Training☆120Updated 2 months ago
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆224Updated 2 years ago
- a size profiler for cuda binary☆53Updated last month
- ☆27Updated 8 months ago
- ☆19Updated last year
- ☆83Updated 3 years ago
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆50Updated 2 months ago
- Canvas: End-to-End Kernel Architecture Search in Neural Networks☆26Updated last year