flashinfer-ai / flashinfer-benchView external linksLinks
Building the Virtuous Cycle for AI-driven LLM Systems
☆164Updated this week
Alternatives and similar repositories for flashinfer-bench
Users that are interested in flashinfer-bench are comparing it to the libraries listed below
Sorting:
- ☆65Apr 26, 2025Updated 9 months ago
- ☆118May 19, 2025Updated 8 months ago
- Debug print operator for cudagraph debugging☆14Aug 2, 2024Updated last year
- ☆52May 19, 2025Updated 8 months ago
- ☆32Jul 2, 2025Updated 7 months ago
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆43Nov 19, 2025Updated 2 months ago
- a simple API to use CUPTI☆11Aug 19, 2025Updated 5 months ago
- Open ABI and FFI for Machine Learning Systems☆337Updated this week
- ☆15Oct 30, 2025Updated 3 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆22Updated this week
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- Tile-based language built for AI computation across all scales☆120Updated this week
- Framework to reduce autotune overhead to zero for well known deployments.☆96Sep 19, 2025Updated 4 months ago
- DeeperGEMM: crazy optimized version☆73May 5, 2025Updated 9 months ago
- A Top-Down Profiler for GPU Applications☆22Feb 29, 2024Updated last year
- It is an LLM-based AI agent, which can write correct and efficient gpu kernels automatically.☆63Updated this week
- Review automated kernel generation in the era of LLMs☆97Jan 23, 2026Updated 3 weeks ago
- NVIDIA cuTile learn☆162Dec 9, 2025Updated 2 months ago
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆209Sep 21, 2024Updated last year
- Autonomous GPU Kernel Generation via Deep Agents☆233Updated this week
- ☆38Aug 7, 2025Updated 6 months ago
- ☆39Dec 14, 2025Updated 2 months ago
- ☆38Jul 19, 2025Updated 6 months ago
- PerFlow-AI is a programmable performance analysis, modeling, prediction tool for AI system.☆28Feb 3, 2026Updated last week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆806Jan 20, 2026Updated 3 weeks ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆148May 10, 2025Updated 9 months ago
- study of cutlass☆22Nov 10, 2024Updated last year
- Implement Flash Attention using Cute.☆100Dec 17, 2024Updated last year
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆37Feb 6, 2026Updated last week
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆106Jun 28, 2025Updated 7 months ago
- Official Repo of CudaForge☆59Dec 2, 2025Updated 2 months ago
- Distributed Compiler based on Triton for Parallel Systems☆1,350Updated this week
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Sep 13, 2025Updated 5 months ago
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆314Jun 10, 2025Updated 8 months ago
- ☆84Nov 22, 2025Updated 2 months ago
- ☆13Jun 18, 2024Updated last year
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 6 months ago
- Automated bottleneck detection and solution orchestration☆19Feb 3, 2026Updated last week
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year