Building the Virtuous Cycle for AI-driven LLM Systems
☆192Feb 27, 2026Updated last week
Alternatives and similar repositories for flashinfer-bench
Users that are interested in flashinfer-bench are comparing it to the libraries listed below
Sorting:
- ☆65Apr 26, 2025Updated 10 months ago
- ☆118May 19, 2025Updated 9 months ago
- Debug print operator for cudagraph debugging☆14Aug 2, 2024Updated last year
- ☆52May 19, 2025Updated 9 months ago
- ☆32Jul 2, 2025Updated 8 months ago
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆44Nov 19, 2025Updated 3 months ago
- a simple API to use CUPTI☆11Aug 19, 2025Updated 6 months ago
- Open ABI and FFI for Machine Learning Systems☆355Updated this week
- ☆16Feb 24, 2026Updated last week
- Automated GPU Kernel Generation via Co-Evolving Intrinsic World Model☆52Updated this week
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆21Feb 9, 2026Updated 3 weeks ago
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- Tile-based language built for AI computation across all scales☆138Feb 27, 2026Updated last week
- Framework to reduce autotune overhead to zero for well known deployments.☆97Sep 19, 2025Updated 5 months ago
- DeeperGEMM: crazy optimized version☆74May 5, 2025Updated 10 months ago
- A Top-Down Profiler for GPU Applications☆22Feb 29, 2024Updated 2 years ago
- NVIDIA cuTile learn☆165Dec 9, 2025Updated 2 months ago
- It is an LLM-based AI agent, which can write correct and efficient gpu kernels automatically.☆69Updated this week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆836Updated this week
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆210Sep 21, 2024Updated last year
- ☆38Aug 7, 2025Updated 6 months ago
- ☆39Dec 14, 2025Updated 2 months ago
- ☆37Jul 19, 2025Updated 7 months ago
- PerFlow-AI is a programmable performance analysis, modeling, prediction tool for AI system.☆29Feb 3, 2026Updated last month
- Autonomous GPU Kernel Generation & Optimization via Deep Agents☆248Updated this week
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆150May 10, 2025Updated 9 months ago
- study of cutlass☆22Nov 10, 2024Updated last year
- Distributed Compiler based on Triton for Parallel Systems☆1,371Feb 13, 2026Updated 3 weeks ago
- Implement Flash Attention using Cute.☆102Dec 17, 2024Updated last year
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆106Jun 28, 2025Updated 8 months ago
- Official Repo of CudaForge☆62Dec 2, 2025Updated 3 months ago
- Review automated kernel generation in the era of LLMs☆135Feb 28, 2026Updated last week
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Feb 20, 2026Updated 2 weeks ago
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆315Jun 10, 2025Updated 8 months ago
- A framework that helps implementing swizzle GPU kernels☆51Feb 29, 2020Updated 6 years ago
- ☆86Nov 22, 2025Updated 3 months ago
- ☆13Jun 18, 2024Updated last year
- Automated bottleneck detection and solution orchestration☆19Feb 24, 2026Updated last week
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 6 months ago