flashinfer-ai / debug-print
Debug print operator for cudagraph debugging
☆10Updated 6 months ago
Alternatives and similar repositories for debug-print:
Users that are interested in debug-print are comparing it to the libraries listed below
- TileFusion is a highly efficient kernel template library designed to elevate the level of abstraction in CUDA C for processing tiles.☆53Updated this week
- ☆19Updated 4 months ago
- ☆23Updated last month
- Quantized Attention on GPU☆34Updated 2 months ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆51Updated last week
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆86Updated this week
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆17Updated this week
- ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 2 months ago
- ☆21Updated this week
- Framework to reduce autotune overhead to zero for well known deployments.☆61Updated 2 weeks ago
- ☆60Updated 3 weeks ago
- GPTQ inference TVM kernel☆38Updated 9 months ago
- Odysseus: Playground of LLM Sequence Parallelism☆64Updated 7 months ago
- Benchmark tests supporting the TiledCUDA library.☆15Updated 2 months ago
- ☆42Updated last month
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆24Updated 2 months ago
- A sparse attention kernel supporting mix sparse patterns☆108Updated this week
- ☆33Updated 3 weeks ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆19Updated this week
- 16-fold memory access reduction with nearly no loss☆76Updated 3 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆88Updated 11 months ago
- Implement Flash Attention using Cute.☆69Updated last month
- ☆8Updated last year
- PyTorch bindings for CUTLASS grouped GEMM.☆64Updated 3 months ago
- ☆22Updated 6 months ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆38Updated 6 months ago
- ☆69Updated last month
- extensible collectives library in triton☆82Updated 4 months ago
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆53Updated 6 months ago