flashinfer-ai / debug-print
Debug print operator for cudagraph debugging
☆10Updated 5 months ago
Alternatives and similar repositories for debug-print:
Users that are interested in debug-print are comparing it to the libraries listed below
- ☆36Updated this week
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, achieve peak⚡️ performance☆43Updated this week
- ☆19Updated 3 months ago
- Quantized Attention on GPU☆34Updated last month
- ☆21Updated last week
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆16Updated this week
- ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated last month
- Framework to reduce autotune overhead to zero for well known deployments.☆57Updated last month
- GPTQ inference TVM kernel☆38Updated 8 months ago
- ☆30Updated 5 months ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆37Updated 5 months ago
- ☆56Updated 3 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆75Updated this week
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆23Updated last month
- A sparse attention kernel supporting mix sparse patterns☆94Updated 3 months ago
- 📚[WIP] FFPA: Yet antother Faster Flash Prefill Attention with O(1)⚡️GPU SRAM complexity for headdim > 256, 1.8x~3x↑🎉faster vs SDPA EA.☆49Updated this week
- 16-fold memory access reduction with nearly no loss☆63Updated 2 months ago
- ☆22Updated last month
- ☆27Updated 3 weeks ago
- ☆22Updated 3 weeks ago
- PyTorch bindings for CUTLASS grouped GEMM.☆58Updated 2 months ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆49Updated 7 months ago
- ☆8Updated last year
- Implement Flash Attention using Cute.☆65Updated last month
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆51Updated 5 months ago
- extensible collectives library in triton☆76Updated 3 months ago
- ☆48Updated 7 months ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆18Updated 3 years ago
- Artifacts of EVT ASPLOS'24☆23Updated 10 months ago
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆24Updated last month