Libraries-Openly-Fused / FusedKernelLibraryLinks
Implementation of a methodology that allows all sorts of user defined GPU kernel fusion, for non CUDA programmers.
☆23Updated this week
Alternatives and similar repositories for FusedKernelLibrary
Users that are interested in FusedKernelLibrary are comparing it to the libraries listed below
Sorting:
- 🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …☆84Updated last week
- ☆96Updated 3 months ago
- Quantized Attention on GPU☆44Updated 9 months ago
- The evaluation framework for training-free sparse attention in LLMs☆93Updated 2 months ago
- ☆76Updated 8 months ago
- ☆92Updated 3 weeks ago
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆92Updated last week
- Framework to reduce autotune overhead to zero for well known deployments.☆81Updated 2 weeks ago
- A parallel framework for training deep neural networks☆63Updated 6 months ago
- TritonParse: A Compiler Tracer, Visualizer, and mini-Reproducer Generator(WIP) for Triton Kernels☆150Updated this week
- ☆106Updated last month
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆32Updated 9 months ago
- [WIP] Better (FP8) attention for Hopper☆32Updated 6 months ago
- ☆50Updated 3 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆221Updated this week
- ring-attention experiments☆152Updated 11 months ago
- ☆168Updated last year
- Memory Optimizations for Deep Learning (ICML 2023)☆107Updated last year
- A curated list of recent papers on efficient video attention for video diffusion models, including sparsification, quantization, and cach…☆37Updated last week
- How to ship your LLM generated kernels to PyTorch☆49Updated this week
- ☆56Updated last year
- ☆126Updated 3 months ago
- CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning☆186Updated last month
- Mixed precision training from scratch with Tensors and CUDA☆26Updated last year
- A bunch of kernels that might make stuff slower 😉☆59Updated this week
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆48Updated last year
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆43Updated 2 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆157Updated this week
- Efficient implementation of DeepSeek Ops (Blockwise FP8 GEMM, MoE, and MLA) for AMD Instinct MI300X☆69Updated last month
- High-Performance SGEMM on CUDA devices☆101Updated 7 months ago