leloykun / flash-hyperbolic-attention-minimal
Flash Hyperbolic Attention in ~[...] lines of CUDA
☆21Updated 11 months ago
Alternatives and similar repositories for flash-hyperbolic-attention-minimal:
Users that are interested in flash-hyperbolic-attention-minimal are comparing it to the libraries listed below
- Boosting 4-bit inference kernels with 2:4 Sparsity☆72Updated 7 months ago
- ☆103Updated 7 months ago
- Fast and memory-efficient exact attention☆67Updated last month
- Cataloging released Triton kernels.☆213Updated 3 months ago
- ☆195Updated last week
- Framework to reduce autotune overhead to zero for well known deployments.☆63Updated last week
- ☆122Updated last month
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆108Updated this week
- ☆76Updated 5 months ago
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆59Updated 2 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆78Updated 5 months ago
- [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection☆95Updated last month
- 🔥 A minimal training framework for scaling FLA models☆94Updated last week
- Triton-based implementation of Sparse Mixture of Experts.☆210Updated 4 months ago
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…☆21Updated 6 months ago
- Applied AI experiments and examples for PyTorch☆253Updated 2 weeks ago
- Transformers components but in Triton☆32Updated 3 weeks ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆40Updated last year
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆254Updated last week
- The simplest but fast implementation of matrix multiplication in CUDA.☆34Updated 8 months ago
- Collection of kernels written in Triton language☆118Updated this week
- Fast Hadamard transform in CUDA, with a PyTorch interface☆166Updated 10 months ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆32Updated last week
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆103Updated 8 months ago
- ☆114Updated 2 weeks ago
- ☆194Updated 8 months ago
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆245Updated 5 months ago
- ring-attention experiments☆129Updated 5 months ago
- ☆43Updated last year
- ☆19Updated last month