Fast and low-memory attention layer written in CUDA
☆20Jul 14, 2023Updated 2 years ago
Alternatives and similar repositories for fused-attention
Users that are interested in fused-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Beyond Softmax Loss: Intra-Concentration and Inter-Separability Loss for Classification(I2CS)☆12Aug 11, 2020Updated 5 years ago
- ☆13May 26, 2025Updated last year
- A Symbolic Emulator for Shuffle Synthesis on the NVIDIA PTX Code☆16Mar 19, 2023Updated 3 years ago
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆14Apr 3, 2025Updated last year
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆15Aug 31, 2023Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swa…☆39Oct 5, 2025Updated 9 months ago
- ☆12Mar 21, 2024Updated 2 years ago
- Fast Online and Relational Tracking☆12Jan 10, 2023Updated 3 years ago
- A retargetable and extensible synthesis-based compiler for modern hardware architectures☆18Nov 20, 2025Updated 7 months ago
- An implementation of SGEMV with performance comparable to cuBLAS.☆12May 21, 2021Updated 5 years ago
- TensorRight: Automated Verification of Tensor Graph Rewrites☆23Nov 9, 2025Updated 8 months ago
- itertree python package - full featured tree data structure☆15Sep 8, 2025Updated 10 months ago
- ☆24Jun 12, 2026Updated 3 weeks ago
- LLM Program Watermarking☆18Apr 19, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The official implementation of the DAC 2024 paper GQA-LUT☆23Dec 20, 2024Updated last year
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- An Xposed/LSPosed module for disabling the annoying biometrics timeout☆20Aug 24, 2025Updated 10 months ago
- Source code for the paper "Do Deep Neural Network Solutions form a Star Domain?"☆12May 26, 2024Updated 2 years ago
- ☆13Oct 13, 2025Updated 8 months ago
- ☆19Feb 15, 2023Updated 3 years ago
- Lua convenience library for nim☆18Mar 23, 2020Updated 6 years ago
- The Spicy Project☆14May 31, 2016Updated 10 years ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Evaluate Transformers from the Hub 🔥☆14May 26, 2026Updated last month
- analyse problems of AI with Math and Code☆31Jul 28, 2025Updated 11 months ago
- ☆14Dec 30, 2025Updated 6 months ago
- PIM-ML is a benchmark for training machine learning algorithms on the UPMEM architecture, which is the first publicly-available real-worl…☆28Jan 7, 2025Updated last year
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated last year
- ☆25Oct 30, 2024Updated last year
- ☆33Feb 3, 2025Updated last year
- ☆24Jun 18, 2024Updated 2 years ago
- SoC for CQU Dual Issue Machine☆12Sep 20, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Notes and Examples to get started Parallel Computing with CUDA.☆13Nov 1, 2019Updated 6 years ago
- Примеры пропозалов для подачи заявки в Open.TLab☆27Dec 15, 2022Updated 3 years ago
- ☆50May 20, 2025Updated last year
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Sep 10, 2024Updated last year
- ☆78Feb 19, 2024Updated 2 years ago
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…☆21Sep 10, 2024Updated last year
- Hacks to run proprietary NVIDIA drivers on musl systems☆17Oct 6, 2021Updated 4 years ago