Fast and low-memory attention layer written in CUDA
☆20Jul 14, 2023Updated 2 years ago
Alternatives and similar repositories for fused-attention
Users that are interested in fused-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated 7 months ago
- ☆30Updated this week
- ☆13May 26, 2025Updated 10 months ago
- ☆10Mar 8, 2025Updated last year
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆14Apr 3, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆16Aug 31, 2023Updated 2 years ago
- FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swa…☆38Oct 5, 2025Updated 6 months ago
- A DL compiler fuzzer☆15Nov 1, 2024Updated last year
- A retargetable and extensible synthesis-based compiler for modern hardware architectures☆17Nov 20, 2025Updated 4 months ago
- // clone this repo with --depth=1 to save disk size // toolchain compatible with Ubuntu 20.04+ //☆15Apr 28, 2022Updated 3 years ago
- An implementation of SGEMV with performance comparable to cuBLAS.☆12May 21, 2021Updated 4 years ago
- TensorRight: Automated Verification of Tensor Graph Rewrites☆19Nov 9, 2025Updated 5 months ago
- An Xposed/LSPosed module for disabling the annoying biometrics timeout☆20Aug 24, 2025Updated 7 months ago
- ☆33Sep 14, 2025Updated 7 months ago
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Processing-in Memory Architecture for Multiply-Accumulate Operations with Hybrid Memory Cube☆12Feb 13, 2017Updated 9 years ago
- LLM Program Watermarking☆18Apr 19, 2024Updated 2 years ago
- ☆12Mar 21, 2024Updated 2 years ago
- The official implementation of the DAC 2024 paper GQA-LUT☆22Dec 20, 2024Updated last year
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- Source code for the paper "Do Deep Neural Network Solutions form a Star Domain?"☆12May 26, 2024Updated last year
- ☆13Oct 13, 2025Updated 6 months ago
- ☆19Feb 15, 2023Updated 3 years ago
- Official Repository for Efficient Linear-Time Attention Transformers.☆18Jun 2, 2024Updated last year
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Semantic Scaffolds for Pseudocode-to-Code Generation (accepted by ACL 2020)☆14Jun 7, 2021Updated 4 years ago
- compiling DSLs to high-level hardware instructions☆23Nov 8, 2022Updated 3 years ago
- sketches for egg: a flexible, high-performance e-graph library☆30Sep 25, 2025Updated 6 months ago
- Lua convenience library for nim☆18Mar 23, 2020Updated 6 years ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 2 years ago
- The official implementation of ICLR 2025 paper "Polynomial Composition Activations: Unleashing the Dynamics of Large Language Models".☆18Apr 25, 2025Updated 11 months ago
- Evaluate Transformers from the Hub 🔥☆14Apr 3, 2026Updated 2 weeks ago
- survey and analysis of kv-stores in academia and industry☆10Aug 31, 2019Updated 6 years ago
- ☆26Oct 6, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- pLUTo is a DRAM-based Processing-using-Memory architecture that leverages the high density of DRAM to enable the massively parallel stori…☆18Jan 12, 2023Updated 3 years ago
- ☆24Oct 30, 2024Updated last year
- PIM-ML is a benchmark for training machine learning algorithms on the UPMEM architecture, which is the first publicly-available real-worl…☆25Jan 7, 2025Updated last year
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated last year
- An AI-powered web application that allows users to virtually try on clothing by overlaying garment images on user images. Built with comp…☆14Apr 18, 2025Updated last year
- ☆23Jun 18, 2024Updated last year
- Notes and Examples to get started Parallel Computing with CUDA.☆13Nov 1, 2019Updated 6 years ago