Fast and low-memory attention layer written in CUDA
☆20Jul 14, 2023Updated 3 years ago
Alternatives and similar repositories for fused-attention
Users that are interested in fused-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆14Apr 3, 2025Updated last year
- A Symbolic Emulator for Shuffle Synthesis on the NVIDIA PTX Code☆16Mar 19, 2023Updated 3 years ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆15Aug 31, 2023Updated 3 years ago
- ☆10Mar 8, 2025Updated last year
- A DL compiler fuzzer☆15Nov 1, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swa…☆39Oct 5, 2025Updated 11 months ago
- An awesome list that curates the best Flet tools, tutorials, blogs and more.☆10Jan 8, 2023Updated 3 years ago
- A new DRAM substrate that mitigates the excessive energy consumption from both (i) transmitting unused data on the memory channel and (i…☆14Aug 23, 2024Updated 2 years ago
- An implementation of SGEMV with performance comparable to cuBLAS.☆12May 21, 2021Updated 5 years ago
- ☆16Mar 10, 2024Updated 2 years ago
- // clone this repo with --depth=1 to save disk size // toolchain compatible with Ubuntu 20.04+ //☆15Apr 28, 2022Updated 4 years ago
- Processing-in Memory Architecture for Multiply-Accumulate Operations with Hybrid Memory Cube☆12Feb 13, 2017Updated 9 years ago
- learning notes when learning the source code of pytorch☆24Apr 3, 2019Updated 7 years ago
- ☆13Oct 13, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- TransPimLib is a library for transcendental (and other hard-to-calculate) functions in general-purpose PIM systems, TransPimLib provides …☆15Apr 21, 2023Updated 3 years ago
- Code for paper "Concrete Subspace Learning based Interference Elimination for Multi-task Model Fusion"☆14Mar 28, 2024Updated 2 years ago
- Source code for the paper "Do Deep Neural Network Solutions form a Star Domain?"☆11May 26, 2024Updated 2 years ago
- itertree python package - full featured tree data structure☆15Sep 8, 2025Updated 11 months ago
- Verified graph rewriting (for dataflow circuits).☆27Jul 15, 2026Updated last month
- ☆19Mar 4, 2025Updated last year
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- whatever it means☆19Jun 10, 2026Updated 2 months ago
- Evaluate Transformers from the Hub 🔥☆14May 26, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- survey and analysis of kv-stores in academia and industry☆10Aug 31, 2019Updated 7 years ago
- Code for "Fine-Tuning by Curriculum Learning for Non-Autoregressive Neural Machine Translation"☆13Jul 10, 2020Updated 6 years ago
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…☆22Sep 10, 2024Updated last year
- ☆21Jun 4, 2025Updated last year
- Lua convenience library for nim☆18Mar 23, 2020Updated 6 years ago
- [NeurIPS 2023] Code release for "Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity"☆19Oct 19, 2023Updated 2 years ago
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated last year
- The official implementation of the DAC 2024 paper GQA-LUT☆25Dec 20, 2024Updated last year
- The Spicy Project☆14May 31, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Agentic coding harness with persistent memory and a REPL body. Built on Ori Mnemos. Open source must win.☆18May 8, 2026Updated 3 months ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Sep 10, 2024Updated last year
- A replication of the paper "Adaptive Mixtures of Local Experts" applied to the CIFAR-10 image classification dataset.☆12Mar 19, 2021Updated 5 years ago
- [ICML 2025] Flat-LoRA: Low-Rank Adaptation over a Flat Loss Landscape☆18May 18, 2025Updated last year
- ☆14Dec 30, 2025Updated 8 months ago
- DESIGN.md for Terminal UI — curated TUI design systems for AI coding agents. Source-code-level research from Claude Code, Lazygit, btop, …☆29Apr 5, 2026Updated 5 months ago
- A Pytorch implementation of "Data-Free Learning of Student Networks" (ICCV 2019).☆18Oct 8, 2019Updated 6 years ago