Fast and low-memory attention layer written in CUDA
☆20Jul 14, 2023Updated 3 years ago
Alternatives and similar repositories for fused-attention
Users that are interested in fused-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆15Aug 31, 2023Updated 3 years ago
- ☆10Mar 8, 2025Updated last year
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated 2 years ago
- ☆12Mar 21, 2024Updated 2 years ago
- A DL compiler fuzzer☆15Nov 1, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swa…☆40Oct 5, 2025Updated last year
- A comparison of pretraining framework for LLM☆22Feb 6, 2025Updated last year
- Investigating machine learning algorithms for identifying roads within dashcam photos☆11Jan 15, 2016Updated 10 years ago
- ☆16Mar 10, 2024Updated 2 years ago
- // clone this repo with --depth=1 to save disk size // toolchain compatible with Ubuntu 20.04+ //☆15Apr 28, 2022Updated 4 years ago
- Code for GRAPHITE: Generating Automatic Physical Examples for Machine-Learning Attacks on Computer Vision Systems☆12Apr 19, 2024Updated 2 years ago
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated last year
- Processing-in Memory Architecture for Multiply-Accumulate Operations with Hybrid Memory Cube☆12Feb 13, 2017Updated 9 years ago
- Akshay Rangesh and Mohan M. Trivedi, "Ground Plane Polling for 6DoF Pose Estimation of Objects on the Road," IEEE Transactions on Intelli…☆15Mar 26, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Oct 13, 2025Updated last year
- nanoGPT using Equinox☆15Mar 3, 2023Updated 3 years ago
- ☆10Dec 21, 2022Updated 3 years ago
- JAX Scalify: end-to-end scaled arithmetics☆18Oct 30, 2024Updated last year
- Verified graph rewriting (for dataflow circuits).☆29Oct 4, 2026Updated last week
- ☆19Mar 4, 2025Updated last year
- analyse problems of AI with Math and Code☆31Jul 28, 2025Updated last year
- itertree python package - full featured tree data structure☆15Sep 8, 2025Updated last year
- A retargetable and extensible synthesis-based compiler for modern hardware architectures☆21Nov 20, 2025Updated 10 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Semantic Scaffolds for Pseudocode-to-Code Generation (accepted by ACL 2020)☆14Jun 7, 2021Updated 5 years ago
- Code related to the ELM neuron.☆17Feb 27, 2024Updated 2 years ago
- compiling DSLs to high-level hardware instructions☆24Nov 8, 2022Updated 3 years ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- sketches for egg: a flexible, high-performance e-graph library☆33Sep 25, 2025Updated last year
- ☆19Feb 15, 2023Updated 3 years ago
- survey and analysis of kv-stores in academia and industry☆10Aug 31, 2019Updated 7 years ago
- Lua convenience library for nim☆18Mar 23, 2020Updated 6 years ago
- MoE expert offload for low-VRAM GPUs — run 100B+ MoE models (DeepSeek, Qwen, Mixtral) on 8 GB cards. Expert cache with LRU hot experts, O…☆151Oct 1, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…☆22Sep 10, 2024Updated 2 years ago
- ☆21Jun 4, 2025Updated last year
- ☆34Feb 3, 2025Updated last year
- ☆26Oct 6, 2023Updated 3 years ago
- The official implementation of the DAC 2024 paper GQA-LUT☆26Dec 20, 2024Updated last year
- [NeurIPS 2023] Code release for "Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity"☆19Oct 19, 2023Updated 2 years ago
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated last year