Fast and low-memory attention layer written in CUDA
☆20Jul 14, 2023Updated 2 years ago
Alternatives and similar repositories for fused-attention
Users that are interested in fused-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GEMV implementation with CUTLASS☆19Aug 21, 2025Updated 7 months ago
- BaseBot is the open source Bot backend library compatible with the Friendly AI app that is available on App and Play Store.☆18Aug 3, 2023Updated 2 years ago
- ☆10Mar 8, 2025Updated last year
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆14Apr 3, 2025Updated 11 months ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆16Aug 31, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- A DL compiler fuzzer☆14Nov 1, 2024Updated last year
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated last year
- JAX Scalify: end-to-end scaled arithmetics☆18Oct 30, 2024Updated last year
- SIMPLER MAGIC: Synthesis and In-memory MaPping of Logic Execution in a single Row for Memristor Aided loGIC☆13Dec 5, 2019Updated 6 years ago
- A retargetable and extensible synthesis-based compiler for modern hardware architectures☆17Nov 20, 2025Updated 4 months ago
- // clone this repo with --depth=1 to save disk size // toolchain compatible with Ubuntu 20.04+ //☆15Apr 28, 2022Updated 3 years ago
- TensorRight: Automated Verification of Tensor Graph Rewrites☆19Nov 9, 2025Updated 4 months ago
- ☆14Mar 10, 2024Updated 2 years ago
- Processing-in Memory Architecture for Multiply-Accumulate Operations with Hybrid Memory Cube☆12Feb 13, 2017Updated 9 years ago
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- LLM Program Watermarking☆18Apr 19, 2024Updated last year
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- ☆12Mar 21, 2024Updated 2 years ago
- The official implementation of the DAC 2024 paper GQA-LUT☆21Dec 20, 2024Updated last year
- learning notes when learning the source code of pytorch☆24Apr 3, 2019Updated 6 years ago
- ☆19Feb 15, 2023Updated 3 years ago
- Lua convenience library for nim☆18Mar 23, 2020Updated 6 years ago
- sketches for egg: a flexible, high-performance e-graph library☆30Sep 25, 2025Updated 6 months ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Evaluate Transformers from the Hub 🔥☆14Nov 27, 2023Updated 2 years ago
- survey and analysis of kv-stores in academia and industry☆10Aug 31, 2019Updated 6 years ago
- analyse problems of AI with Math and Code☆27Jul 28, 2025Updated 8 months ago
- pLUTo is a DRAM-based Processing-using-Memory architecture that leverages the high density of DRAM to enable the massively parallel stori…☆18Jan 12, 2023Updated 3 years ago
- ☆24Oct 30, 2024Updated last year
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated last year
- An AI-powered web application that allows users to virtually try on clothing by overlaying garment images on user images. Built with comp…☆14Apr 18, 2025Updated 11 months ago
- ☆23Jun 18, 2024Updated last year
- SoC for CQU Dual Issue Machine☆12Sep 20, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- Notes and Examples to get started Parallel Computing with CUDA.☆13Nov 1, 2019Updated 6 years ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Sep 10, 2024Updated last year
- Nim wrapper for libbacktrace☆23Updated this week
- Hacks to run proprietary NVIDIA drivers on musl systems☆17Oct 6, 2021Updated 4 years ago
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…☆21Sep 10, 2024Updated last year
- Code and data for AAAI 2022 paper "Multilingual Code Snippets Training for Program Translation"☆10Mar 7, 2022Updated 4 years ago
- Implementation for <Orthogonal Over-Parameterized Training> in CVPR'21.☆22Jul 16, 2021Updated 4 years ago