Fast and low-memory attention layer written in CUDA
☆20Jul 14, 2023Updated 3 years ago
Alternatives and similar repositories for fused-attention
Users that are interested in fused-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Beyond Softmax Loss: Intra-Concentration and Inter-Separability Loss for Classification(I2CS)☆12Aug 11, 2020Updated 6 years ago
- A Symbolic Emulator for Shuffle Synthesis on the NVIDIA PTX Code☆16Mar 19, 2023Updated 3 years ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆15Aug 31, 2023Updated 3 years ago
- ☆10Mar 8, 2025Updated last year
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆12Mar 21, 2024Updated 2 years ago
- SIMPLER MAGIC: Synthesis and In-memory MaPping of Logic Execution in a single Row for Memristor Aided loGIC☆13Dec 5, 2019Updated 6 years ago
- A DL compiler fuzzer☆15Nov 1, 2024Updated last year
- Fast Online and Relational Tracking☆12Jan 10, 2023Updated 3 years ago
- FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swa…☆40Oct 5, 2025Updated 11 months ago
- An awesome list that curates the best Flet tools, tutorials, blogs and more.☆10Jan 8, 2023Updated 3 years ago
- A new DRAM substrate that mitigates the excessive energy consumption from both (i) transmitting unused data on the memory channel and (i…☆14Aug 23, 2024Updated 2 years ago
- An implementation of SGEMV with performance comparable to cuBLAS.☆12May 21, 2021Updated 5 years ago
- Unofficial PyTorch Implementation of OpenAI's GPT-3☆13Apr 11, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆202Sep 24, 2023Updated 3 years ago
- // clone this repo with --depth=1 to save disk size // toolchain compatible with Ubuntu 20.04+ //☆15Apr 28, 2022Updated 4 years ago
- Simple application for create and translation mjpeg video stream to http webpage use openCV☆10Oct 3, 2023Updated 2 years ago
- Code for GRAPHITE: Generating Automatic Physical Examples for Machine-Learning Attacks on Computer Vision Systems☆12Apr 19, 2024Updated 2 years ago
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated last year
- Processing-in Memory Architecture for Multiply-Accumulate Operations with Hybrid Memory Cube☆12Feb 13, 2017Updated 9 years ago
- learning notes when learning the source code of pytorch☆24Apr 3, 2019Updated 7 years ago
- ☆13Oct 13, 2025Updated 11 months ago
- Source code for the paper "Do Deep Neural Network Solutions form a Star Domain?"☆11May 26, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- JAX Scalify: end-to-end scaled arithmetics☆18Oct 30, 2024Updated last year
- Verified graph rewriting (for dataflow circuits).☆29Updated this week
- A verification tool for ensuring parallelization equivalence in distributed model training.☆18Sep 1, 2025Updated last year
- Anything related to Linux Kernel☆15Feb 10, 2021Updated 5 years ago
- ☆19Mar 4, 2025Updated last year
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- Fake RPi.GPIO module for testing☆14Dec 19, 2020Updated 5 years ago
- Code related to the ELM neuron.☆16Feb 27, 2024Updated 2 years ago
- whatever it means☆19Jun 10, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Mips处理器仿真设计☆17Jun 22, 2016Updated 10 years ago
- sketches for egg: a flexible, high-performance e-graph library☆33Sep 25, 2025Updated last year
- ☆19Feb 15, 2023Updated 3 years ago
- Evaluate Transformers from the Hub 🔥☆14Updated this week
- verilog modules☆16May 4, 2020Updated 6 years ago
- Camera streamer on jetson Xavier☆15Feb 18, 2021Updated 5 years ago
- Official Repository for Efficient Linear-Time Attention Transformers.☆17Jun 2, 2024Updated 2 years ago