NX-AI / flashrnnLinks
FlashRNN - Fast RNN Kernels with I/O Awareness
☆93Updated last month
Alternatives and similar repositories for flashrnn
Users that are interested in flashrnn are comparing it to the libraries listed below
Sorting:
- Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.☆65Updated last week
- ☆232Updated 2 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆149Updated last month
- Accelerated First Order Parallel Associative Scan☆184Updated 11 months ago
- Load compute kernels from the Hub☆220Updated this week
- [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule☆193Updated 4 months ago
- The evaluation framework for training-free sparse attention in LLMs☆86Updated last month
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆127Updated 8 months ago
- Normalized Transformer (nGPT)☆185Updated 8 months ago
- Work in progress.☆70Updated last month
- Fast and memory-efficient exact attention☆69Updated 5 months ago
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆127Updated 11 months ago
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated 11 months ago
- JAX bindings for Flash Attention v2☆91Updated last week
- A bunch of kernels that might make stuff slower 😉☆56Updated this week
- ☆123Updated 2 months ago
- Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI☆289Updated 2 months ago
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆24Updated last month
- ring-attention experiments☆146Updated 9 months ago
- DPO, but faster 🚀☆44Updated 8 months ago
- RWKV-7: Surpassing GPT☆94Updated 8 months ago
- ☆39Updated 3 months ago
- Awesome Triton Resources☆32Updated 3 months ago
- Here we will test various linear attention designs.☆62Updated last year
- Experiment of using Tangent to autodiff triton☆79Updated last year
- Transformers components but in Triton☆34Updated 2 months ago
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆82Updated 2 weeks ago
- Griffin MQA + Hawk Linear RNN Hybrid☆88Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆230Updated 8 months ago