Alternatives and similar repositories for flashrnn

Users that are interested in flashrnn are comparing it to the libraries listed below

• NX-AI / mlstm_kernels
  Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
  ☆69Updated last week
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆186Updated 9 months ago
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆160Updated 2 months ago
• HanGuo97 / log-linear-attention
  ☆237Updated 2 months ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆187Updated last year
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆129Updated 8 months ago
• NVlabs / GatedDeltaNet
  [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule
  ☆199Updated 5 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆244Updated this week
• IST-DASLab / QuEST
  Work in progress.
  ☆72Updated last month
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆90Updated 2 months ago
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆127Updated last year
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆88Updated last year
• gpu-mode / ring-attention
  ring-attention experiments
  ☆149Updated 10 months ago
• bluorion-com / ZClip
  Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".
  ☆131Updated 2 weeks ago
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated last year
• martin-marek / batch-size
  📄Small Batch Size Training for Language Models
  ☆43Updated this week
• amazon-science / mxfp4-llm
  Official implementation for Training LLMs with MXFP4
  ☆77Updated 4 months ago
• lucidrains / nGPT-pytorch
  Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
  ☆289Updated 2 months ago
• nshepperd / flash_attn_jax
  JAX bindings for Flash Attention v2
  ☆90Updated last week
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆44Updated 8 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• fal-ai-community / NativeSparseAttention
  research impl of Native Sparse Attention (2502.11089)
  ☆60Updated 6 months ago
• Dao-AILab / grouped-latent-attention
  ☆123Updated 2 months ago
• meta-pytorch / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆224Updated last year
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆62Updated last year
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆70Updated 5 months ago
• howard-hou / RWKV-X
  RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…
  ☆46Updated last month
• test-time-training / ttt-tk
  ☆40Updated 4 months ago
• open-lm-engine / flash-model-architectures
  A bunch of kernels that might make stuff slower 😉
  ☆58Updated last week
• google-deepmind / spectral_ssm
  ☆34Updated last year