fla-org / flash-bidirectional-linear-attentionLinks
Triton implement of bi-directional (non-causal) linear attention
☆56Updated 8 months ago
Alternatives and similar repositories for flash-bidirectional-linear-attention
Users that are interested in flash-bidirectional-linear-attention are comparing it to the libraries listed below
Sorting:
- Xmixers: A collection of SOTA efficient token/channel mixers☆29Updated last month
- Flash-Linear-Attention models beyond language☆19Updated last month
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆131Updated last month
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆36Updated last year
- Fast and memory-efficient exact kmeans☆111Updated 3 weeks ago
- Here we will test various linear attention designs.☆61Updated last year
- A WebUI for Side-by-Side Comparison of Media (Images/Videos) Across Multiple Folders☆23Updated 8 months ago
- [NeurIPS'25] dKV-Cache: The Cache for Diffusion Language Models☆110Updated 5 months ago
- [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆99Updated 4 months ago
- Code for "RSQ: Learning from Important Tokens Leads to Better Quantized LLMs"☆19Updated 4 months ago
- ☆32Updated last year
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Updated last year
- ☆61Updated 3 months ago
- [ICML24] Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs☆94Updated 10 months ago
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆119Updated 4 months ago
- [ICML 2025] SparseLoRA: Accelerating LLM Fine-Tuning with Contextual Sparsity☆58Updated 3 months ago
- [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring☆239Updated 3 months ago
- ☆105Updated last year
- ☆42Updated this week
- [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Di…☆66Updated last year
- ☆251Updated 4 months ago
- ☆34Updated 7 months ago
- AdaSplash: Adaptive Sparse Flash Attention (aka Flash Entmax Attention)☆26Updated 3 weeks ago
- Patch convolution to avoid large GPU memory usage of Conv2D☆92Updated 9 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆195Updated 4 months ago
- [NeurIPS '25] Multi-Token Prediction Needs Registers☆22Updated last month
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆50Updated 3 months ago
- The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…☆95Updated last month
- [COLM 2025] Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"☆55Updated 3 months ago
- Pytorch implementation of "Oscillation-Reduced MXFP4 Training for Vision Transformers" on DeiT Model Pre-training☆30Updated 4 months ago