fla-org / flash-bidirectional-linear-attentionLinks
Triton implement of bi-directional (non-causal) linear attention
☆48Updated 4 months ago
Alternatives and similar repositories for flash-bidirectional-linear-attention
Users that are interested in flash-bidirectional-linear-attention are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"☆104Updated 2 weeks ago
- [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆69Updated 4 months ago
- A WebUI for Side-by-Side Comparison of Media (Images/Videos) Across Multiple Folders☆24Updated 3 months ago
- ☆47Updated 2 months ago
- ☆74Updated last week
- XAttention: Block Sparse Attention with Antidiagonal Scoring☆158Updated 3 weeks ago
- ☆31Updated last year
- Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"☆34Updated this week
- Here we will test various linear attention designs.☆58Updated last year
- Flash-Linear-Attention models beyond language☆14Updated this week
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆30Updated 11 months ago
- [NeurIPS 2024] Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching☆103Updated 10 months ago
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆30Updated 6 months ago
- This is the official PyTorch implementation of "ZipAR: Accelerating Auto-regressive Image Generation through Spatial Locality"☆47Updated 2 months ago
- [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Di…☆60Updated last year
- ☆103Updated last year
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆38Updated 7 months ago
- ☆13Updated 2 months ago
- HGRN2: Gated Linear RNNs with State Expansion☆54Updated 9 months ago
- The official repo of continuous speculative decoding☆26Updated 2 months ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…☆65Updated last year
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆21Updated 5 months ago
- FORA introduces simple yet effective caching mechanism in Diffusion Transformer Architecture for faster inference sampling.☆46Updated 10 months ago
- Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…☆72Updated this week
- Implementation of the proposed MaskBit from Bytedance AI☆80Updated 6 months ago
- [ICML 2025 Spotlight] Mixture of Lookup Experts☆24Updated 3 weeks ago
- FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]☆19Updated this week
- ☆23Updated 2 months ago
- ☆83Updated last month
- ✈️ Towards Stabilized and Efficient Diffusion Transformers through Long-Skip-Connections with Spectral Constraints☆67Updated 2 months ago