Alternatives and similar repositories for flash-bidirectional-linear-attention:

Users that are interested in flash-bidirectional-linear-attention are comparing it to the libraries listed below

• zhixuan-lin / forgetting-transformer
  [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"
  ☆89Updated this week
• BBuf / flash-rwkv
  ☆30Updated 10 months ago
• OpenSparseLLMs / Linearization
  ☆39Updated 3 weeks ago
• mit-han-lab / x-attention
  XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆134Updated 2 weeks ago
• ruikangliu / Quantized-Reasoning-Models
  Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"
  ☆19Updated last week
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆30Updated 10 months ago
• xdit-project / DiTCacheAnalysis
  An auxiliary project analysis of the characteristics of KV in DiT Attention.
  ☆29Updated 4 months ago
• mit-han-lab / VisCompare
  A WebUI for Side-by-Side Comparison of Media (Images/Videos) Across Multiple Folders
  ☆22Updated last month
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆54Updated 7 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆60Updated 11 months ago
• horseee / learning-to-cache
  [NeurIPS 2024] Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching
  ☆100Updated 8 months ago
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆64Updated 11 months ago
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆34Updated 9 months ago
• prathebaselva / FORA
  FORA introduces simple yet effective caching mechanism in Diffusion Transformer Architecture for faster inference sampling.
  ☆44Updated 9 months ago
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Updated 10 months ago
• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆43Updated 3 weeks ago
• sustcsonglin / linear-attention-and-beyond-slides
  ☆67Updated last month
• pprp / Pruner-Zero
  Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆81Updated 4 months ago
• sustcsonglin / fla-tilelang
  ☆19Updated last month
• HuangOwen / RoLoRA
  [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
  ☆33Updated 6 months ago
• abdelfattah-lab / TokenButler
  ☆20Updated last week
• ThisisBillhe / EfficientDM
  [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Di…
  ☆59Updated 10 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆39Updated last year
• berlino / gated_linear_attention
  ☆102Updated last year
• HelmholtzAI-FZJ / flex_gen
  ☆17Updated 3 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 9 months ago
• lucidrains / maskbit-pytorch
  Implementation of the proposed MaskBit from Bytedance AI
  ☆75Updated 5 months ago
• VITA-Group / Ms-PoE
  "Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiw…
  ☆29Updated 11 months ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆85Updated 2 months ago
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆47Updated 9 months ago