Alternatives and similar repositories for FlashMHA:

Users that are interested in FlashMHA are comparing it to the libraries listed below

• BBuf / flash-rwkv
  ☆30Updated 11 months ago
• li-plus / flash-preference
  Accelerate LLM preference tuning via prefix sharing with a single line of code
  ☆41Updated last week
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆82Updated 11 months ago
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆47Updated 3 months ago
• VITA-Group / o1-planning
  On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability
  ☆38Updated 2 weeks ago
• SprocketLab / sparse_matrix_fine_tuning
  Official repository for ICML 2024 paper "MoRe Fine-Tuning with 10x Fewer Parameters"
  ☆18Updated last week
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆23Updated last year
• teelinsan / parallel-decoding
  Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"
  ☆116Updated last year
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated 10 months ago
• JerryYin777 / Cross-Layer-Attention
  Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)
  ☆14Updated 11 months ago
• sustcsonglin / linear-attention-and-beyond-slides
  ☆71Updated 2 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆60Updated last year
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆45Updated 5 months ago
• VITA-Group / Ms-PoE
  "Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiw…
  ☆29Updated last year
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆84Updated 5 months ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 7 months ago
• Infini-AI-Lab / gsm_infinite
  ☆45Updated 2 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆39Updated last year
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆60Updated last year
• kyegomez / Hedgehog
  Implementation of the model "Hedgehog" from the paper: "The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry"
  ☆13Updated last year
• ModelTC / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆36Updated last year
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆69Updated 10 months ago
• microsoft / AttentionEngine
  ☆68Updated this week
• berlino / gated_linear_attention
  ☆103Updated last year
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆87Updated 3 months ago
• HazyResearch / prefix-linear-attention
  ☆53Updated 10 months ago
• zhixuan-lin / forgetting-transformer
  [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"
  ☆99Updated last month
• fla-org / flame
  🔥 A minimal training framework for scaling FLA models
  ☆128Updated this week
• Dao-AILab / gemm-cublas
  ☆18Updated last week