xiayuqing0622 / flex_head_faLinks
Fast and memory-efficient exact attention
☆68Updated 3 months ago
Alternatives and similar repositories for flex_head_fa
Users that are interested in flex_head_fa are comparing it to the libraries listed below
Sorting:
- ☆114Updated 3 weeks ago
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆70Updated last week
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆131Updated last week
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆126Updated 6 months ago
- Here we will test various linear attention designs.☆59Updated last year
- ☆130Updated 4 months ago
- ☆81Updated last year
- Stick-breaking attention☆57Updated this week
- Transformers components but in Triton☆34Updated last month
- Triton-based implementation of Sparse Mixture of Experts.☆219Updated 6 months ago
- ☆208Updated 2 weeks ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆235Updated 2 weeks ago
- ☆76Updated 3 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆76Updated last year
- The evaluation framework for training-free sparse attention in LLMs☆69Updated this week
- Using FlexAttention to compute attention with different masking patterns☆43Updated 9 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆59Updated 8 months ago
- 🔥 A minimal training framework for scaling FLA models☆170Updated last week
- ☆147Updated 2 years ago
- Efficient triton implementation of Native Sparse Attention.☆168Updated last month
- ☆21Updated 3 months ago
- ☆37Updated 9 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆120Updated 6 months ago
- ☆55Updated 11 months ago
- ☆51Updated 7 months ago
- Awesome Triton Resources☆31Updated last month
- The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".☆71Updated 3 months ago
- ☆36Updated 2 months ago
- Understand and test language model architectures on synthetic tasks.☆217Updated 2 weeks ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆79Updated 9 months ago