☆107Feb 25, 2025Updated last year
Alternatives and similar repositories for linear-attention-and-beyond-slides
Users that are interested in linear-attention-and-beyond-slides are comparing it to the libraries listed below
Sorting:
- PyTorch implementation of the Flash Spectral Transform Unit.☆22Sep 19, 2024Updated last year
- ☆35Mar 7, 2025Updated last year
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- ☆118May 19, 2025Updated 9 months ago
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆974Feb 5, 2026Updated last month
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆28Aug 19, 2025Updated 6 months ago
- ☆131Jun 6, 2025Updated 9 months ago
- ☆65Apr 26, 2025Updated 10 months ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Jan 23, 2024Updated 2 years ago
- ☆97Mar 26, 2025Updated 11 months ago
- Quantized Attention on GPU☆44Nov 22, 2024Updated last year
- 🚀 Efficient implementations of state-of-the-art linear attention models☆4,474Updated this week
- ☆32Jul 2, 2025Updated 8 months ago
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆141Feb 25, 2026Updated last week
- ☆52May 19, 2025Updated 9 months ago
- [WIP] Better (FP8) attention for Hopper☆32Feb 24, 2025Updated last year
- Welcome to the 'In Context Learning Theory' Reading Group☆30Nov 8, 2024Updated last year
- [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring☆269Jul 6, 2025Updated 8 months ago
- ☆38Aug 7, 2025Updated 7 months ago
- Triton implement of bi-directional (non-causal) linear attention☆71Mar 1, 2026Updated last week
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆17Mar 13, 2023Updated 2 years ago
- ☆20Nov 4, 2025Updated 4 months ago
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆261Aug 9, 2025Updated 7 months ago
- 🔥 A minimal training framework for scaling FLA models☆353Nov 15, 2025Updated 3 months ago
- Xmixers: A collection of SOTA efficient token/channel mixers☆28Sep 4, 2025Updated 6 months ago
- Efficient triton implementation of Native Sparse Attention.☆269May 23, 2025Updated 9 months ago
- Official repository for the paper Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regressi…☆23Oct 1, 2025Updated 5 months ago
- Automating analysis from trace files☆63Updated this week
- ☆21Mar 3, 2025Updated last year
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆239Jun 15, 2025Updated 8 months ago
- Distributed Compiler based on Triton for Parallel Systems☆1,380Feb 13, 2026Updated 3 weeks ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Mar 24, 2025Updated 11 months ago
- A sparse attention kernel supporting mix sparse patterns☆472Jan 18, 2026Updated last month
- ☆66Jul 8, 2025Updated 8 months ago
- Automated bottleneck detection and solution orchestration☆19Feb 24, 2026Updated last week
- Official Implementation of ACL2023: Don't Parse, Choose Spans! Continuous and Discontinuous Constituency Parsing via Autoregressive Span …☆14Aug 25, 2023Updated 2 years ago
- Image Tokenizer Needs Post-Training☆24Oct 4, 2025Updated 5 months ago
- Retrieval with Learned Similarities (http://arxiv.org/abs/2407.15462, WWW'25 Oral)☆52Apr 23, 2025Updated 10 months ago
- ☆13Jan 7, 2025Updated last year