RobinWu218 / ToSTLinks
[ICLR 2025 Spotlight] Official Implementation for ToST (Token Statistics Transformer)
☆128Updated 10 months ago
Alternatives and similar repositories for ToST
Users that are interested in ToST are comparing it to the libraries listed below
Sorting:
- [CVPR2025] Breaking the Low-Rank Dilemma of Linear Attention☆38Updated 9 months ago
- Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"☆169Updated 11 months ago
- The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…☆754Updated 2 weeks ago
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆134Updated 2 weeks ago
- [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆105Updated 7 months ago
- [NeurIPS 2025 Oral] Exploring Diffusion Transformer Designs via Grafting☆69Updated 6 months ago
- [NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (T6) (https://arxiv.org/abs/2501.06425)☆441Updated 2 weeks ago
- Awesome list of papers that extend Mamba to various applications.☆139Updated 6 months ago
- A repository for DenseSSMs☆88Updated last year
- ☆262Updated 6 months ago
- [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule☆411Updated 3 months ago
- The official implementation of "[MASK] is All You Need"☆127Updated 5 months ago
- Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"☆183Updated last year
- A More Fair and Comprehensive Comparison between KAN and MLP☆177Updated last year
- When it comes to optimizers, it's always better to be safe than sorry☆399Updated 3 months ago
- Implementation of a multimodal diffusion transformer in Pytorch☆107Updated last year
- A Triton Kernel for incorporating Bi-Directionality in Mamba2☆75Updated last year
- Triton implement of bi-directional (non-causal) linear attention☆60Updated 11 months ago
- Implementation of the dynamic chunking mechanism in H-net by Hwang et al. of Carnegie Mellon☆65Updated 4 months ago
- Inference Speed Benchmark for Learning to (Learn at Test Time): RNNs with Expressive Hidden States☆76Updated last year
- LLaDA2.0 is the diffusion language model series developed by InclusionAI team, Ant Group.☆207Updated 2 weeks ago
- Official Repo for Error-Free Linear Attention is a Free Lunch: Exact Solution from Continuous-Time Dynamics☆68Updated last week
- [Preprint] GMem: A Modular Approach for Ultra-Efficient Generative Models☆40Updated 9 months ago
- [CVPR'25] MergeVQ: A Unified Framework for Visual Generation and Representation with Token Merging and Quantization☆47Updated 5 months ago
- ☆78Updated 11 months ago
- PyTorch implementation of NEPA☆230Updated last week
- Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch☆96Updated 10 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆83Updated last year
- ☆200Updated 2 years ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers" [ICCV 2025]☆99Updated 5 months ago