RobinWu218 / ToSTLinks
[ICLR 2025 Spotlight] Official Implementation for ToST (Token Statistics Transformer)
☆127Updated 9 months ago
Alternatives and similar repositories for ToST
Users that are interested in ToST are comparing it to the libraries listed below
Sorting:
- The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…☆449Updated last week
- [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization☆104Updated 6 months ago
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆134Updated last month
- [NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (T6) (https://arxiv.org/abs/2501.06425)☆433Updated last month
- [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule☆388Updated 2 months ago
- [CVPR2025] Breaking the Low-Rank Dilemma of Linear Attention☆37Updated 9 months ago
- The official implementation of "[MASK] is All You Need"☆125Updated 4 months ago
- A Triton Kernel for incorporating Bi-Directionality in Mamba2☆75Updated 11 months ago
- Awesome list of papers that extend Mamba to various applications.☆139Updated 6 months ago
- When it comes to optimizers, it's always better to be safe than sorry☆396Updated 2 months ago
- Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"☆166Updated 10 months ago
- Inference Speed Benchmark for Learning to (Learn at Test Time): RNNs with Expressive Hidden States☆75Updated last year
- Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"☆183Updated last year
- Discrete Diffusion Forcing (D2F): dLLMs Can Do Faster-Than-AR Inference☆210Updated 2 months ago
- ☆257Updated 6 months ago
- Triton implement of bi-directional (non-causal) linear attention☆57Updated 10 months ago
- [CVPR] MergeVQ: A Unified Framework for Visual Generation and Representation with Token Merging and Quantization☆47Updated 4 months ago
- A More Fair and Comprehensive Comparison between KAN and MLP☆176Updated last year
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers" [ICCV 2025]☆95Updated 4 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆83Updated last year
- Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch☆95Updated 9 months ago
- Scaling RWKV-Like Architectures for Diffusion Models☆140Updated last year
- Towards training VQ-VAE models robustly!☆87Updated 5 months ago
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆233Updated 2 months ago
- Official PyTorch Implementation of "Scalable Autoregressive Image Generation with Mamba"☆141Updated 11 months ago
- [ICCV 25]SpectralAR: Spectral Autoregressive Visual Generation☆35Updated 6 months ago
- Official Implementation of LaViDa: :A Large Diffusion Language Model for Multimodal Understanding☆181Updated last week
- Implementation of the dynamic chunking mechanism in H-net by Hwang et al. of Carnegie Mellon☆65Updated 3 months ago
- Autoregressive Image Generation with Randomized Parallel Decoding☆81Updated last month
- TraceRL & TraDo-8B: Revolutionizing Reinforcement Learning Framework for Diffusion Large Language Models☆347Updated last week