badripatro / mamba360Links
State Space Models
☆67Updated last year
Alternatives and similar repositories for mamba360
Users that are interested in mamba360 are comparing it to the libraries listed below
Sorting:
- ☆48Updated last year
- A repository for DenseSSMs☆87Updated last year
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆43Updated 5 months ago
- ☆60Updated 4 months ago
- Simba☆207Updated last year
- Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data☆59Updated 11 months ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆55Updated 2 months ago
- MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248☆54Updated 11 months ago
- ☆65Updated 7 months ago
- More dimensions = More fun☆22Updated 10 months ago
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆222Updated last year
- [ICLR 2025] Official Code Release for Explaining Modern Gated-Linear RNNs via a Unified Implicit Attention Formulation☆42Updated 3 months ago
- [ICLR2025] This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision☆77Updated this week
- [CVPR2025] Breaking the Low-Rank Dilemma of Linear Attention☆21Updated 2 months ago
- Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning☆45Updated last year
- A pytorch implementation of Fourier Analysis Networks (FAN)☆35Updated 7 months ago
- PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …☆66Updated 7 months ago
- A Triton Kernel for incorporating Bi-Directionality in Mamba2☆68Updated 5 months ago
- Awesome list of papers that extend Mamba to various applications.☆133Updated last month
- HGRN2: Gated Linear RNNs with State Expansion☆54Updated 9 months ago
- Towards Understanding the Mixture-of-Experts Layer in Deep Learning☆30Updated last year
- Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"☆135Updated 4 months ago
- Mamba or Transformer for Time Series Forecasting? Mixture of Universals (MoU) Is All You Need.☆43Updated 3 months ago
- ☆19Updated this week
- Official implementation of ICML 2024 paper "Matrix Information Theory for Self-supervised Learning" (https://arxiv.org/abs/2305.17326)☆28Updated 8 months ago
- ☆23Updated 8 months ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆79Updated last year
- This is the official code for paper: Token Summarisation for Efficient Vision Transformers via Graph-based Token Propagation☆28Updated last year
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆38Updated 7 months ago
- The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)☆48Updated 2 months ago