Alternatives and similar repositories for mamba-tiny:

Users that are interested in mamba-tiny are comparing it to the libraries listed below

• AvivBick / awesome-ssm-ml
  Reading list for research topics in state-space models
  ☆257Updated last week
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆470Updated 11 months ago
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆119Updated 5 months ago
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆211Updated 8 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆155Updated this week
• nikhilvyas / SOAP
  ☆149Updated last month
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆182Updated this week
• lindermanlab / S5
  ☆278Updated 3 weeks ago
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆209Updated 11 months ago
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆273Updated last month
• apapiu / mamba_small_bench
  Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)
  ☆43Updated last year
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆109Updated 3 weeks ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆77Updated 8 months ago
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆146Updated 2 months ago
• alxndrTL / othello_mamba
  Evaluating the Mamba architecture on the Othello game
  ☆44Updated 9 months ago
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆129Updated last month
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆170Updated 5 months ago
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆73Updated 10 months ago
• hkproj / mamba-notes
  Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
  ☆159Updated last year
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆119Updated 6 months ago
• lucidrains / adam-atan2-pytorch
  Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
  ☆101Updated 2 months ago
• apple / ml-sigmoid-attention
  ☆243Updated 4 months ago
• bobby-he / simplified_transformers
  ☆287Updated last month
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆92Updated 4 months ago
• yu-rp / KANbeFair
  A More Fair and Comprehensive Comparison between KAN and MLP
  ☆157Updated 5 months ago
• HazyResearch / flash-fft-conv
  FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
  ☆292Updated last month
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆49Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆115Updated 5 months ago
• lucidrains / nGPT-pytorch
  Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
  ☆271Updated 2 months ago
• shikaiqiu / compute-better-spent
  ☆50Updated 3 months ago