Alternatives and similar repositories for S5:

Users that are interested in S5 are comparing it to the libraries listed below

• HazyResearch / hippo-code
  ☆172Updated 8 months ago
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆76Updated 11 months ago
• srush / annotated-s4
  Implementation of https://srush.github.io/annotated-s4
  ☆483Updated 2 years ago
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆74Updated 9 months ago
• NicolasZucchet / minimal-LRU
  Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)
  ☆53Updated 3 months ago
• Gothos / LRU-pytorch
  Unofficial implementation of Linear Recurrent Units, by Deepmind, in Pytorch
  ☆66Updated last year
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆77Updated 9 months ago
• ctlllll / SGConv
  ☆163Updated 2 years ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆171Updated 6 months ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆473Updated 11 months ago
• nikhilvyas / SOAP
  ☆158Updated 2 months ago
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆110Updated 4 months ago
• AvivBick / awesome-ssm-ml
  Reading list for research topics in state-space models
  ☆259Updated last month
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆122Updated last year
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆181Updated last month
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆279Updated last week
• locuslab / torchdeq
  Modern Fixed Point Systems using Pytorch
  ☆86Updated last year
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆49Updated last year
• raminmh / liquid-s4
  Liquid Structural State-Space Models
  ☆334Updated last year
• lucidrains / block-recurrent-transformer-pytorch
  Implementation of Block Recurrent Transformer - Pytorch
  ☆218Updated 6 months ago
• google-research / jaxpruner
  ☆218Updated last week
• BirkhoffG / jax-dataloader
  Pytorch-like dataloaders for JAX.
  ☆75Updated 4 months ago
• google-deepmind / nanodo
  ☆211Updated 7 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 8 months ago
• autonomousvision / akorn
  Artificial Kuramoto Oscillatory Neurons
  ☆51Updated this week
• NX-AI / xlstm-jax
  Official JAX implementation of xLSTM including fast and efficient training and inference code. 7B model available at https://huggingface.…
  ☆82Updated last month
• alxndrTL / othello_mamba
  Evaluating the Mamba architecture on the Othello game
  ☆44Updated 9 months ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆62Updated 2 years ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆102Updated 2 months ago
• shikaiqiu / compute-better-spent
  ☆52Updated 4 months ago