Alternatives and similar repositories for S5:

Users that are interested in S5 are comparing it to the libraries listed below

• HazyResearch / hippo-code
  ☆178Updated 11 months ago
• srush / annotated-s4
  Implementation of https://srush.github.io/annotated-s4
  ☆494Updated 2 years ago
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆76Updated last year
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆80Updated last year
• Gothos / LRU-pytorch
  Unofficial implementation of Linear Recurrent Units, by Deepmind, in Pytorch
  ☆69Updated last week
• NicolasZucchet / minimal-LRU
  Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)
  ☆53Updated 6 months ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆182Updated 8 months ago
• nikhilvyas / SOAP
  ☆177Updated 5 months ago
• ctlllll / SGConv
  ☆164Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆123Updated last year
• autonomousvision / akorn
  [ICLR'25] Artificial Kuramoto Oscillatory Neurons
  ☆78Updated 2 months ago
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆114Updated 6 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆78Updated 11 months ago
• NX-AI / xlstm-jax
  Official JAX implementation of xLSTM including fast and efficient training and inference code. 7B model available at https://huggingface.…
  ☆91Updated 3 months ago
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆50Updated last year
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆51Updated 3 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆194Updated last month
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆113Updated 4 months ago
• google-deepmind / nanodo
  ☆217Updated 9 months ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆63Updated 2 years ago
• BirkhoffG / jax-dataloader
  Pytorch-like dataloaders for JAX.
  ☆80Updated last week
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆483Updated last year
• shikaiqiu / compute-better-spent
  ☆52Updated 7 months ago
• bhoov / hamux
  Hierarchical Associative Memory User Experience
  ☆101Updated last year
• modula-systems / modula
  🧱 Modula software package
  ☆188Updated last month
• locuslab / torchdeq
  Modern Fixed Point Systems using Pytorch
  ☆89Updated last year
• google-research / jaxpruner
  ☆224Updated 2 months ago
• HomebrewML / HeavyBall
  Efficient optimizers
  ☆190Updated this week
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆173Updated this week
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆287Updated last month