i404788 / s5-pytorch

Related projects ⓘ

Alternatives and complementary repositories for s5-pytorch

• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆70Updated 8 months ago
• lindermanlab / S5
  ☆261Updated 3 months ago
• sustcsonglin / flash-linear-rnn
  Implementations of various linear RNN layers using pytorch and triton
  ☆46Updated last year
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆49Updated last week
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆45Updated 3 weeks ago
• NicolasZucchet / minimal-LRU
  Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)
  ☆47Updated 2 weeks ago
• HazyResearch / hippo-code
  ☆167Updated 5 months ago
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆61Updated 6 months ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆60Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆120Updated last year
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆103Updated 3 months ago
• fabian-sp / MoMo
  MoMo: Momentum Models for Adaptive Learning Rates
  ☆17Updated 5 months ago
• shikaiqiu / compute-better-spent
  ☆46Updated last month
• google-deepmind / spectral_ssm
  ☆27Updated 7 months ago
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆102Updated last month
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆70Updated 6 months ago
• ctlllll / SGConv
  ☆164Updated last year
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆79Updated 9 months ago
• Johswald / awesome-hypernetworks
  ☆58Updated 2 years ago
• kuleshov-group / awesome-discrete-diffusion-models
  A curated list for awesome discrete diffusion models resources.
  ☆67Updated last week
• Hprairie / Bi-Mamba2
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆50Updated 2 months ago
• alxndrTL / othello_mamba
  Evaluating the Mamba architecture on the Othello game
  ☆43Updated 6 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆49Updated 3 months ago
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆40Updated 3 months ago
• Doraemonzzz / hgru-pytorch
  ☆25Updated 4 months ago
• Gothos / LRU-pytorch
  Unofficial implementation of Linear Recurrent Units, by Deepmind, in Pytorch
  ☆59Updated last year
• Leiay / looped_transformer
  ☆20Updated 11 months ago
• GFNOrg / GFlowNet-EM
  Code for GFlowNet-EM, a novel algorithm for fitting latent variable models with compositional latents and an intractable true posterior.
  ☆38Updated 9 months ago
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆85Updated 6 months ago
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆77Updated 9 months ago