Alternatives and similar repositories for retnet

Users that are interested in retnet are comparing it to the libraries listed below

• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆56Updated last month
• DonRL10 / RetNet
  an implementation of paper"Retentive Network: A Successor to Transformer for Large Language Models" https://arxiv.org/pdf/2307.08621.pdf
  ☆12Updated 2 years ago
• Benjamin-Walker / selective-ssms-and-linear-cdes
  Code for "Theoretical Foundations of Deep Selective State-Space Models" (NeurIPS 2024)
  ☆15Updated 9 months ago
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆65Updated last year
• Doraemonzzz / hgru2-pytorch
  ☆23Updated last year
• annosubmission / GRC-Cache
  ☆16Updated 2 years ago
• badripatro / mamba360
  State Space Models
  ☆70Updated last year
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆92Updated last year
• dashstander / block-recurrent-transformer
  Pytorch implementation of "Block Recurrent Transformers" (Hutchins & Schlag et al., 2022)
  ☆85Updated 3 years ago
• fkodom / yet-another-retnet
  A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…
  ☆106Updated last year
• kyegomez / xLSTM
  Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"
  ☆118Updated this week
• Doraemonzzz / hgru-pytorch
  ☆27Updated last year
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆87Updated last year
• ShaderManager / RetNet
  PyTorch implementation of Retentive Network: A Successor to Transformer for Large Language Models
  ☆14Updated 2 years ago
• fmorenopino / SAAM
  Spectral Attention Autoregressive Model (SAAM)
  ☆16Updated 2 years ago
• AlirezaMorsali / MLP-Attention
  ☆16Updated 9 months ago
• vulus98 / Rethinking-attention
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆43Updated 9 months ago
• krafton-ai / mambaformer-icl
  MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248
  ☆57Updated last year
• Doraemonzzz / tnn-pytorch
  ☆19Updated 2 years ago
• smvorwerk / xlstm-cuda
  Cuda implementation of Extended Long Short Term Memory (xLSTM) with C++ and PyTorch ports
  ☆89Updated last year
• bojone / rnn
  一些RNN的实现
  ☆51Updated 2 years ago
• Itamarzimm / UnifiedImplicitAttnRepr
  [ICLR 2025] Official Code Release for Explaining Modern Gated-Linear RNNs via a Unified Implicit Attention Formulation
  ☆46Updated 7 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆54Updated last year
• syassami / FourierKAN-mnist
  MNIST example using Kolmogorov-Arnold Networks
  ☆28Updated last year
• styalai / xLSTM-pytorch
  A easy to use implementation of xLSTM
  ☆59Updated last month
• Hannibal046 / GridTST
  Source code for Leveraging 2D Information for Long-term Time Series Forecasting with Vanilla Transformers
  ☆17Updated last year
• LUMIA-Group / FourierTransformer
  The official Pytorch implementation of the paper "Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT …
  ☆40Updated last year
• AwesomeSeq / Comba-triton
  ☆47Updated 3 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆90Updated last year
• nik-dim / pamal
  Official repository of "Pareto Manifold Learning: Tackling multiple tasks via ensembles of single-task models" [ICML 2023]
  ☆22Updated 9 months ago