Alternatives and similar repositories for Griffin:

Users that are interested in Griffin are comparing it to the libraries listed below

• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆51Updated this week
• kyegomez / MambaFormer
  Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…
  ☆20Updated this week
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆73Updated 10 months ago
• Doraemonzzz / hgru2-pytorch
  ☆24Updated 4 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆52Updated 5 months ago
• assafbk / DeciMamba
  Official Implementation Of The Paper: `DeciMamba: Exploring the Length Extrapolation Potential of Mamba'
  ☆22Updated 6 months ago
• kyegomez / xLSTM
  Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"
  ☆115Updated this week
• Doraemonzzz / hgru-pytorch
  ☆28Updated 6 months ago
• IdoAmos / not-from-scratch
  ☆28Updated 3 months ago
• kyegomez / MultiQueryAttention
  This is a simple torch implementation of the high performance Multi-Query Attention
  ☆16Updated last year
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆72Updated 9 months ago
• Snagnar / Hieros
  Implemenation of the HIERarchical imagionation On Structured State Space Sequence Models (HIEROS) paper
  ☆15Updated 6 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆49Updated last week
• uclaml / MoE
  Towards Understanding the Mixture-of-Experts Layer in Deep Learning
  ☆22Updated last year
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆85Updated 9 months ago
• lucidrains / scaling-vin-pytorch
  Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group
  ☆36Updated 4 months ago
• kazuki-irie / kv-memory-brain
  Official Code Repository for the paper "Key-value memory in the brain"
  ☆20Updated last week
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆15Updated 10 months ago
• kyegomez / TinyGPTV
  Simple Implementation of TinyGPTV in super simple Zeta lego blocks
  ☆15Updated 2 months ago
• hyperevolnet / Terminator
  The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.
  ☆31Updated 2 weeks ago
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆24Updated this week
• nZhangx / TrajectoryFlowMatching
  Code repository for Trajectory Flow Matching
  ☆50Updated 2 months ago
• Hprairie / Bi-Mamba2
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆60Updated last month
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆62Updated 9 months ago
• kyegomez / MHMoE
  Community Implementation of the paper: "Multi-Head Mixture-of-Experts" In PyTorch
  ☆20Updated this week
• kyegomez / SwitchTransformers
  Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…
  ☆69Updated this week
• raunaqbhirangi / hiss
  Hierarchical State Space Models
  ☆43Updated 9 months ago
• radarFudan / mamba-minimal-jax
  ☆30Updated 2 months ago
• quiqi / relu_kan
  ☆80Updated 7 months ago
• opallab / positional_attention
  Source code for the paper "Positional Attention: Out-of-Distribution Generalization and Expressivity for Neural Algorithmic Reasoning"
  ☆14Updated 2 weeks ago