Alternatives and similar repositories for Griffin:

Users that are interested in Griffin are comparing it to the libraries listed below

• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆52Updated 2 months ago
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆77Updated last year
• kyegomez / MambaFormer
  Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…
  ☆20Updated last week
• IdoAmos / not-from-scratch
  ☆30Updated 5 months ago
• Doraemonzzz / hgru-pytorch
  ☆27Updated 8 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆53Updated 7 months ago
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆15Updated last year
• lucidrains / scaling-vin-pytorch
  Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group
  ☆36Updated 6 months ago
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆24Updated last week
• lucidrains / sinkhorn-router-pytorch
  Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise
  ☆33Updated 6 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆78Updated 10 months ago
• assafbk / DeciMamba
  DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)
  ☆24Updated 8 months ago
• lucidrains / vit-arc-slot
  Explorations into improving ViTArc with Slot Attention
  ☆39Updated 5 months ago
• badripatro / mamba360
  State Space Models
  ☆67Updated 10 months ago
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆76Updated 11 months ago
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆33Updated this week
• abenechehab / dicl
  [ICLR 2025] Official implementation of DICL (Disentangled In-Context Learning), featured in the paper "Zero-shot Model-based Reinforcemen…
  ☆16Updated last month
• Weixin-Liang / Mixture-of-Mamba
  ☆38Updated 2 months ago
• Doraemonzzz / hgru2-pytorch
  ☆23Updated 6 months ago
• uclaml / MoE
  Towards Understanding the Mixture-of-Experts Layer in Deep Learning
  ☆25Updated last year
• nZhangx / TrajectoryFlowMatching
  Code repository for Trajectory Flow Matching
  ☆59Updated 4 months ago
• convergence-ai / lm2
  Official repo of paper LM2
  ☆34Updated last month
• kyegomez / SwitchTransformers
  Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…
  ☆89Updated 2 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆51Updated 2 months ago
• MambaMixer / M2
  ☆48Updated 11 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• radarFudan / mamba-minimal-jax
  ☆30Updated 4 months ago
• quiqi / relu_kan
  ☆87Updated 9 months ago
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆64Updated 11 months ago
• kyegomez / MultiQueryAttention
  This is a simple torch implementation of the high performance Multi-Query Attention
  ☆16Updated last year