Alternatives and similar repositories for Griffin:

Users that are interested in Griffin are comparing it to the libraries listed below

• kyegomez / MambaFormer
  Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…
  ☆20Updated this week
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆51Updated 2 weeks ago
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆76Updated 11 months ago
• IdoAmos / not-from-scratch
  ☆28Updated 3 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆52Updated 5 months ago
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆73Updated 9 months ago
• Doraemonzzz / hgru-pytorch
  ☆28Updated 7 months ago
• GistNoesis / FusedFourierKAN
  C++ and Cuda ops for fused FourierKAN
  ☆75Updated 9 months ago
• lucidrains / sinkhorn-router-pytorch
  Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise
  ☆32Updated 5 months ago
• nZhangx / TrajectoryFlowMatching
  Code repository for Trajectory Flow Matching
  ☆51Updated 3 months ago
• CraftJarvis / OmniJARVIS
  ☆26Updated 7 months ago
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆24Updated this week
• assafbk / DeciMamba
  Official Implementation Of The Paper: `DeciMamba: Exploring the Length Extrapolation Potential of Mamba'
  ☆23Updated 6 months ago
• uclaml / MoE
  Towards Understanding the Mixture-of-Experts Layer in Deep Learning
  ☆22Updated last year
• Klassikcat / KANElectra
  Transformer model based on Kolmogorov–Arnold Network(KAN), which is an alternative of Multi-Layer Perceptron(MLP)
  ☆27Updated 2 months ago
• Snagnar / Hieros
  Implemenation of the HIERarchical imagionation On Structured State Space Sequence Models (HIEROS) paper
  ☆15Updated 7 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆50Updated 3 weeks ago
• opallab / positional_attention
  Source code for the paper "Positional Attention: Out-of-Distribution Generalization and Expressivity for Neural Algorithmic Reasoning"
  ☆14Updated 2 weeks ago
• lucidrains / scaling-vin-pytorch
  Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group
  ☆36Updated 4 months ago
• Doraemonzzz / hgru2-pytorch
  ☆24Updated 4 months ago
• SpaceLearner / JacobiKAN
  Kolmogorov-Arnold Networks (KAN) using Jacobi polynomials instead of B-splines.
  ☆36Updated 9 months ago
• sidhu2690 / RBF-KAN
  This code implements a Radial Basis Function (RBF) based Kolmogorov-Arnold Network (KAN) for function approximation.
  ☆26Updated 8 months ago
• MambaMixer / M2
  ☆45Updated 10 months ago
• kyegomez / SwitchTransformers
  Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…
  ☆78Updated 2 weeks ago
• jxiw / MambaByte
  [CoLM 24] Official Repository of MambaByte: Token-free Selective State Space Model
  ☆19Updated 4 months ago
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆96Updated 5 months ago
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆93Updated 2 weeks ago
• raunaqbhirangi / hiss
  Hierarchical State Space Models
  ☆43Updated 10 months ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆86Updated 10 months ago
• badripatro / mamba360
  State Space Models
  ☆64Updated 9 months ago