peytontolbert / Griffin

Related projects ⓘ

Alternatives and complementary repositories for Griffin

• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆49Updated this week
• kyegomez / MambaFormer
  Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…
  ☆20Updated this week
• lucidrains / scaling-vin-pytorch
  Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group
  ☆36Updated last month
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆68Updated 8 months ago
• IdoAmos / not-from-scratch
  ☆25Updated 3 weeks ago
• radarFudan / mamba-minimal-jax
  ☆29Updated last month
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆49Updated 2 months ago
• Snagnar / Hieros
  Implemenation of the HIERarchical imagionation On Structured State Space Sequence Models (HIEROS) paper
  ☆12Updated 3 months ago
• Doraemonzzz / hgru-pytorch
  ☆25Updated 4 months ago
• GistNoesis / FusedFourierKAN
  C++ and Cuda ops for fused FourierKAN
  ☆73Updated 6 months ago
• YihongDong / FAN
  ☆52Updated this week
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆64Updated 6 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 6 months ago
• Hprairie / Bi-Mamba2
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆47Updated 2 months ago
• lucidrains / sinkhorn-router-pytorch
  Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise
  ☆31Updated 2 months ago
• assafbk / DeciMamba
  Official Implementation Of The Paper: `DeciMamba: Exploring the Length Extrapolation Potential of Mamba'
  ☆20Updated 3 months ago
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆102Updated 3 months ago
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆77Updated last month
• MambaMixer / M2
  ☆41Updated 7 months ago
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆85Updated 6 months ago
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆23Updated last week
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆31Updated last month
• kyegomez / SparseAttention
  Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
  ☆59Updated last week
• opallab / positional_attention
  Source code for the paper "Positional Attention: Out-of-Distribution Generalization and Expressivity for Neural Algorithmic Reasoning"
  ☆14Updated last month
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆40Updated 2 months ago
• SpaceLearner / JacobiKAN
  Kolmogorov-Arnold Networks (KAN) using Jacobi polynomials instead of B-splines.
  ☆32Updated 6 months ago
• google-deepmind / spectral_ssm
  ☆27Updated 7 months ago
• sidhu2690 / RBF-KAN
  This code implements a Radial Basis Function (RBF) based Kolmogorov-Arnold Network (KAN) for function approximation.
  ☆25Updated 4 months ago
• quiqi / relu_kan
  ☆76Updated 5 months ago
• Doraemonzzz / hgru2-pytorch
  ☆21Updated last month