Alternatives and similar repositories for Griffin

Users that are interested in Griffin are comparing it to the libraries listed below

• ShaderManager / RetNet
  PyTorch implementation of Retentive Network: A Successor to Transformer for Large Language Models
  ☆14Updated last year
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆193Updated last month
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆130Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆117Updated 11 months ago
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆53Updated last month
• kyegomez / xLSTM
  Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"
  ☆119Updated last month
• sakami0000 / child-mind-institute-detect-sleep-states-1st-place
  ☆18Updated last year
• apapiu / mamba_small_bench
  Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)
  ☆46Updated last year
• myscience / x-lstm
  Pytorch implementation of the xLSTM model by Beck et al. (2024)
  ☆163Updated 9 months ago
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆103Updated last month
• smvorwerk / xlstm-cuda
  Cuda implementation of Extended Long Short Term Memory (xLSTM) with C++ and PyTorch ports
  ☆87Updated 11 months ago
• a-r-r-o-w / kanformer
  Naively combining transformers and Kolmogorov-Arnold Networks to learn and experiment
  ☆35Updated 9 months ago
• radarFudan / mamba
  ☆17Updated 6 months ago
• NISCHALPI / xLSTM-and-mLSTM
  An implementation of mLSTM and sLSTM in PyTorch.
  ☆28Updated 11 months ago
• kyegomez / MambaFormer
  Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…
  ☆21Updated 3 weeks ago
• jacobmarks / awesome-neurips-2023
  Conference schedule, top papers, and analysis of the data for NeurIPS 2023!
  ☆119Updated last year
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆54Updated last year
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆52Updated 7 months ago
• kyegomez / MHMoE
  Community Implementation of the paper: "Multi-Head Mixture-of-Experts" In PyTorch
  ☆24Updated last month
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆46Updated 7 months ago
• Montinger / Transformer-Workbench
  Playground for Transformers
  ☆50Updated last year
• FarnoushRJ / MambaLRP
  [NeurIPS 2024] Official implementation of the paper "MambaLRP: Explaining Selective State Space Sequence Models".
  ☆38Updated 6 months ago
• ShadeAlsha / ICon
  ICLR 2025 - official implementation for "I-Con: A Unifying Framework for Representation Learning"
  ☆85Updated this week
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated last year
• jakariaemon / CNN-KAN
  A modified CNN architecture using Kolmogorov-Arnold Networks
  ☆79Updated 11 months ago
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆61Updated last year
• NX-AI / mlstm_kernels
  Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
  ☆56Updated last week
• quiqi / relu_kan
  ☆88Updated 11 months ago
• badripatro / mamba360
  State Space Models
  ☆67Updated last year
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆81Updated last year