Alternatives and similar repositories for Griffin:

Users that are interested in Griffin are comparing it to the libraries listed below

• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆130Updated 11 months ago
• ShaderManager / RetNet
  PyTorch implementation of Retentive Network: A Successor to Transformer for Large Language Models
  ☆14Updated last year
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆39Updated this week
• aykutcayir34 / DifferentialTransformer
  ☆8Updated 6 months ago
• kyegomez / MambaFormer
  Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…
  ☆20Updated this week
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆52Updated 3 weeks ago
• kyegomez / xLSTM
  Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"
  ☆119Updated 3 weeks ago
• NISCHALPI / xLSTM-and-mLSTM
  An implementation of mLSTM and sLSTM in PyTorch.
  ☆26Updated 10 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆192Updated 3 weeks ago
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆61Updated 11 months ago
• fkodom / yet-another-retnet
  A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…
  ☆105Updated last year
• badripatro / mamba360
  State Space Models
  ☆68Updated 11 months ago
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆80Updated last year
• jakariaemon / CNN-KAN
  A modified CNN architecture using Kolmogorov-Arnold Networks
  ☆77Updated 11 months ago
• apapiu / mamba_small_bench
  Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)
  ☆45Updated last year
• radarFudan / mamba
  ☆16Updated 6 months ago
• smvorwerk / xlstm-cuda
  Cuda implementation of Extended Long Short Term Memory (xLSTM) with C++ and PyTorch ports
  ☆87Updated 10 months ago
• jacobfa / fft
  ☆115Updated last week
• Indoxer / LKAN
  Variations of Kolmogorov-Arnold Networks
  ☆114Updated 11 months ago
• kyegomez / SimpleMamba
  Implementation of a modular, high-performance, and simplistic mamba for high-speed applications
  ☆34Updated 5 months ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆47Updated 6 months ago
• myscience / x-lstm
  Pytorch implementation of the xLSTM model by Beck et al. (2024)
  ☆162Updated 8 months ago
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆50Updated 6 months ago
• sidhu2690 / RBF-KAN
  This code implements a Radial Basis Function (RBF) based Kolmogorov-Arnold Network (KAN) for function approximation.
  ☆28Updated 10 months ago
• myscience / mamba
  Pytorch (Lightning) implementation of the Mamba model
  ☆26Updated last week
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆50Updated last month
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆116Updated 11 months ago
• zavareh1 / Wav-KAN
  This repository contains the codes to replicate the simulations from the paper: "Wav-KAN: Wavelet Kolmogorov-Arnold Networks". It showca…
  ☆142Updated 2 months ago
• Klassikcat / KANElectra
  Transformer model based on Kolmogorov–Arnold Network(KAN), which is an alternative of Multi-Layer Perceptron(MLP)
  ☆28Updated 3 weeks ago
• peytontolbert / Griffin
  Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
  ☆13Updated last year