Alternatives and similar repositories for Griffin

Users that are interested in Griffin are comparing it to the libraries listed below

• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆213Updated last week
• jacobfa / fft
  ☆131Updated 6 months ago
• Indoxer / LKAN
  Variations of Kolmogorov-Arnold Networks
  ☆116Updated last year
• chenziwenhaoshuai / Vision-KAN
  KAN for Vision Transformer
  ☆255Updated last year
• 1ssb / torchkan
  An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations
  ☆189Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆121Updated last year
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆120Updated last week
• smvorwerk / xlstm-cuda
  Cuda implementation of Extended Long Short Term Memory (xLSTM) with C++ and PyTorch ports
  ☆91Updated last year
• SynodicMonth / ChebyKAN
  Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.
  ☆402Updated last year
• StarostinV / convkan
  Convolutional layer for Kolmogorov-Arnold Network (KAN)
  ☆115Updated 10 months ago
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆134Updated last year
• akaashdash / kansformers
  ☆140Updated last year
• lucidrains / medical-ai-experiments
  A repository to house some personal attempts to beat some state-of-the-art for medical datasets
  ☆101Updated 2 years ago
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆56Updated 3 months ago
• badripatro / mamba360
  State Space Models
  ☆72Updated last year
• fkodom / yet-another-retnet
  A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…
  ☆106Updated 2 years ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆206Updated 3 weeks ago
• lucidrains / complex-valued-transformer
  Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer Architecture"
  ☆88Updated 2 years ago
• ZiyaoLi / fast-kan
  FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)
  ☆467Updated last year
• jakariaemon / CNN-KAN
  A modified CNN architecture using Kolmogorov-Arnold Networks
  ☆84Updated last year
• hkproj / mamba-notes
  Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
  ☆179Updated 2 years ago
• ShaderManager / RetNet
  PyTorch implementation of Retentive Network: A Successor to Transformer for Large Language Models
  ☆14Updated 2 years ago
• kyegomez / xLSTM
  Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"
  ☆118Updated this week
• myscience / x-lstm
  Pytorch implementation of the xLSTM model by Beck et al. (2024)
  ☆181Updated last year
• xmindflow / Awesome_Mamba
  Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis
  ☆262Updated 6 months ago
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆89Updated last year
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆231Updated 3 months ago
• tommyip / mamba2-minimal
  Minimal Mamba-2 implementation in PyTorch
  ☆243Updated last year
• AI-Guru / xlstm-resources
  Resources about xLSTM by Sepp Hochreiter
  ☆318Updated last year
• apapiu / mamba_small_bench
  Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)
  ☆47Updated 2 years ago