Alternatives and similar repositories for kanformer

Users that are interested in kanformer are comparing it to the libraries listed below

• 1ssb / torchkan
  An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations
  ☆184Updated 8 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆182Updated last week
• Indoxer / LKAN
  Variations of Kolmogorov-Arnold Networks
  ☆115Updated last year
• SynodicMonth / ChebyKAN
  Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.
  ☆383Updated last year
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆201Updated 3 weeks ago
• Jaykef / ai-algorithms
  First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…
  ☆178Updated 3 weeks ago
• AthanasiosDelis / faster-kan
  Benchmarking and Testing FastKAN
  ☆80Updated last year
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆253Updated last year
• pg2455 / KAN-Tutorial
  Understanding Kolmogorov-Arnold Networks: A Tutorial Series on KAN using Toy Examples
  ☆194Updated 2 months ago
• kyegomez / zeta
  Build high-performance AI models with modular building blocks
  ☆539Updated this week
• ZiyaoLi / fast-kan
  FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)
  ☆429Updated last year
• apapiu / mamba_small_bench
  Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)
  ☆48Updated last year
• quiqi / relu_kan
  ☆94Updated last year
• myscience / x-lstm
  Pytorch implementation of the xLSTM model by Beck et al. (2024)
  ☆169Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆121Updated last year
• Jerry-Master / KAN-benchmarking
  Benchmark for efficiency in memory and time of different KAN implementations.
  ☆130Updated 11 months ago
• myscience / mamba
  Pytorch (Lightning) implementation of the Mamba model
  ☆29Updated 3 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆112Updated 2 years ago
• akaashdash / kansformers
  ☆136Updated last year
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆131Updated last year
• AdityaNG / kan-gpt
  The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
  ☆720Updated 8 months ago
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆120Updated 9 months ago
• fkodom / yet-another-retnet
  A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…
  ☆105Updated last year
• hkproj / mamba-notes
  Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
  ☆169Updated last year
• iShohei220 / adopt
  Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"
  ☆428Updated 8 months ago
• jakariaemon / CNN-KAN
  A modified CNN architecture using Kolmogorov-Arnold Networks
  ☆83Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆208Updated last year
• syncdoth / RetNet
  Huggingface compatible implementation of RetNet (Retentive Networks, https://arxiv.org/pdf/2307.08621.pdf) including parallel, recurrent,…
  ☆226Updated last year
• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆184Updated 11 months ago
• Zhangyanbo / MLP-KAN
  Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)
  ☆106Updated 9 months ago