Alternatives and similar repositories for kanformer

Users that are interested in kanformer are comparing it to the libraries listed below

• 1ssb / torchkan
  An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations
  ☆186Updated 11 months ago
• Indoxer / LKAN
  Variations of Kolmogorov-Arnold Networks
  ☆115Updated last year
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆195Updated 3 weeks ago
• SynodicMonth / ChebyKAN
  Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.
  ☆392Updated last year
• Jaykef / ai-algorithms
  First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…
  ☆179Updated 4 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆210Updated last month
• pg2455 / KAN-Tutorial
  Understanding Kolmogorov-Arnold Networks: A Tutorial Series on KAN using Toy Examples
  ☆202Updated 5 months ago
• ZiyaoLi / fast-kan
  FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)
  ☆447Updated last year
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆133Updated last year
• Jerry-Master / KAN-benchmarking
  Benchmark for efficiency in memory and time of different KAN implementations.
  ☆136Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆117Updated 2 years ago
• myscience / x-lstm
  Pytorch implementation of the xLSTM model by Beck et al. (2024)
  ☆179Updated last year
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆259Updated last year
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆127Updated last year
• quiqi / relu_kan
  ☆97Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆121Updated last year
• apapiu / mamba_small_bench
  Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)
  ☆47Updated last year
• yu-rp / KANbeFair
  A More Fair and Comprehensive Comparison between KAN and MLP
  ☆176Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆214Updated last year
• lucidrains / nGPT-pytorch
  Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
  ☆292Updated 5 months ago
• AdityaNG / kan-gpt
  The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
  ☆725Updated 11 months ago
• hkproj / mamba-notes
  Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
  ☆173Updated last year
• iShohei220 / adopt
  Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"
  ☆427Updated 11 months ago
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆115Updated last month
• fkodom / yet-another-retnet
  A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…
  ☆106Updated last year
• kyegomez / zeta
  Build high-performance AI models with modular building blocks
  ☆567Updated 2 weeks ago
• GistNoesis / FourierKAN
  ☆745Updated last year
• team-daniel / KAN
  Implementation on how to use Kolmogorov-Arnold Networks (KANs) for classification and regression tasks.
  ☆260Updated last year
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆561Updated 10 months ago
• AI-Guru / xlstm-resources
  Resources about xLSTM by Sepp Hochreiter
  ☆317Updated last year