hkproj / kan-notes

Related projects ⓘ

Alternatives and complementary repositories for kan-notes

• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆108Updated 5 months ago
• SynodicMonth / ChebyKAN
  Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.
  ☆349Updated 6 months ago
• ZiyaoLi / fast-kan
  FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)
  ☆367Updated 5 months ago
• 1ssb / torchkan
  An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations
  ☆160Updated 3 months ago
• Indoxer / LKAN
  Variations of Kolmogorov-Arnold Networks
  ☆111Updated 6 months ago
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆130Updated 6 months ago
• jakariaemon / CNN-KAN
  A modified CNN architecture using Kolmogorov-Arnold Networks
  ☆65Updated 6 months ago
• pg2455 / KAN-Tutorial
  Understanding Kolmogorov-Arnold Networks: A Tutorial Series on KAN using Toy Examples
  ☆166Updated last month
• team-daniel / KAN
  Implementation on how to use Kolmogorov-Arnold Networks (KANs) for classification and regression tasks.
  ☆221Updated 2 months ago
• AthanasiosDelis / faster-kan
  Benchmarking and Testing FastKAN
  ☆66Updated 5 months ago
• kyegomez / swarms-pytorch
  Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
  ☆112Updated last week
• a-r-r-o-w / kanformer
  Naively combining transformers and Kolmogorov-Arnold Networks to learn and experiment
  ☆33Updated 3 months ago
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆102Updated last month
• riiswa / kanrl
  Kolmogorov-Arnold Network for Reinforcement Leaning, initial experiments
  ☆269Updated 4 months ago
• chenziwenhaoshuai / Vision-KAN
  KAN for Vision Transformer
  ☆232Updated last month
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆163Updated 6 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 6 months ago
• Decentralised-AI / LFM-Liquid-AI-Liquid-Foundation-Models
  An open source implementation of LFMs from Liquid AI: Liquid Foundation Models
  ☆72Updated last month
• evintunador / templateGPT
  customizable template GPT code designed for easy novel architecture experimentation
  ☆25Updated 3 weeks ago
• Sentdex / neural-net-internals-visualized
  Visualizing some of the internals of a neural network during training and inference.
  ☆70Updated 9 months ago
• TheSeriousProgrammer / SimpleBitNet
  Simple Adaptation of BitNet
  ☆29Updated 7 months ago
• lucidrains / nGPT-pytorch
  Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
  ☆259Updated 2 weeks ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆82Updated last year
• GistNoesis / FourierKAN
  ☆714Updated 6 months ago
• Jerry-Master / KAN-benchmarking
  Benchmark for efficiency in memory and time of different KAN implementations.
  ☆111Updated 2 months ago
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆59Updated 6 months ago
• Zhangyanbo / MLP-KAN
  Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)
  ☆103Updated 3 weeks ago
• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆173Updated 2 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 7 months ago
• angry-kratos / Simple_Llama3_from_scratch
  ☆32Updated 5 months ago