AdityaNG / kan-gpt
The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
☆714Updated 5 months ago
Alternatives and similar repositories for kan-gpt:
Users that are interested in kan-gpt are comparing it to the libraries listed below
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆373Updated 11 months ago
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆404Updated 10 months ago
- ☆732Updated 11 months ago
- An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).☆4,330Updated 9 months ago
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆116Updated 11 months ago
- An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations☆180Updated 5 months ago
- Variations of Kolmogorov-Arnold Networks☆114Updated 11 months ago
- A comprehensive collection of KAN(Kolmogorov-Arnold Network)-related resources, including libraries, projects, tutorials, papers, and mor…☆2,901Updated 2 months ago
- This project extends the idea of the innovative architecture of Kolmogorov-Arnold Networks (KAN) to the Convolutional Layers, changing th…☆861Updated last month
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆867Updated last week
- KAN for Vision Transformer☆245Updated 7 months ago
- Schedule-Free Optimization in PyTorch☆2,150Updated 3 weeks ago
- Official repository of the xLSTM.☆1,849Updated last month
- System 2 Reasoning Link Collection☆828Updated last month
- llama3.np is a pure NumPy implementation for Llama 3 model.☆980Updated last week
- UNet diffusion model in pure CUDA☆601Updated 10 months ago
- nanoGPT style version of Llama 3.1☆1,363Updated 9 months ago
- Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"☆549Updated 4 months ago
- PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…☆289Updated last year
- Benchmark for efficiency in memory and time of different KAN implementations.☆121Updated 8 months ago
- Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper☆607Updated last month
- Build high-performance AI models with modular building blocks☆506Updated this week
- Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States☆1,187Updated 9 months ago
- Annotated version of the Mamba paper☆483Updated last year
- 4M: Massively Multimodal Masked Modeling☆1,719Updated 2 months ago
- ☆444Updated last year
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆168Updated last month
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆424Updated 4 months ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆791Updated last week
- The Multilayer Perceptron Language Model☆548Updated 9 months ago