AdityaNG / kan-gpt
The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
☆714Updated 5 months ago
Alternatives and similar repositories for kan-gpt:
Users that are interested in kan-gpt are comparing it to the libraries listed below
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆370Updated 11 months ago
- ☆731Updated 11 months ago
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆403Updated 10 months ago
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆116Updated 11 months ago
- A comprehensive collection of KAN(Kolmogorov-Arnold Network)-related resources, including libraries, projects, tutorials, papers, and mor…☆2,892Updated 2 months ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆865Updated 2 months ago
- This project extends the idea of the innovative architecture of Kolmogorov-Arnold Networks (KAN) to the Convolutional Layers, changing th…☆854Updated 2 weeks ago
- An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations☆178Updated 5 months ago
- Variations of Kolmogorov-Arnold Networks☆114Updated 11 months ago
- An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).☆4,314Updated 8 months ago
- KAN for Vision Transformer☆246Updated 6 months ago
- Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793☆407Updated 2 weeks ago
- ☆444Updated last year
- Understanding Kolmogorov-Arnold Networks: A Tutorial Series on KAN using Toy Examples☆185Updated 6 months ago
- Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States☆405Updated 8 months ago
- Pytorch implementation of the xLSTM model by Beck et al. (2024)☆162Updated 8 months ago
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆166Updated 3 weeks ago
- Resources about xLSTM by Sepp Hochreiter☆311Updated 5 months ago
- PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…☆288Updated 11 months ago
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆425Updated 4 months ago
- Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"☆555Updated 10 months ago
- Build high-performance AI models with modular building blocks☆500Updated this week
- Code for BLT research paper☆1,532Updated last week
- Official repository of the xLSTM.☆1,837Updated 3 weeks ago
- ☆128Updated 11 months ago
- Reaching LLaMA2 Performance with 0.1M Dollars☆981Updated 9 months ago
- Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"☆549Updated 4 months ago
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆113Updated 6 months ago
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆103Updated 5 months ago
- UNet diffusion model in pure CUDA☆602Updated 10 months ago