AdityaNG / kan-gptLinks
The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
☆723Updated 10 months ago
Alternatives and similar repositories for kan-gpt
Users that are interested in kan-gpt are comparing it to the libraries listed below
Sorting:
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆392Updated last year
- ☆740Updated last year
- Variations of Kolmogorov-Arnold Networks☆115Updated last year
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆438Updated last year
- This project extends the idea of the innovative architecture of Kolmogorov-Arnold Networks (KAN) to the Convolutional Layers, changing th…☆901Updated 6 months ago
- A comprehensive collection of KAN(Kolmogorov-Arnold Network)-related resources, including libraries, projects, tutorials, papers, and mor…☆3,064Updated 3 months ago
- The Multilayer Perceptron Language Model☆568Updated last year
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆120Updated last year
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆915Updated 5 months ago
- An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations☆188Updated 10 months ago
- Build high-performance AI models with modular building blocks☆555Updated last week
- Understanding Kolmogorov-Arnold Networks: A Tutorial Series on KAN using Toy Examples☆196Updated 4 months ago
- An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).☆4,481Updated last year
- nanoGPT style version of Llama 3.1☆1,429Updated last year
- ☆447Updated last year
- Mamba-Chat: A chat LLM based on the state-space model architecture 🐍☆932Updated last year
- The Tensor (or Array)☆449Updated last year
- Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"☆562Updated last year
- Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"☆560Updated 9 months ago
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆190Updated last week
- A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest…☆457Updated last week
- Reaching LLaMA2 Performance with 0.1M Dollars☆985Updated last year
- Official repository of the xLSTM.☆1,992Updated last month
- Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.☆686Updated last year
- The Autograd Engine☆636Updated last year
- Schedule-Free Optimization in PyTorch☆2,217Updated 4 months ago
- First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…☆177Updated 2 months ago
- llama3.np is a pure NumPy implementation for Llama 3 model.☆990Updated 5 months ago
- From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)☆750Updated 11 months ago
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,151Updated 8 months ago