AdityaNG / kan-gptLinks
The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
☆724Updated 11 months ago
Alternatives and similar repositories for kan-gpt
Users that are interested in kan-gpt are comparing it to the libraries listed below
Sorting:
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆392Updated last year
- ☆743Updated last year
- Variations of Kolmogorov-Arnold Networks☆115Updated last year
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆444Updated last year
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆923Updated this week
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆121Updated last year
- An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations☆186Updated 11 months ago
- An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).☆4,498Updated last year
- A comprehensive collection of KAN(Kolmogorov-Arnold Network)-related resources, including libraries, projects, tutorials, papers, and mor…☆3,099Updated 4 months ago
- This project extends the idea of the innovative architecture of Kolmogorov-Arnold Networks (KAN) to the Convolutional Layers, changing th…☆902Updated 6 months ago
- Build high-performance AI models with modular building blocks☆559Updated last week
- Understanding Kolmogorov-Arnold Networks: A Tutorial Series on KAN using Toy Examples☆200Updated 5 months ago
- Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"☆564Updated last year
- Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"☆560Updated 10 months ago
- ☆446Updated last year
- Mamba-Chat: A chat LLM based on the state-space model architecture 🐍☆933Updated last year
- PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…☆292Updated last year
- Official repository of the xLSTM.☆2,016Updated this week
- An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"☆1,205Updated 2 years ago
- Annotated version of the Mamba paper☆490Updated last year
- Open weights language model from Google DeepMind, based on Griffin.☆652Updated 5 months ago
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆193Updated last week
- Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793☆440Updated 5 months ago
- llama3.np is a pure NumPy implementation for Llama 3 model.☆991Updated 6 months ago
- Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.☆685Updated last year
- Schedule-Free Optimization in PyTorch☆2,229Updated 5 months ago
- Implementation on how to use Kolmogorov-Arnold Networks (KANs) for classification and regression tasks.☆256Updated last year
- 👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]☆636Updated last year
- Interactively inspect module inputs, outputs, parameters, and gradients.☆352Updated 5 months ago
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,420Updated this week