The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
☆725Nov 25, 2024Updated last year
Alternatives and similar repositories for kan-gpt
Users that are interested in kan-gpt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).☆4,649Aug 1, 2024Updated last year
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆123May 25, 2024Updated 2 years ago
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆413May 13, 2024Updated 2 years ago
- Kolmogorov Arnold Networks☆16,306Jan 19, 2025Updated last year
- A comprehensive collection of KAN(Kolmogorov-Arnold Network)-related resources, including libraries, projects, tutorials, papers, and mor…☆3,248Jun 1, 2026Updated 3 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Variations of Kolmogorov-Arnold Networks☆116May 15, 2024Updated 2 years ago
- Benchmark for efficiency in memory and time of different KAN implementations.☆140Aug 26, 2024Updated last year
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆108Oct 4, 2025Updated 8 months ago
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆486Jun 20, 2024Updated 2 years ago
- Kolmogorov-Arnold Network for Reinforcement Leaning, initial experiments☆295Apr 9, 2025Updated last year
- KAN for Vision Transformer☆256Oct 7, 2024Updated last year
- This project extends the idea of the innovative architecture of Kolmogorov-Arnold Networks (KAN) to the Convolutional Layers, changing th…☆920Apr 8, 2025Updated last year
- ☆752May 24, 2024Updated 2 years ago
- TKAN: Temporal Kolmogorov-Arnold Networks☆225Dec 16, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Gemma 2B with 10M context length using Infini-attention.☆933May 12, 2024Updated 2 years ago
- This project is dedicated to the implementation and research of Kolmogorov-Arnold convolutional networks. The repository includes implem…☆531Nov 19, 2024Updated last year
- [ICLR2025] Kolmogorov-Arnold Transformer☆847Mar 23, 2025Updated last year
- An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations☆190Nov 24, 2024Updated last year
- Reaching LLaMA2 Performance with 0.1M Dollars☆986Jul 23, 2024Updated last year
- Cloudflare Container Rust Example☆17Jun 25, 2025Updated last year
- PyTorch native post-training library☆5,777Updated this week
- Testing KAN-based text generation GPT models☆19May 6, 2024Updated 2 years ago
- ☆13Nov 19, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆139May 8, 2024Updated 2 years ago
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆44Jun 24, 2024Updated 2 years ago
- Temporal Kolmogorov-Arnold Transformer☆88Dec 27, 2024Updated last year
- Tools for merging pretrained large language models.☆7,173Jun 17, 2026Updated last week
- A simple feature-based time series classifier using Kolmogorov–Arnold Networks☆121Aug 17, 2024Updated last year
- Mamba SSM architecture☆18,481Jun 15, 2026Updated 2 weeks ago
- Linear Attention Sequence Parallelism (LASP)☆87Jun 4, 2024Updated 2 years ago
- Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with I…☆376Apr 23, 2024Updated 2 years ago
- Official repository of Evolutionary Optimization of Model Merging Recipes☆1,426Nov 29, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Transformer model based on Kolmogorov–Arnold Network(KAN), which is an alternative of Multi-Layer Perceptron(MLP)☆29May 19, 2026Updated last month
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆10,598Jul 1, 2024Updated last year
- Understanding Kolmogorov-Arnold Networks: A Tutorial Series on KAN using Toy Examples☆205May 26, 2025Updated last year
- Kolmogorov-Arnold Networks (KAN) using Jacobi polynomials instead of B-splines.☆39May 9, 2024Updated 2 years ago
- Kolmogorov-Arnold Networks with various basis functions like B-Splines, Fourier, Chebyshev, Wavelets etc☆36May 8, 2024Updated 2 years ago
- This repository contains a better implementation of Kolmogorov-Arnold networks☆62Jun 1, 2025Updated last year
- Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"☆3,327May 4, 2024Updated 2 years ago