The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
☆726Nov 25, 2024Updated last year
Alternatives and similar repositories for kan-gpt
Users that are interested in kan-gpt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).☆4,661Aug 1, 2024Updated 2 years ago
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆125May 25, 2024Updated 2 years ago
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆417May 13, 2024Updated 2 years ago
- Kolmogorov Arnold Networks☆16,337Jan 19, 2025Updated last year
- A comprehensive collection of KAN(Kolmogorov-Arnold Network)-related resources, including libraries, projects, tutorials, papers, and mor…☆3,293Sep 11, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Variations of Kolmogorov-Arnold Networks☆116May 15, 2024Updated 2 years ago
- Benchmark for efficiency in memory and time of different KAN implementations.☆140Aug 26, 2024Updated 2 years ago
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆108Oct 4, 2025Updated 11 months ago
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆494Jun 20, 2024Updated 2 years ago
- Kolmogorov-Arnold Network for Reinforcement Leaning, initial experiments☆297Apr 9, 2025Updated last year
- KAN for Vision Transformer☆255Oct 7, 2024Updated last year
- This project extends the idea of the innovative architecture of Kolmogorov-Arnold Networks (KAN) to the Convolutional Layers, changing th…☆921Apr 8, 2025Updated last year
- ☆755May 24, 2024Updated 2 years ago
- TKAN: Temporal Kolmogorov-Arnold Networks☆228Dec 16, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Gemma 2B with 10M context length using Infini-attention.☆932May 12, 2024Updated 2 years ago
- This project is dedicated to the implementation and research of Kolmogorov-Arnold convolutional networks. The repository includes implem…☆529Aug 20, 2026Updated 3 weeks ago
- [ICLR2025] Kolmogorov-Arnold Transformer☆848Mar 23, 2025Updated last year
- PyTorch Kolmogorov-Arnold Networks (spline, Legendre, Chebyshev, convolutional) with quantisation, CUDA, and Integrated-Gradients interpr…☆190Jul 13, 2026Updated 2 months ago
- Reaching LLaMA2 Performance with 0.1M Dollars☆988Jul 23, 2024Updated 2 years ago
- Testing KAN-based text generation GPT models☆19May 6, 2024Updated 2 years ago
- PyTorch native post-training library☆5,812Sep 9, 2026Updated last week
- ☆13Nov 19, 2023Updated 2 years ago
- ☆139May 8, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆44Jun 24, 2024Updated 2 years ago
- Temporal Kolmogorov-Arnold Transformer☆89Dec 27, 2024Updated last year
- A simple feature-based time series classifier using Kolmogorov–Arnold Networks☆121Aug 17, 2024Updated 2 years ago
- Tools for merging pretrained large language models.☆7,357Sep 12, 2026Updated last week
- Mamba SSM architecture☆18,847Jul 22, 2026Updated last month
- Linear Attention Sequence Parallelism (LASP)☆87Jun 4, 2024Updated 2 years ago
- Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with I…☆375Apr 23, 2024Updated 2 years ago
- Transformer model based on Kolmogorov–Arnold Network(KAN), which is an alternative of Multi-Layer Perceptron(MLP)☆29Jul 1, 2026Updated 2 months ago
- Cloudflare Container Rust Example☆17Jun 25, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Official repository of Evolutionary Optimization of Model Merging Recipes☆1,441Nov 29, 2024Updated last year
- Understanding Kolmogorov-Arnold Networks: A Tutorial Series on KAN using Toy Examples☆210May 26, 2025Updated last year
- Kolmogorov-Arnold Networks (KAN) using Jacobi polynomials instead of B-splines.☆39May 9, 2024Updated 2 years ago
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆10,723Jul 1, 2024Updated 2 years ago
- A modified CNN architecture using Kolmogorov-Arnold Networks☆82May 23, 2024Updated 2 years ago
- This repository contains a better implementation of Kolmogorov-Arnold networks☆62Jun 1, 2025Updated last year
- Kolmogorov-Arnold Networks with various basis functions like B-Splines, Fourier, Chebyshev, Wavelets etc☆36May 8, 2024Updated 2 years ago