quiqi / relu_kan
☆77Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for relu_kan
- Benchmark for efficiency in memory and time of different KAN implementations.☆111Updated 2 months ago
- Kolmogorov-Arnold Networks (KAN) using Jacobi polynomials instead of B-splines.☆32Updated 6 months ago
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆103Updated 3 weeks ago
- Kolmogorov-Arnold Networks (KAN) using orthogonal polynomials instead of B-splines.☆30Updated this week
- C++ and Cuda ops for fused FourierKAN☆73Updated 6 months ago
- Benchmarking and Testing FastKAN☆65Updated 5 months ago
- This code implements a Radial Basis Function (RBF) based Kolmogorov-Arnold Network (KAN) for function approximation.☆25Updated 5 months ago
- A More Fair and Comprehensive Comparison between KAN and MLP☆150Updated 3 months ago
- An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations☆160Updated 3 months ago
- A modified CNN architecture using Kolmogorov-Arnold Networks☆65Updated 6 months ago
- Kolmogorov-Arnold Networks with various basis functions like B-Splines, Fourier, Chebyshev, Wavelets etc☆31Updated 6 months ago
- The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.☆31Updated 2 months ago
- A State-Space Model with Rational Transfer Function Representation.☆70Updated 6 months ago
- ☆119Updated 6 months ago
- Combine B-Splines (BS) and Radial Basis Functions (RBF) in Kolmogorov-Arnold Networks (KANs)☆22Updated last week
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆137Updated last week
- Self-Expanding Neural Networks☆36Updated 9 months ago
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆41Updated 11 months ago
- ☆37Updated 6 months ago
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆367Updated 5 months ago
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆21Updated last week
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆85Updated 2 months ago
- ☆39Updated this week
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆50Updated last week
- Fast Convolutional KAN☆55Updated 6 months ago
- MNIST example using Kolmogorov-Arnold Networks☆27Updated 6 months ago
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆349Updated 6 months ago
- This repository contains a better implementation of Kolmogorov-Arnold networks☆59Updated 6 months ago
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆42Updated 5 months ago
- Pytorch implementation of the xLSTM model by Beck et al. (2024)☆141Updated 3 months ago