quiqi / relu_kan
☆79Updated 7 months ago
Alternatives and similar repositories for relu_kan:
Users that are interested in relu_kan are comparing it to the libraries listed below
- Kolmogorov-Arnold Networks (KAN) using Jacobi polynomials instead of B-splines.☆35Updated 8 months ago
- Benchmarking and Testing FastKAN☆68Updated 7 months ago
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆102Updated 2 months ago
- Benchmark for efficiency in memory and time of different KAN implementations.☆114Updated 4 months ago
- Kolmogorov-Arnold Networks (KAN) using orthogonal polynomials instead of B-splines.☆32Updated last month
- ☆36Updated 8 months ago
- This code implements a Radial Basis Function (RBF) based Kolmogorov-Arnold Network (KAN) for function approximation.☆26Updated 7 months ago
- C++ and Cuda ops for fused FourierKAN☆74Updated 8 months ago
- The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.☆31Updated this week
- A modified CNN architecture using Kolmogorov-Arnold Networks☆70Updated 7 months ago
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆20Updated this week
- This repository contains the codes to replicate the simulations from the paper: "Wav-KAN: Wavelet Kolmogorov-Arnold Networks". It showca…☆115Updated last week
- Combine B-Splines (BS) and Radial Basis Functions (RBF) in Kolmogorov-Arnold Networks (KANs)☆25Updated 3 weeks ago
- ☆122Updated 8 months ago
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆377Updated 6 months ago
- FC-KAN: Function Combinations in Kolmogorov-Arnold Networks☆23Updated last month
- This repository contains a better implementation of Kolmogorov-Arnold networks☆59Updated 8 months ago
- An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations☆169Updated last month
- Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)☆42Updated last year
- Kolmogorov-Arnold Networks with various basis functions like B-Splines, Fourier, Chebyshev, Wavelets etc☆32Updated 8 months ago
- Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"☆114Updated 2 months ago
- A State-Space Model with Rational Transfer Function Representation.☆76Updated 8 months ago
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆43Updated 6 months ago
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆113Updated 7 months ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆51Updated 2 months ago
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆357Updated 8 months ago
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆154Updated 2 months ago
- Variations of Kolmogorov-Arnold Networks☆112Updated 8 months ago
- my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture☆129Updated 8 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆50Updated 9 months ago