Klassikcat / KANElectra
Transformer model based on Kolmogorov–Arnold Network(KAN), which is an alternative of Multi-Layer Perceptron(MLP)
☆26Updated last month
Alternatives and similar repositories for KANElectra:
Users that are interested in KANElectra are comparing it to the libraries listed below
- ☆122Updated 8 months ago
- Fast Convolutional KAN☆58Updated 8 months ago
- C++ and Cuda ops for fused FourierKAN☆74Updated 8 months ago
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆43Updated last month
- This repository contains the codes to replicate the simulations from the paper: "Wav-KAN: Wavelet Kolmogorov-Arnold Networks". It showca…☆115Updated last week
- Trainable Highly-expressive Activation Functions. ECCV 2024☆35Updated 2 months ago
- An implementation of mLSTM and sLSTM in PyTorch.☆27Updated 7 months ago
- Convolutional layer for Kolmogorov-Arnold Network (KAN)☆83Updated 7 months ago
- State Space Models☆64Updated 8 months ago
- Simba☆194Updated 9 months ago
- Kolmogorov-Arnold Networks (KAN) using Jacobi polynomials instead of B-splines.☆35Updated 8 months ago
- [NeurIPS2023]Lightweight Vision Transformer with Bidirectional Interaction☆23Updated last year
- 🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)☆76Updated 8 months ago
- A modified CNN architecture using Kolmogorov-Arnold Networks☆70Updated 7 months ago
- Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data☆55Updated 6 months ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆51Updated 2 months ago
- ☆45Updated 9 months ago
- MNIST example using Kolmogorov-Arnold Networks☆27Updated 8 months ago
- A Triton Kernel for incorporating Bi-Directionality in Mamba2☆60Updated last month
- Mamba or Transformer for Time Series Forecasting? Mixture of Universals (MoU) Is All You Need.☆38Updated 4 months ago
- ☆64Updated 2 months ago
- Official Code for "CMamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting"☆24Updated last week
- A pytorch implementation of Fourier Analysis Networks (FAN)☆29Updated 3 months ago
- ☆42Updated last month
- Cuda implementation of Extended Long Short Term Memory (xLSTM) with C++ and PyTorch ports☆84Updated 7 months ago
- PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …☆50Updated 2 months ago
- Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"☆114Updated 2 months ago
- Kolmogorov–Arnold Networks (KAN) in PyTorch☆20Updated 8 months ago
- A simpler Pytorch + Zeta Implementation of the paper: "SiMBA: Simplified Mamba-based Architecture for Vision and Multivariate Time series…☆27Updated 2 months ago
- Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…☆67Updated 2 months ago