Klassikcat / KANElectraLinks
Transformer model based on Kolmogorov–Arnold Network(KAN), which is an alternative of Multi-Layer Perceptron(MLP)
☆28Updated 3 months ago
Alternatives and similar repositories for KANElectra
Users that are interested in KANElectra are comparing it to the libraries listed below
Sorting:
- ☆137Updated last year
- An implementation of mLSTM and sLSTM in PyTorch.☆29Updated last year
- Convolutional layer for Kolmogorov-Arnold Network (KAN)☆113Updated 6 months ago
- Simba☆213Updated last year
- State Space Models☆70Updated last year
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆43Updated 10 months ago
- Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"☆118Updated last week
- Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data☆64Updated last year
- Fast Convolutional KAN☆64Updated last year
- ☆75Updated 8 months ago
- Cuda implementation of Extended Long Short Term Memory (xLSTM) with C++ and PyTorch ports☆89Updated last year
- Official repository for CVPR24 Precognition Workshop Paper: VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotem…☆150Updated last year
- Minimal Mamba-2 implementation in PyTorch☆222Updated last year
- A modified CNN architecture using Kolmogorov-Arnold Networks☆83Updated last year
- ☆47Updated last year
- C++ and Cuda ops for fused FourierKAN☆80Updated last year
- PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …☆77Updated 11 months ago
- 🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)☆76Updated last year
- This repository contains the codes to replicate the simulations from the paper: "Wav-KAN: Wavelet Kolmogorov-Arnold Networks". It showca…☆150Updated 4 months ago
- MNIST example using Kolmogorov-Arnold Networks☆28Updated last year
- ☆67Updated 11 months ago
- Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis☆257Updated 2 months ago
- KAN for Vision Transformer☆252Updated last year
- Trainable Highly-expressive Activation Functions. ECCV 2024☆38Updated 7 months ago
- Benchmarking and Testing FastKAN☆85Updated last year
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆56Updated last week
- ☆247Updated 7 months ago
- A Triton Kernel for incorporating Bi-Directionality in Mamba2☆75Updated 10 months ago
- Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling☆206Updated last week
- [NeurIPS2023]Lightweight Vision Transformer with Bidirectional Interaction☆26Updated last year