Adamdad / katLinks
[ICLR2025] Kolmogorov-Arnold Transformer
☆853Updated 10 months ago
Alternatives and similar repositories for kat
Users that are interested in kat are comparing it to the libraries listed below
Sorting:
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆302Updated last year
- KAN for Vision Transformer☆256Updated last year
- This project extends the idea of the innovative architecture of Kolmogorov-Arnold Networks (KAN) to the Convolutional Layers, changing th…☆913Updated 9 months ago
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆467Updated last year
- xLSTM as Generic Vision Backbone☆491Updated 3 months ago
- Code release for DynamicTanh (DyT)☆1,034Updated 10 months ago
- ☆748Updated last year
- ☆79Updated last year
- [Mamba-Survey-2024] Paper list for State-Space-Model/Mamba and it's Applications☆746Updated 7 months ago
- ☆140Updated last year
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆402Updated last year
- A curated collection of papers, tutorials, videos, and other valuable resources related to Mamba.☆695Updated 5 months ago
- This project is dedicated to the implementation and research of Kolmogorov-Arnold convolutional networks. The repository includes implem…☆531Updated last year
- A simple and efficient Mamba implementation in pure PyTorch and MLX.☆1,418Updated last week
- An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations☆189Updated last year
- Benchmark for efficiency in memory and time of different KAN implementations.☆138Updated last year
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆205Updated 2 weeks ago
- A More Fair and Comprehensive Comparison between KAN and MLP☆178Updated last year
- Minimal Mamba-2 implementation in PyTorch☆242Updated last year
- Benchmarking and Testing FastKAN☆91Updated last year
- Collection of papers on state-space models☆616Updated 3 months ago
- Awesome Papers related to Mamba.☆1,388Updated last year
- When it comes to optimizers, it's always better to be safe than sorry☆402Updated 4 months ago
- Awesome list of papers that extend Mamba to various applications.☆138Updated 7 months ago
- 🦖Pytorch implementation of popular Attention Mechanisms, Vision Transformers, MLP-Like models and CNNs.🔥🔥🔥☆538Updated 2 years ago
- Causal depthwise conv1d in CUDA, with a PyTorch interface☆711Updated 3 weeks ago
- Collection of awesome parameter-efficient fine-tuning resources.☆585Updated last month
- Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Mod…☆483Updated this week
- Variations of Kolmogorov-Arnold Networks☆116Updated last year
- ☆255Updated 3 months ago