Adamdad / kat
Kolmogorov-Arnold Transformer: A PyTorch Implementation with CUDA kernel
☆651Updated 3 months ago
Alternatives and similar repositories for kat:
Users that are interested in kat are comparing it to the libraries listed below
- KAN for Vision Transformer☆240Updated 3 months ago
- A More Fair and Comprehensive Comparison between KAN and MLP☆157Updated 5 months ago
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆155Updated this week
- This project extends the idea of the innovative architecture of Kolmogorov-Arnold Networks (KAN) to the Convolutional Layers, changing th…☆818Updated 2 months ago
- xLSTM as Generic Vision Backbone☆456Updated 2 months ago
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆380Updated 7 months ago
- This project is dedicated to the implementation and research of Kolmogorov-Arnold convolutional networks. The repository includes implem…☆462Updated 2 months ago
- An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations☆169Updated 2 months ago
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆359Updated 8 months ago
- Simba☆199Updated 10 months ago
- A curated collection of papers, tutorials, videos, and other valuable resources related to Mamba.☆464Updated this week
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆211Updated 8 months ago
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆191Updated 3 months ago
- ☆44Updated 2 months ago
- Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling☆182Updated this week
- ☆122Updated 8 months ago
- [Mamba-Survey-2024] Paper list for State-Space-Model/Mamba and it's Applications☆663Updated last month
- Benchmark for efficiency in memory and time of different KAN implementations.☆117Updated 5 months ago
- ☆195Updated 3 weeks ago
- Minimal Mamba-2 implementation in PyTorch☆166Updated 7 months ago
- ☆714Updated 8 months ago
- Causal depthwise conv1d in CUDA, with a PyTorch interface☆381Updated last month
- Benchmarking and Testing FastKAN☆70Updated 8 months ago
- Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis☆204Updated 3 months ago
- A simple and efficient Mamba implementation in pure PyTorch and MLX.☆1,112Updated last month
- Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch☆911Updated this week
- Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Mod…☆423Updated this week
- Collection of papers on state-space models☆572Updated this week
- Fast Convolutional KAN☆58Updated 8 months ago
- Awesome Papers related to Mamba.☆1,292Updated 3 months ago