Adamdad / kat
Kolmogorov-Arnold Transformer: A PyTorch Implementation with CUDA kernel
☆605Updated last month
Related projects ⓘ
Alternatives and complementary repositories for kat
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆137Updated last week
- xLSTM as Generic Vision Backbone☆439Updated 2 weeks ago
- A curated collection of papers, tutorials, videos, and other valuable resources related to Mamba.☆384Updated last week
- Causal depthwise conv1d in CUDA, with a PyTorch interface☆331Updated 3 months ago
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆200Updated 5 months ago
- KAN for Vision Transformer☆232Updated last month
- [Mamba-Survey-2024] Paper list for State-Space-Model/Mamba and it's Applications☆620Updated 3 weeks ago
- Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling☆170Updated last week
- A simple and efficient Mamba implementation in pure PyTorch and MLX.☆1,014Updated 2 months ago
- FastKAN: Very Fast Implementation of Kolmogorov-Arnold Networks (KAN)☆367Updated 5 months ago
- Collection of papers on state-space models☆556Updated 2 weeks ago
- Awesome list of papers that extend Mamba to various applications.☆128Updated 2 months ago
- Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis☆197Updated last month
- ☆326Updated 2 weeks ago
- Minimal Mamba-2 implementation in PyTorch☆136Updated 5 months ago
- Simba☆182Updated 7 months ago
- Collection of awesome parameter-efficient fine-tuning resources.☆484Updated 3 months ago
- Reading list for research topics in state-space models☆242Updated 2 weeks ago
- Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Mod…☆396Updated last week
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆157Updated 3 weeks ago
- A More Fair and Comprehensive Comparison between KAN and MLP☆150Updated 3 months ago
- An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations☆160Updated 3 months ago
- Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States☆1,044Updated 4 months ago
- Benchmark for efficiency in memory and time of different KAN implementations.☆111Updated 2 months ago
- Awesome Papers related to Mamba.☆1,224Updated last month
- ☆231Updated 2 months ago
- Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)☆149Updated 10 months ago
- ☆39Updated this week
- Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone☆820Updated last month
- Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States☆366Updated 3 months ago