yhgon / NoPropLinks
implement of NoProp-CT
☆24Updated 6 months ago
Alternatives and similar repositories for NoProp
Users that are interested in NoProp are comparing it to the libraries listed below
Sorting:
- Oscillatory State-Space Models☆102Updated this week
- PyTorch implementation of the groundbreaking paper "NoProp: Training Neural Networks Without Backpropagation or Forward Propagation".☆62Updated 6 months ago
- ☆68Updated last year
- [IEEE Trans. AI 2024] Spiking Diffusion Models☆46Updated 6 months ago
- ☆137Updated last year
- Benchmarking and Testing FastKAN☆86Updated last year
- ☆42Updated last year
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆192Updated last week
- ☆75Updated 8 months ago
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆125Updated last year
- ☆128Updated 2 months ago
- A Triton Kernel for incorporating Bi-Directionality in Mamba2☆75Updated 10 months ago
- Minimal Mamba-2 implementation in PyTorch☆228Updated last year
- Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch☆94Updated 8 months ago
- When it comes to optimizers, it's always better to be safe than sorry☆376Updated last month
- Implementation of the proposed minGRU in Pytorch☆306Updated 7 months ago
- A More Fair and Comprehensive Comparison between KAN and MLP☆175Updated last year
- [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule☆337Updated last month
- This repository contains an experimental PyTorch implementation exploring the NoProp algorithm, presented in the paper "NOPROP: TRAINING …☆15Updated 4 months ago
- Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer Architecture"☆84Updated 2 years ago
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆228Updated 2 weeks ago
- ☆50Updated 9 months ago
- Pytorch implementation of Evolutionary Policy Optimization, from Wang et al. of the Robotics Institute at Carnegie Mellon University☆103Updated last month
- An open source implementation of LFMs from Liquid AI: Liquid Foundation Models☆193Updated 2 weeks ago
- Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling☆207Updated 2 weeks ago
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆106Updated 3 weeks ago
- Awesome list of papers that extend Mamba to various applications.☆138Updated 4 months ago
- Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…☆113Updated last week
- Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"☆91Updated 2 weeks ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆56Updated last week