ruke1ire / RTF
A State-Space Model with Rational Transfer Function Representation.
☆78Updated 10 months ago
Alternatives and similar repositories for RTF:
Users that are interested in RTF are comparing it to the libraries listed below
- ☆52Updated 5 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆83Updated last year
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆122Updated last year
- Implementation of GateLoop Transformer in Pytorch and Jax☆87Updated 9 months ago
- ☆31Updated 11 months ago
- ☆79Updated 11 months ago
- Diffusion models in PyTorch☆99Updated last week
- Implementations of various linear RNN layers using pytorch and triton☆50Updated last year
- ☆30Updated 4 months ago
- ☆31Updated 10 months ago
- Parallelizing non-linear sequential models over the sequence length☆51Updated 2 months ago
- Griffin MQA + Hawk Linear RNN Hybrid☆85Updated 11 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆98Updated 3 months ago
- Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.☆50Updated last week
- ☆53Updated last year
- A MAD laboratory to improve AI architecture designs 🧪☆108Updated 3 months ago
- ☆59Updated 4 months ago
- Experiments on the impact of depth in transformers and SSMs.☆23Updated 4 months ago
- ☆172Updated 4 months ago
- Explorations into the recently proposed Taylor Series Linear Attention☆96Updated 7 months ago
- FlashRNN - Fast RNN Kernels with I/O Awareness☆76Updated last week
- Flow-matching algorithms in JAX☆86Updated 7 months ago
- Accelerated First Order Parallel Associative Scan☆180Updated 7 months ago
- Implementation of PSGD optimizer in JAX☆30Updated 3 months ago
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆78Updated last year
- 🧱 Modula software package☆187Updated this week
- ☆30Updated 5 months ago
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆76Updated 11 months ago
- supporting pytorch FSDP for optimizers☆80Updated 3 months ago
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆44Updated 9 months ago