TariqAHassan / S4Torch
PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
☆70Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for S4Torch
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆64Updated 6 months ago
- ☆261Updated 3 months ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆120Updated last year
- Implementations of various linear RNN layers using pytorch and triton☆46Updated last year
- Unofficial implementation of Linear Recurrent Units, by Deepmind, in Pytorch☆59Updated last year
- ☆167Updated 5 months ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆49Updated last week
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆102Updated last month
- A State-Space Model with Rational Transfer Function Representation.☆70Updated 6 months ago
- Sequence Modeling with Structured State Spaces☆60Updated 2 years ago
- Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)☆47Updated 2 weeks ago
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆77Updated 9 months ago
- Parallelizing non-linear sequential models over the sequence length☆45Updated 3 weeks ago
- Code for SpaceTime 🌌⏱️. Proposed in Effectively Modeling Time Series with Simple Discrete State Spaces, ICLR 2023.☆164Updated last year
- ☆164Updated last year
- The official code 👩💻 for - TOTEM: TOkenized Time Series EMbeddings for General Time Series Analysis☆86Updated 8 months ago
- Implementation of the proposed minGRU in Pytorch☆244Updated last week
- Evaluating the Mamba architecture on the Othello game☆43Updated 6 months ago
- C++ and Cuda ops for fused FourierKAN☆73Updated 6 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆79Updated 9 months ago
- ☆46Updated last month
- A PyTorch implementation of a Generative Flow Network (GFlowNet) proposed by Bengio et al. (2021)☆40Updated last year
- Code repository of the paper "CKConv: Continuous Kernel Convolution For Sequential Data" published at ICLR 2022. https://arxiv.org/abs/21…☆117Updated last year
- Kolmogorov–Arnold Networks with modified activation (using MLP to represent the activation)☆103Updated 3 weeks ago
- Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models☆12Updated 8 months ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆95Updated last year
- A curated list for awesome discrete diffusion models resources.☆67Updated last week
- An annotated implementation of the Hyena Hierarchy paper☆31Updated last year
- Code for GFlowNet-EM, a novel algorithm for fitting latent variable models with compositional latents and an intractable true posterior.☆38Updated 9 months ago
- Gaussian-Bernoulli Restricted Boltzmann Machines☆99Updated last year