Structured state space sequence models
☆2,925Jul 17, 2024Updated 2 years ago
Alternatives and similar repositories for s4
Users that are interested in s4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆325Jan 8, 2025Updated last year
- Implementation of https://srush.github.io/annotated-s4☆519Jun 20, 2025Updated last year
- Mamba SSM architecture☆18,873Jul 22, 2026Updated 2 months ago
- ☆206May 27, 2024Updated 2 years ago
- Sequence modeling with Mega.☆301Jan 28, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sequence Modeling with Structured State Spaces☆69Aug 2, 2022Updated 4 years ago
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆91Mar 1, 2024Updated 2 years ago
- Simple, minimal implementation of the Mamba SSM in one file of PyTorch.☆2,970Mar 8, 2024Updated 2 years ago
- Convolutions for Sequence Modeling☆918Jun 13, 2024Updated 2 years ago
- ☆165Jan 24, 2023Updated 3 years ago
- Long Range Arena for Benchmarking Efficient Transformers☆788Dec 16, 2023Updated 2 years ago
- Repository for the paper: 'Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models'☆335May 24, 2025Updated last year
- Fast and memory-efficient exact attention☆25,022Updated this week
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆9,605Aug 26, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Language Modeling with the H3 State Space Model☆527Sep 29, 2023Updated 2 years ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,728Updated this week
- Collection of papers on state-space models☆620Aug 10, 2026Updated last month
- Pytorch library for fast transformer implementations☆1,781Mar 23, 2023Updated 3 years ago
- Liquid Structural State-Space Models☆396Feb 1, 2024Updated 2 years ago
- A concise but complete full-attention transformer with a set of promising experimental features from various papers☆5,948Updated this week
- Implementation of DiffWave and SaShiMi audio generation models☆129Apr 4, 2023Updated 3 years ago
- Annotated version of the Mamba paper☆504Feb 27, 2024Updated 2 years ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆100Feb 25, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Reading list for research topics in state-space models☆372May 18, 2026Updated 4 months ago
- Differentiable ODE solvers with full GPU support and O(1)-memory backpropagation.☆6,482Apr 4, 2025Updated last year
- 🚀 Efficient implementations for emerging model architectures☆5,795Updated this week
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆88Apr 26, 2024Updated 2 years ago
- Code for SpaceTime 🌌⏱️. Proposed in Effectively Modeling Time Series with Simple Discrete State Spaces, ICLR 2023.☆180Mar 17, 2023Updated 3 years ago
- A simple and efficient Mamba implementation in pure PyTorch and MLX.☆1,481May 3, 2026Updated 4 months ago
- Foundation Architecture for (M)LLMs☆3,141Apr 11, 2024Updated 2 years ago
- A Python package for probabilistic state space modeling with JAX☆1,013Sep 16, 2026Updated last week
- maximal update parametrization (µP)☆1,758Jul 17, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Flax is a neural network library for JAX that is designed for flexibility.☆7,332Updated this week
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆206Aug 26, 2023Updated 3 years ago
- Vector (and Scalar) Quantization, in Pytorch☆4,008Updated this week
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆22,226Sep 21, 2026Updated last week
- Hackable and optimized Transformers building blocks, supporting a composable construction.☆10,552Updated this week
- functorch is JAX-like composable function transforms for PyTorch.☆1,434Aug 21, 2025Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆32,219Sep 30, 2025Updated 11 months ago