Structured state space sequence models
☆2,919Jul 17, 2024Updated 2 years ago
Alternatives and similar repositories for s4
Users that are interested in s4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆324Jan 8, 2025Updated last year
- Implementation of https://srush.github.io/annotated-s4☆519Jun 20, 2025Updated last year
- Mamba SSM architecture☆18,811Jul 22, 2026Updated last month
- ☆204May 27, 2024Updated 2 years ago
- Sequence modeling with Mega.☆302Jan 28, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Sequence Modeling with Structured State Spaces☆69Aug 2, 2022Updated 4 years ago
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆91Mar 1, 2024Updated 2 years ago
- Simple, minimal implementation of the Mamba SSM in one file of PyTorch.☆2,967Mar 8, 2024Updated 2 years ago
- Convolutions for Sequence Modeling☆918Jun 13, 2024Updated 2 years ago
- ☆165Jan 24, 2023Updated 3 years ago
- Long Range Arena for Benchmarking Efficient Transformers☆788Dec 16, 2023Updated 2 years ago
- Repository for the paper: 'Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models'☆335May 24, 2025Updated last year
- Fast and memory-efficient exact attention☆24,856Updated this week
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆9,591Aug 26, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Language Modeling with the H3 State Space Model☆527Sep 29, 2023Updated 2 years ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,696Updated this week
- Collection of papers on state-space models☆619Aug 10, 2026Updated 3 weeks ago
- Pytorch library for fast transformer implementations☆1,780Mar 23, 2023Updated 3 years ago
- Liquid Structural State-Space Models☆396Feb 1, 2024Updated 2 years ago
- A concise but complete full-attention transformer with a set of promising experimental features from various papers☆5,944Updated this week
- Implementation of DiffWave and SaShiMi audio generation models☆128Apr 4, 2023Updated 3 years ago
- Annotated version of the Mamba paper☆502Feb 27, 2024Updated 2 years ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆101Feb 25, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Reading list for research topics in state-space models☆370May 18, 2026Updated 3 months ago
- Differentiable ODE solvers with full GPU support and O(1)-memory backpropagation.☆6,479Apr 4, 2025Updated last year
- 🚀 Efficient implementations for emerging model architectures☆5,710Updated this week
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆88Apr 26, 2024Updated 2 years ago
- Code for SpaceTime 🌌⏱️. Proposed in Effectively Modeling Time Series with Simple Discrete State Spaces, ICLR 2023.☆181Mar 17, 2023Updated 3 years ago
- A simple and efficient Mamba implementation in pure PyTorch and MLX.☆1,479May 3, 2026Updated 4 months ago
- Foundation Architecture for (M)LLMs☆3,139Apr 11, 2024Updated 2 years ago
- A Python package for probabilistic state space modeling with JAX☆1,005Updated this week
- maximal update parametrization (µP)☆1,754Jul 17, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Flax is a neural network library for JAX that is designed for flexibility.☆7,313Aug 31, 2026Updated last week
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆207Aug 26, 2023Updated 3 years ago
- Vector (and Scalar) Quantization, in Pytorch☆4,001Updated this week
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆22,205Aug 26, 2026Updated last week
- Hackable and optimized Transformers building blocks, supporting a composable construction.☆10,545Updated this week
- functorch is JAX-like composable function transforms for PyTorch.☆1,434Aug 21, 2025Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆32,230Sep 30, 2025Updated 11 months ago