Structured state space sequence models
☆2,927Jul 17, 2024Updated 2 years ago
Alternatives and similar repositories for s4
Users that are interested in s4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆325Jan 8, 2025Updated last year
- Implementation of https://srush.github.io/annotated-s4☆519Jun 20, 2025Updated last year
- Mamba SSM architecture☆18,923Jul 22, 2026Updated 2 months ago
- ☆206May 27, 2024Updated 2 years ago
- Sequence modeling with Mega.☆300Jan 28, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Sequence Modeling with Structured State Spaces☆69Aug 2, 2022Updated 4 years ago
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆91Mar 1, 2024Updated 2 years ago
- Simple, minimal implementation of the Mamba SSM in one file of PyTorch.☆2,968Mar 8, 2024Updated 2 years ago
- Convolutions for Sequence Modeling☆920Jun 13, 2024Updated 2 years ago
- ☆165Jan 24, 2023Updated 3 years ago
- Long Range Arena for Benchmarking Efficient Transformers☆788Dec 16, 2023Updated 2 years ago
- Fast and memory-efficient exact attention☆25,140Updated this week
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆9,622Aug 26, 2026Updated last month
- Language Modeling with the H3 State Space Model☆527Sep 29, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,751Sep 28, 2026Updated 2 weeks ago
- Collection of papers on state-space models☆621Oct 1, 2026Updated 2 weeks ago
- Pytorch library for fast transformer implementations☆1,782Mar 23, 2023Updated 3 years ago
- Liquid Structural State-Space Models☆397Feb 1, 2024Updated 2 years ago
- A concise but complete full-attention transformer with a set of promising experimental features from various papers☆5,959Oct 5, 2026Updated last week
- Implementation of DiffWave and SaShiMi audio generation models☆129Apr 4, 2023Updated 3 years ago
- Annotated version of the Mamba paper☆504Feb 27, 2024Updated 2 years ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆100Feb 25, 2023Updated 3 years ago
- Reading list for research topics in state-space models☆373May 18, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Differentiable ODE solvers with full GPU support and O(1)-memory backpropagation.☆6,490Apr 4, 2025Updated last year
- 🚀 Efficient implementations for emerging model architectures☆5,881Updated this week
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆88Apr 26, 2024Updated 2 years ago
- Code for SpaceTime 🌌⏱️. Proposed in Effectively Modeling Time Series with Simple Discrete State Spaces, ICLR 2023.☆179Mar 17, 2023Updated 3 years ago
- A simple and efficient Mamba implementation in pure PyTorch and MLX.☆1,480May 3, 2026Updated 5 months ago
- Foundation Architecture for (M)LLMs☆3,143Apr 11, 2024Updated 2 years ago
- A Python package for probabilistic state space modeling with JAX☆1,019Updated this week
- maximal update parametrization (µP)☆1,756Jul 17, 2024Updated 2 years ago
- Flax is a neural network library for JAX that is designed for flexibility.☆7,345Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆206Aug 26, 2023Updated 3 years ago
- Vector (and Scalar) Quantization, in Pytorch☆4,013Sep 24, 2026Updated 3 weeks ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆22,234Sep 21, 2026Updated 3 weeks ago
- Hackable and optimized Transformers building blocks, supporting a composable construction.☆10,567Oct 9, 2026Updated last week
- functorch is JAX-like composable function transforms for PyTorch.☆1,434Aug 21, 2025Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆32,212Sep 30, 2025Updated last year
- Accelerated First Order Parallel Associative Scan☆198Jan 7, 2026Updated 9 months ago