Implementation of https://srush.github.io/annotated-s4
☆512Jun 20, 2025Updated 8 months ago
Alternatives and similar repositories for annotated-s4
Users that are interested in annotated-s4 are comparing it to the libraries listed below
Sorting:
- Structured state space sequence models☆2,854Jul 17, 2024Updated last year
- ☆316Jan 8, 2025Updated last year
- Annotated version of the Mamba paper☆497Feb 27, 2024Updated 2 years ago
- Accelerated First Order Parallel Associative Scan☆194Jan 7, 2026Updated last month
- Sequence Modeling with Structured State Spaces☆67Aug 2, 2022Updated 3 years ago
- ☆35Nov 22, 2024Updated last year
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆89Mar 1, 2024Updated 2 years ago
- ☆51Jan 28, 2024Updated 2 years ago
- Recursive Bayesian Networks☆11May 11, 2025Updated 9 months ago
- Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …☆117Mar 16, 2024Updated last year
- What would you do with 1000 H100s...☆1,154Jan 10, 2024Updated 2 years ago
- maximal update parametrization (µP)☆1,686Jul 17, 2024Updated last year
- Reading list for research topics in state-space models☆347Jun 11, 2025Updated 8 months ago
- Convolutions for Sequence Modeling☆912Jun 13, 2024Updated last year
- ☆29Nov 30, 2021Updated 4 years ago
- Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/☆2,792Feb 23, 2026Updated last week
- Train very large language models in Jax.☆210Oct 21, 2023Updated 2 years ago
- Simple, minimal implementation of the Mamba SSM in one file of PyTorch.☆2,921Mar 8, 2024Updated last year
- Sequence modeling with Mega.☆303Jan 28, 2023Updated 3 years ago
- Language Modeling with the H3 State Space Model☆522Sep 29, 2023Updated 2 years ago
- JAX/Flax implementation of the Hyena Hierarchy☆34Apr 27, 2023Updated 2 years ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆248Jun 6, 2025Updated 8 months ago
- FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores☆343Dec 28, 2024Updated last year
- ☆164Jan 24, 2023Updated 3 years ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆93Jan 25, 2024Updated 2 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆695Jan 26, 2026Updated last month
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆11Mar 18, 2023Updated 2 years ago
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- Helpful tools and examples for working with flex-attention☆1,136Feb 8, 2026Updated 3 weeks ago
- ☆13Oct 5, 2025Updated 4 months ago
- train with kittens!☆63Oct 25, 2024Updated last year
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,123Apr 20, 2022Updated 3 years ago
- Optax is a gradient processing and optimization library for JAX.☆2,193Feb 24, 2026Updated last week
- Blog post☆17Feb 16, 2024Updated 2 years ago
- ☆39Apr 5, 2024Updated last year
- Some preliminary explorations of Mamba's context scaling.☆218Feb 8, 2024Updated 2 years ago
- Mamba SSM architecture☆17,257Feb 18, 2026Updated last week
- A Python package for probabilistic state space modeling with JAX☆932Jan 6, 2026Updated last month
- Understand and test language model architectures on synthetic tasks.☆254Feb 24, 2026Updated last week