srush / annotated-s4Links
Implementation of https://srush.github.io/annotated-s4
☆514Updated 7 months ago
Alternatives and similar repositories for annotated-s4
Users that are interested in annotated-s4 are comparing it to the libraries listed below
Sorting:
- ☆314Updated last year
- Annotated version of the Mamba paper☆496Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆693Updated 2 weeks ago
- ☆291Updated last year
- Accelerated First Order Parallel Associative Scan☆196Updated last month
- ☆194Updated last year
- Long Range Arena for Benchmarking Efficient Transformers☆777Updated 2 years ago
- ☆259Updated 8 months ago
- ☆367Updated last year
- For optimization algorithm research and development.☆558Updated 3 weeks ago
- Sequence modeling with Mega.☆303Updated 3 years ago
- Named tensors with first-class dimensions for PyTorch☆332Updated 2 years ago
- ☆234Updated 11 months ago
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆130Updated last year
- JAX Synergistic Memory Inspector☆184Updated last year
- Efficient optimizers☆281Updated last month
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆406Updated this week
- Puzzles for exploring transformers☆386Updated 2 years ago
- Neural Networks and the Chomsky Hierarchy☆212Updated last year
- ☆246Updated last year
- Language Modeling with the H3 State Space Model☆522Updated 2 years ago
- ☆492Updated last year
- ☆163Updated 3 years ago
- 🧱 Modula software package☆322Updated 5 months ago
- Understand and test language model architectures on synthetic tasks.☆252Updated 3 weeks ago
- Code for our NeurIPS 2022 paper☆371Updated 3 years ago
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆378Updated last year
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds☆352Updated 2 months ago
- TensorDict is a pytorch dedicated tensor container.☆1,003Updated this week
- maximal update parametrization (µP)☆1,673Updated last year