srush / annotated-s4Links
Implementation of https://srush.github.io/annotated-s4
☆504Updated 4 months ago
Alternatives and similar repositories for annotated-s4
Users that are interested in annotated-s4 are comparing it to the libraries listed below
Sorting:
- ☆307Updated 10 months ago
- Annotated version of the Mamba paper☆490Updated last year
- ☆259Updated 5 months ago
- Long Range Arena for Benchmarking Efficient Transformers☆767Updated last year
- ☆363Updated last year
- ☆189Updated last year
- Accelerated First Order Parallel Associative Scan☆191Updated last year
- Sequence modeling with Mega.☆301Updated 2 years ago
- ☆285Updated last year
- Named tensors with first-class dimensions for PyTorch☆331Updated 2 years ago
- Language Modeling with the H3 State Space Model☆518Updated 2 years ago
- ☆164Updated 2 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆679Updated last week
- Neural Networks and the Chomsky Hierarchy☆211Updated last year
- For optimization algorithm research and development.☆543Updated last week
- Code for our NeurIPS 2022 paper☆369Updated 2 years ago
- Implementation of Block Recurrent Transformer - Pytorch☆221Updated last year
- Puzzles for exploring transformers☆376Updated 2 years ago
- Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch☆779Updated 3 months ago
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆126Updated last year
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆400Updated last week
- ☆312Updated 8 months ago
- JAX Synergistic Memory Inspector☆179Updated last year
- ☆234Updated 9 months ago
- ☆222Updated 11 months ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆259Updated 2 years ago
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆369Updated last year
- A repository for log-time feedforward networks☆222Updated last year
- Efficient optimizers☆276Updated last month
- Load tensorboard event logs as pandas DataFrames for scientific plotting; Supports both PyTorch and TensorFlow☆205Updated last year