expz / annotated-hyenaLinks
An annotated implementation of the Hyena Hierarchy paper
☆34Updated 2 years ago
Alternatives and similar repositories for annotated-hyena
Users that are interested in annotated-hyena are comparing it to the libraries listed below
Sorting:
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆91Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆89Updated last year
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆53Updated last year
- ☆58Updated last year
- Triton Implementation of HyperAttention Algorithm☆48Updated last year
- [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)☆33Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)