sap-ient-ai / FFFLinks
FastFeedForward Networks
☆20Updated 2 years ago
Alternatives and similar repositories for FFF
Users that are interested in FFF are comparing it to the libraries listed below
Sorting:
- ☆105Updated 4 months ago
- ☆82Updated last year
- Jax like function transformation engine but micro, microjax☆33Updated last year
- Token Omission Via Attention☆128Updated last year
- Memoria is a human-inspired memory architecture for neural networks.☆79Updated last year
- ☆53Updated last year
- ☆29Updated last year
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆38Updated 6 months ago
- GoldFinch and other hybrid transformer components☆45Updated last year
- ☆58Updated 3 weeks ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆130Updated last year
- Implementation of Spectral State Space Models☆16Updated last year
- H-Net Dynamic Hierarchical Architecture☆80Updated 3 months ago
- ☆28Updated last year
- ☆34Updated last year
- ☆50Updated last year
- RWKV-7: Surpassing GPT☆101Updated last year
- Experiment of using Tangent to autodiff triton☆81Updated last year
- Experiments for efforts to train a new and improved t5☆76Updated last year
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆103Updated 11 months ago
- ☆24Updated last year
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- A repository for research on medium sized language models.☆78Updated last year
- HomebrewNLP in JAX flavour for maintable TPU-Training☆51Updated last year
- train with kittens!☆63Updated last year
- Implementation of GateLoop Transformer in Pytorch and Jax☆91Updated last year
- Evaluating the Mamba architecture on the Othello game☆48Updated last year
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆41Updated last year
- Collection of autoregressive model implementation☆85Updated 7 months ago
- [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluation☆57Updated last week