sap-ient-ai / FFF
FastFeedForward Networks
☆19Updated last year
Alternatives and similar repositories for FFF:
Users that are interested in FFF are comparing it to the libraries listed below
- ☆49Updated 4 months ago
- ☆27Updated 6 months ago
- ☆53Updated last year
- Implementation of GateLoop Transformer in Pytorch and Jax☆87Updated 7 months ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated last year
- ☆49Updated 10 months ago
- Memoria is a human-inspired memory architecture for neural networks.☆59Updated 2 months ago
- RWKV model implementation☆37Updated last year
- ☆22Updated last year
- ☆26Updated 10 months ago
- Latent Large Language Models☆17Updated 4 months ago
- Jax like function transformation engine but micro, microjax☆30Updated 2 months ago
- ☆50Updated 3 months ago
- Training Models Daily☆17Updated last year
- GoldFinch and other hybrid transformer components☆42Updated 5 months ago
- Experiment of using Tangent to autodiff triton☆74Updated 11 months ago
- ☆56Updated last week
- gzip Predicts Data-dependent Scaling Laws☆33Updated 7 months ago
- Implementation of Spectral State Space Models☆16Updated 10 months ago
- [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluating☆33Updated this week
- RWKV-7: Surpassing GPT☆71Updated 2 months ago
- ☆78Updated 9 months ago
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆35Updated last year
- Experiments for efforts to train a new and improved t5☆77Updated 9 months ago
- Learn online intrinsic rewards from LLM feedback☆33Updated last month
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆29Updated 7 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 7 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆14Updated 2 weeks ago
- ☆22Updated 2 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆26Updated this week