rmwkwok / forward_forward_algorithmLinks
Implementation of Geoffrey Hinton's forward forward algorithm in tensorflow
☆33Updated 2 years ago
Alternatives and similar repositories for forward_forward_algorithm
Users that are interested in forward_forward_algorithm are comparing it to the libraries listed below
Sorting:
- ☆74Updated 2 years ago
- Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer Architecture"☆81Updated last year
- Implementation of Hinton's forward-forward (FF) algorithm in tensorflow - an alternative to back-propagation☆34Updated 2 years ago
- ☆51Updated last year
- Implementation of Block Recurrent Transformer - Pytorch☆221Updated 11 months ago
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆153Updated last year
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆121Updated last year
- A repository for log-time feedforward networks☆222Updated last year
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆82Updated last year
- ☆292Updated 7 months ago
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆45Updated last year
- Forward Pass Learning and Inference Library, for neural networks and general intelligence, Signal Propagation (sigprop)☆55Updated 2 years ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆124Updated last year
- Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch☆94Updated last year
- Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…☆60Updated 2 years ago
- Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.☆172Updated 2 years ago
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated 11 months ago
- Spyx: Spiking Neural Networks in JAX☆123Updated 9 months ago
- A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…☆106Updated last year
- This notebook is designed to plot the attention maps of a vision transformer trained on MNIST digits.☆37Updated last month
- ☆124Updated last month
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆120Updated 9 months ago
- FID computation in Jax/Flax.☆28Updated last year
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆110Updated 2 years ago
- Recursive Leasting Squares (RLS) with Neural Network for fast learning☆54Updated last year
- Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ✅, Pytorch 🔜, and Jax 🔜)☆53Updated last year
- The AdEMAMix Optimizer: Better, Faster, Older.☆183Updated 10 months ago
- PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling☆14Updated 2 years ago
- Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)☆47Updated last year
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆120Updated 9 months ago