loeweX / Forward-Forward
Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm
☆144Updated last year
Alternatives and similar repositories for Forward-Forward:
Users that are interested in Forward-Forward are comparing it to the libraries listed below
- Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…☆55Updated last year
- Forward Pass Learning and Inference Library, for neural networks and general intelligence, Signal Propagation (sigprop)☆52Updated 2 years ago
- Explorations with Geoffrey Hinton's Forward Forward algoithm☆33Updated last year
- Implementation of Forward Forward Network proposed by Hinton in NIPS 2022.☆167Updated 2 years ago
- Spyx: Spiking Neural Networks in JAX☆112Updated 5 months ago
- ☆60Updated 3 years ago
- PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…☆31Updated 3 years ago
- Parallelizing non-linear sequential models over the sequence length☆51Updated 2 months ago
- ☆220Updated last month
- ☆286Updated 2 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆108Updated 3 months ago
- ☆202Updated 2 years ago
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆108Updated last year
- ☆70Updated last year
- A pytorch implementation of Cascaded Forward (CaFo) Algorithm☆21Updated 2 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆170Updated 3 months ago
- A lightweight and flexible framework for Hebbian learning in PyTorch.☆82Updated last year
- ☆54Updated 7 months ago
- ☆52Updated 5 months ago
- ☆28Updated 2 years ago
- ☆121Updated last year
- Fast training of unitary deep network layers from low-rank updates☆29Updated 2 years ago
- Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.☆166Updated last year
- Implementation of https://srush.github.io/annotated-s4☆485Updated 2 years ago
- PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling☆14Updated 2 years ago
- Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural la…☆87Updated 2 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆35Updated 2 years ago
- A centralized place for deep thinking code and experiments☆82Updated last year
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆76Updated 2 years ago
- Understand and test language model architectures on synthetic tasks.☆185Updated 2 weeks ago