rmwkwok / forward_forward_algorithm
Implementation of Geoffrey Hinton's forward forward algorithm in tensorflow
☆33Updated 2 years ago
Alternatives and similar repositories for forward_forward_algorithm:
Users that are interested in forward_forward_algorithm are comparing it to the libraries listed below
- Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…☆55Updated last year
- ☆73Updated 2 years ago
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆145Updated last year
- Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer Architecture"☆70Updated last year
- ☆50Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆95Updated 7 months ago
- Implementation of Agent Attention in Pytorch☆90Updated 8 months ago
- A State-Space Model with Rational Transfer Function Representation.☆78Updated 10 months ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆87Updated 9 months ago
- A simple Python implementation of forward-forward NN training by G. Hinton from NeurIPS 2022☆21Updated 2 years ago
- Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)☆44Updated last year
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆117Updated 5 months ago
- Spyx: Spiking Neural Networks in JAX☆112Updated 5 months ago
- Mobile Viewer for W&B, built on top of Flutter.☆33Updated last year
- ☆30Updated 4 months ago
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆116Updated 10 months ago
- PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling☆14Updated 2 years ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆120Updated 8 months ago
- Collect optimizer related papers, data, repositories☆89Updated 4 months ago
- ☆31Updated 10 months ago
- The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.☆36Updated last month
- Forward Pass Learning and Inference Library, for neural networks and general intelligence, Signal Propagation (sigprop)☆52Updated 2 years ago
- Spiking neuron integration for PyTorch☆40Updated last week
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆102Updated 4 months ago
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆113Updated 5 months ago
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Updated 5 months ago
- Recursive Leasting Squares (RLS) with Neural Network for fast learning☆53Updated last year
- ☆104Updated last week
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆53Updated last year
- ☆52Updated 5 months ago