rmwkwok / forward_forward_algorithm
Implementation of Geoffrey Hinton's forward forward algorithm in tensorflow
☆32Updated last year
Related projects: ⓘ
- ☆47Updated 5 months ago
- ☆73Updated last year
- A State-Space Model with Rational Transfer Function Representation.☆61Updated 4 months ago
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆117Updated 10 months ago
- PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling☆14Updated last year
- several types of attention modules written in PyTorch☆37Updated 4 months ago
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆105Updated 3 months ago
- Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer Architecture"☆57Updated 11 months ago
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆87Updated 3 weeks ago
- Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…☆54Updated last year
- Implementation of Hinton's forward-forward (FF) algorithm in tensorflow - an alternative to back-propagation☆33Updated last year
- Implementation of GateLoop Transformer in Pytorch and Jax☆86Updated 3 months ago
- This notebook is designed to plot the attention maps of a vision transformer trained on MNIST digits.☆27Updated 3 weeks ago
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆101Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆85Updated last month
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.☆47Updated 5 months ago
- Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.☆54Updated 2 years ago
- Implementation of Agent Attention in Pytorch☆83Updated 2 months ago
- Trying out the Mamba architecture on small examples (cifar-10, shakespeare char level etc.)☆40Updated 9 months ago
- Better implementation of Kolmogorov Arnold Network☆18Updated 3 months ago
- A simple Python implementation of forward-forward NN training by G. Hinton from NeurIPS 2022☆20Updated last year
- The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.☆29Updated this week
- 94% on CIFAR-10 in 3.09 seconds 💨 96% in 27 seconds☆127Updated last month
- FID computation in Jax/Flax.☆23Updated 2 months ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆119Updated 11 months ago
- ☆45Updated 2 years ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆115Updated last month
- ☆32Updated 4 months ago
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆74Updated 7 months ago
- ML/DL Math and Method notes☆56Updated 9 months ago