rmwkwok / forward_forward_algorithmLinks
Implementation of Geoffrey Hinton's forward forward algorithm in tensorflow
☆35Updated 2 years ago
Alternatives and similar repositories for forward_forward_algorithm
Users that are interested in forward_forward_algorithm are comparing it to the libraries listed below
Sorting:
- Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer Architecture"☆84Updated 2 years ago
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆124Updated last year
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆120Updated last year
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆156Updated last year
- Implementation of Block Recurrent Transformer - Pytorch☆221Updated last year
- Spyx: Spiking Neural Networks in JAX☆125Updated last year
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆86Updated last year
- ☆51Updated last year
- Implementation/simulation of the predictive forward-forward credit assignment algorithm for training neurobiologically-plausible recurren…☆60Updated 2 years ago
- ☆75Updated 2 years ago
- Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.☆391Updated last year
- Collect optimizer related papers, data, repositories☆97Updated 11 months ago
- Forward Pass Learning and Inference Library, for neural networks and general intelligence, Signal Propagation (sigprop)☆55Updated 2 years ago
- optimizer & lr scheduler & loss function collections in PyTorch☆365Updated this week
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆45Updated last year
- ☆127Updated 2 months ago
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆119Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆99Updated last year
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆123Updated last year
- Implementation of Forward Forward Network proposed by Hinton in NIPS 2022.☆170Updated 2 years ago
- Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.☆37Updated 2 years ago
- [ICLR 2023] "Dilated convolution with learnable spacings" Ismail Khalfaoui Hassani, Thomas Pellegrini and Timothée Masquelier☆71Updated last year
- A repository for log-time feedforward networks☆222Updated last year
- Implementation of Hinton's forward-forward (FF) algorithm in tensorflow - an alternative to back-propagation☆35Updated 2 years ago
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds☆313Updated 3 months ago
- Implementation of Liquid Nets in Pytorch☆67Updated this week
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆129Updated last week
- Implementation of Agent Attention in Pytorch☆91Updated last year
- Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.☆173Updated 2 years ago
- A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…☆106Updated last year