Trel725 / forward-forwardLinks
A simple Python implementation of forward-forward NN training by G. Hinton from NeurIPS 2022
☆21Updated 2 years ago
Alternatives and similar repositories for forward-forward
Users that are interested in forward-forward are comparing it to the libraries listed below
Sorting:
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Updated 2 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated last year
- ☆75Updated 2 years ago
- Omnigrok: Grokking Beyond Algorithmic Data☆61Updated 2 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆62Updated 4 years ago
- Machine Learning eXperiment Utilities☆46Updated last month
- Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.☆39Updated last year
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆79Updated 3 years ago
- ☆65Updated 3 years ago
- [NeurIPS 2023] Learning Transformer Programs☆163Updated last year
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆187Updated 3 years ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago
- CIFAR10 ResNets implemented in JAX+Flax☆12Updated 3 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆90Updated last year
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆136Updated last year
- ☆133Updated 4 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆59Updated 2 years ago
- ☆52Updated last year
- ☆70Updated 8 months ago
- Codebase for Mechanistic Mode Connectivity☆15Updated 2 years ago
- Implementation of Forward Forward Network proposed by Hinton in NIPS 2022.☆170Updated 2 years ago
- The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…☆46Updated last year
- Inference code for LLaMA models in JAX☆118Updated last year
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆155Updated last year
- ☆166Updated 2 years ago
- ☆38Updated last year
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆111Updated 2 years ago
- A centralized place for deep thinking code and experiments☆86Updated 2 years ago
- ☆60Updated 3 years ago