carloalbertobarbano / forward-forward-pytorchLinks
PyTorch implementation of Hinton's FF Algorithm with hard negatives sampling
☆15Updated 2 years ago
Alternatives and similar repositories for forward-forward-pytorch
Users that are interested in forward-forward-pytorch are comparing it to the libraries listed below
Sorting:
- ☆75Updated 2 years ago
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆156Updated last year
- ☆52Updated last year
- nanoGPT-like codebase for LLM training☆107Updated 4 months ago
- Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]☆36Updated last year
- A repository for log-time feedforward networks☆222Updated last year
- ☆166Updated 2 years ago
- Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT☆222Updated last year
- ☆55Updated last year
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆113Updated 2 years ago
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆208Updated 2 years ago
- ☆58Updated last year
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆50Updated last year
- ☆81Updated last year
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds☆303Updated 2 months ago
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆119Updated 11 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated last year
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Updated 2 years ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆35Updated 3 years ago
- A simple Python implementation of forward-forward NN training by G. Hinton from NeurIPS 2022☆21Updated 2 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆80Updated 2 years ago
- Recycling diverse models☆45Updated 2 years ago
- A centralized place for deep thinking code and experiments☆87Updated 2 years ago
- ☆83Updated last year
- ☆51Updated last year
- ☆217Updated 2 years ago
- Implementation of Infini-Transformer in Pytorch☆113Updated 9 months ago
- Uncertainty-aware representation learning (URL) benchmark☆105Updated 7 months ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆123Updated last year
- Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch☆230Updated last year