mpezeshki / pytorch_forward_forward
Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation
☆1,456Updated last year
Alternatives and similar repositories for pytorch_forward_forward:
Users that are interested in pytorch_forward_forward are comparing it to the libraries listed below
- Cramming the training of a (BERT-type) language model into limited compute.☆1,310Updated 7 months ago
- ☆760Updated last week
- Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)☆1,242Updated last month
- Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.☆1,034Updated 2 months ago
- Tensors, for human consumption☆1,179Updated 2 months ago
- 🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch☆2,086Updated 2 months ago
- A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.☆702Updated 8 months ago
- ML Collections is a library of Python Collections designed for ML use cases.☆909Updated 2 months ago
- maximal update parametrization (µP)☆1,437Updated 6 months ago
- arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors …☆1,211Updated last year
- Schedule-Free Optimization in PyTorch☆2,069Updated last month
- The WeightWatcher tool for predicting the accuracy of Deep Neural Networks☆1,510Updated 4 months ago
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆138Updated last year
- JAX - A curated list of resources https://github.com/google/jax☆1,676Updated 6 months ago
- Foundation Architecture for (M)LLMs☆3,039Updated 9 months ago
- JAX-based neural network library☆2,943Updated last month
- Hopfield Networks is All You Need☆1,765Updated last year
- ☆2,709Updated 9 months ago
- Code for our NeurIPS 2022 paper☆366Updated 2 years ago
- The purpose of this repo is to make it easy to get started with JAX, Flax, and Haiku. It contains my "Machine Learning with JAX" series o…☆680Updated last year
- TensorDict is a pytorch dedicated tensor container.☆867Updated this week
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.☆1,415Updated 5 months ago
- Optax is a gradient processing and optimization library for JAX.☆1,775Updated this week
- Language Modeling with the H3 State Space Model☆515Updated last year
- Implementation of Forward Forward Network proposed by Hinton in NIPS 2022.☆165Updated last year
- functorch is JAX-like composable function transforms for PyTorch.☆1,405Updated this week
- D-Adaptation for SGD, Adam and AdaGrad☆512Updated this week
- Model API for GALACTICA☆2,698Updated last year
- A library to inspect and extract intermediate layers of PyTorch models.☆470Updated 2 years ago
- FFCV: Fast Forward Computer Vision (and other ML workloads!)☆2,885Updated 7 months ago