mpezeshki / pytorch_forward_forwardLinks
Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation
β1,481Updated last year
Alternatives and similar repositories for pytorch_forward_forward
Users that are interested in pytorch_forward_forward are comparing it to the libraries listed below
Sorting:
- π¦ Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorchβ2,132Updated 6 months ago
- The official implementation of βSophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-trainingββ958Updated last year
- Cramming the training of a (BERT-type) language model into limited compute.β1,332Updated 11 months ago
- β775Updated last month
- Code for our NeurIPS 2022 paperβ368Updated 2 years ago
- Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)β1,915Updated 10 months ago
- maximal update parametrization (Β΅P)β1,526Updated 10 months ago
- Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.β1,060Updated 2 weeks ago
- Fast and Easy Infinite Neural Networks in Pythonβ2,339Updated last year
- A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.β739Updated last year
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithmβ148Updated last year
- β2,753Updated last year
- Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)β1,262Updated 5 months ago
- Schedule-Free Optimization in PyTorchβ2,162Updated last week
- Hopfield Networks is All You Needβ1,808Updated 2 years ago
- Structured state space sequence modelsβ2,633Updated 10 months ago
- Convolutions for Sequence Modelingβ883Updated 11 months ago
- Tensors, for human consumptionβ1,252Updated last week
- functorch is JAX-like composable function transforms for PyTorch.β1,429Updated this week
- The WeightWatcher tool for predicting the accuracy of Deep Neural Networksβ1,598Updated last week
- FFCV: Fast Forward Computer Vision (and other ML workloads!)β2,930Updated 11 months ago
- Foundation Architecture for (M)LLMsβ3,076Updated last year
- "Deep Generative Modeling": Introductory Examplesβ1,180Updated 8 months ago
- D-Adaptation for SGD, Adam and AdaGradβ518Updated 4 months ago
- For optimization algorithm research and development.β518Updated this week
- VICReg official code baseβ539Updated last year
- Implementation of https://srush.github.io/annotated-s4β495Updated 2 years ago
- Hopular: Modern Hopfield Networks for Tabular Dataβ310Updated 3 years ago
- A multi-backend implementation of the Keras API, with support for TensorFlow, JAX, and PyTorch.β1,268Updated this week
- Language Modeling with the H3 State Space Modelβ518Updated last year