mpezeshki / pytorch_forward_forward
Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation
β1,480Updated last year
Alternatives and similar repositories for pytorch_forward_forward:
Users that are interested in pytorch_forward_forward are comparing it to the libraries listed below
- β776Updated last week
- Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.β1,054Updated last week
- π¦ Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorchβ2,128Updated 5 months ago
- Cramming the training of a (BERT-type) language model into limited compute.β1,331Updated 10 months ago
- β2,736Updated last year
- The official implementation of βSophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-trainingββ957Updated last year
- A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.β731Updated 11 months ago
- Foundation Architecture for (M)LLMsβ3,074Updated last year
- Tensors, for human consumptionβ1,247Updated 5 months ago
- maximal update parametrization (Β΅P)β1,500Updated 9 months ago
- Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)β1,252Updated 4 months ago
- Convolutions for Sequence Modelingβ878Updated 10 months ago
- VICReg official code baseβ536Updated last year
- Code for our NeurIPS 2022 paperβ367Updated 2 years ago
- Structured state space sequence modelsβ2,620Updated 9 months ago
- functorch is JAX-like composable function transforms for PyTorch.β1,424Updated this week
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithmβ148Updated last year
- Prevent PyTorch's `CUDA error: out of memory` in just 1 line of code.β1,822Updated 4 months ago
- A Library for Differentiable Logic Gate Networksβ670Updated last year
- A library to inspect and extract intermediate layers of PyTorch models.β473Updated 2 years ago
- Schedule-Free Optimization in PyTorchβ2,150Updated 3 weeks ago
- For optimization algorithm research and development.β509Updated this week
- JAX - A curated list of resources https://github.com/google/jaxβ1,796Updated 2 months ago
- The purpose of this repo is to make it easy to get started with JAX, Flax, and Haiku. It contains my "Machine Learning with JAX" series oβ¦β725Updated last year
- 100 exercises to learn JAXβ576Updated 2 years ago
- Hopfield Networks is All You Needβ1,796Updated 2 years ago
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.β1,429Updated this week
- arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors β¦β1,276Updated last year
- Implementation of "SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks"β808Updated 3 months ago
- A JAX research toolkit for building, editing, and visualizing neural networks.β1,769Updated last week