mpezeshki / pytorch_forward_forward
Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation
☆1,461Updated last year
Alternatives and similar repositories for pytorch_forward_forward:
Users that are interested in pytorch_forward_forward are comparing it to the libraries listed below
- Tensors, for human consumption☆1,192Updated 3 months ago
- Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)☆1,252Updated 2 months ago
- ☆765Updated last month
- Cramming the training of a (BERT-type) language model into limited compute.☆1,320Updated 8 months ago
- torchview: visualize pytorch models☆881Updated 3 weeks ago
- 🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch☆2,101Updated 3 months ago
- Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.☆1,535Updated 2 weeks ago
- ☆2,724Updated 10 months ago
- A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.☆702Updated 9 months ago
- Package for extracting and mapping the results of every single tensor operation in a PyTorch model in one line of code.☆552Updated 2 weeks ago
- arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors …☆1,238Updated last year
- Code for our NeurIPS 2022 paper☆366Updated 2 years ago
- VICReg official code base☆531Updated last year
- Structured state space sequence models☆2,564Updated 7 months ago
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.☆1,422Updated 7 months ago
- Language Modeling with the H3 State Space Model☆516Updated last year
- Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.☆1,040Updated 2 weeks ago
- A library to inspect and extract intermediate layers of PyTorch models.☆472Updated 2 years ago
- The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”☆949Updated last year
- Probabilistic Machine Learning: Advanced Topics☆1,439Updated 3 months ago
- TensorDict is a pytorch dedicated tensor container.☆889Updated this week
- maximal update parametrization (µP)☆1,466Updated 7 months ago
- Convolutions for Sequence Modeling☆876Updated 8 months ago
- Implementation of "SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks"☆792Updated last month
- Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.☆380Updated 9 months ago
- functorch is JAX-like composable function transforms for PyTorch.☆1,412Updated this week
- Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)☆1,881Updated 7 months ago
- Schedule-Free Optimization in PyTorch☆2,105Updated this week
- Closed-form Continuous-time Neural Networks☆924Updated 8 months ago
- Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm☆144Updated last year