mpezeshki / pytorch_forward_forward
Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation
☆1,431Updated last year
Related projects: ⓘ
- ☆742Updated 5 months ago
- Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)☆1,213Updated 10 months ago
- Structured state space sequence models☆2,361Updated 2 months ago
- Tensors, for human consumption☆1,096Updated 2 weeks ago
- Cramming the training of a (BERT-type) language model into limited compute.☆1,284Updated 3 months ago
- Hopfield Networks is All You Need☆1,660Updated last year
- 🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch☆2,002Updated 3 months ago
- maximal update parametrization (µP)☆1,334Updated 2 months ago
- The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”☆931Updated 7 months ago
- Code for our NeurIPS 2022 paper☆360Updated last year
- Convolutions for Sequence Modeling☆861Updated 3 months ago
- A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.☆633Updated 4 months ago
- A concise but complete full-attention transformer with a set of promising experimental features from various papers☆4,573Updated last week
- Foundation Architecture for (M)LLMs☆3,003Updated 5 months ago
- Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.☆999Updated 2 weeks ago
- JAX-based neural network library☆2,860Updated last week
- Implementation of https://srush.github.io/annotated-s4☆456Updated last year
- functorch is JAX-like composable function transforms for PyTorch.☆1,389Updated this week
- JAX - A curated list of resources https://github.com/google/jax☆1,468Updated 2 months ago
- arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors …☆1,156Updated last year
- ML Collections is a library of Python Collections designed for ML use cases.☆879Updated last month
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.☆1,382Updated last month
- ☆2,670Updated 4 months ago
- Pytorch library for fast transformer implementations☆1,621Updated last year
- The WeightWatcher tool for predicting the accuracy of Deep Neural Networks☆1,438Updated last week
- Language Modeling with the H3 State Space Model☆509Updated 11 months ago
- torchview: visualize pytorch models☆793Updated 4 months ago
- Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)☆1,769Updated last month
- Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.☆374Updated 3 months ago
- Long Range Arena for Benchmarking Efficient Transformers☆711Updated 9 months ago