zhuchen03 / gradinit
Learning to Initialize Neural Networks for Stable and Efficient Training
☆138Updated 2 years ago
Alternatives and similar repositories for gradinit:
Users that are interested in gradinit are comparing it to the libraries listed below
- graftr: an interactive shell to view and edit PyTorch checkpoints.☆111Updated 4 years ago
- ☆14Updated last year
- Compression schema for gradients of activations in backward pass☆44Updated last year
- ☆47Updated 4 years ago
- Implementation of Feedback Transformer in Pytorch☆105Updated 3 years ago
- A small library with distillation, quantization and pruning pipelines☆26Updated 3 years ago
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 4 years ago
- Data Reading Blocks for Python☆103Updated 4 years ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- Unofficial implementation of Perceiver IO☆120Updated 2 years ago
- A simple library that implements CLIP guided loss in PyTorch.☆77Updated 3 years ago
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- A library helping to gather stats and run checks during training deep learning models with Pytorch☆36Updated 2 years ago
- Theoretical Deep Learning: generalization ability☆46Updated 5 years ago
- Code for MSID, a Multi-Scale Intrinsic Distance for comparing generative models, studying neural networks, and more!☆51Updated 5 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- Pytorch based library to rank predicted bounding boxes using text/image user's prompts.☆51Updated 3 years ago
- RUDOLPH: One Hyper-Tasking Transformer can be creative as DALL-E and GPT-3 and smart as CLIP☆254Updated 2 years ago
- Cyclemoid implementation for PyTorch☆87Updated 2 years ago
- GAN models implemented with Pytorch Lightning and Hydra configuration☆34Updated 2 years ago
- Implementations of quasi-hyperbolic optimization algorithms.☆102Updated 4 years ago
- Implementation of Fast Transformer in Pytorch☆172Updated 3 years ago
- GPT, but made only out of MLPs☆88Updated 3 years ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆211Updated 3 years ago
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆251Updated 2 years ago
- http://nlp.seas.harvard.edu/2018/04/03/attention.html☆63Updated 3 years ago
- Train ImageNet *fast* in 500 lines of code with FFCV☆139Updated 9 months ago
- PyTorch implementation of L2L execution algorithm☆107Updated 2 years ago
- ☆16Updated 4 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆126Updated 2 years ago