zhuchen03 / gradinitLinks
Learning to Initialize Neural Networks for Stable and Efficient Training
☆139Updated 3 years ago
Alternatives and similar repositories for gradinit
Users that are interested in gradinit are comparing it to the libraries listed below
Sorting:
- Compression schema for gradients of activations in backward pass☆44Updated last year
- Code for MSID, a Multi-Scale Intrinsic Distance for comparing generative models, studying neural networks, and more!☆51Updated 6 years ago
- A library helping to gather stats and run checks during training deep learning models with Pytorch☆35Updated 3 years ago
- Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks☆83Updated 3 years ago
- Implementation of Feedback Transformer in Pytorch☆107Updated 4 years ago
- Unofficial implementation of Perceiver IO☆122Updated 3 years ago
- PyTorch implementation of L2L execution algorithm☆107Updated 2 years ago
- Data Reading Blocks for Python☆105Updated 4 years ago
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 4 years ago
- RUDOLPH: One Hyper-Tasking Transformer can be creative as DALL-E and GPT-3 and smart as CLIP☆254Updated 2 years ago
- A GPT, made only of MLPs, in Jax☆58Updated 4 years ago
- ☆47Updated 4 years ago
- ☆26Updated 3 years ago
- ☆36Updated last year
- Take control back!☆18Updated 3 years ago
- Very simple and short implementation of gradient boosting in 18 lines of code☆9Updated 4 years ago
- GPT, but made only out of MLPs☆89Updated 4 years ago
- A small library with distillation, quantization and pruning pipelines☆26Updated 4 years ago
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆128Updated last year
- Theoretical Deep Learning: generalization ability☆46Updated 5 years ago
- A simple library that implements CLIP guided loss in PyTorch.☆77Updated 3 years ago
- A small demonstration of using WebDataset with ImageNet and PyTorch Lightning☆74Updated last year
- Implementations of quasi-hyperbolic optimization algorithms.☆102Updated 5 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆127Updated 2 years ago
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆252Updated 2 years ago
- a lightweight transformer library for PyTorch☆72Updated 3 years ago
- Train ImageNet *fast* in 500 lines of code with FFCV☆143Updated last year
- An unopinionated replacement for PyTorch's Dataset and ImageFolder, that handles Tar archives☆77Updated 2 years ago
- ☆15Updated last year
- Train ImageNet in 18 minutes on AWS☆130Updated last year