sgugger / Adam-experiments
Experiments with Adam/AdamW/amsgrad
☆197Updated 6 years ago
Alternatives and similar repositories for Adam-experiments:
Users that are interested in Adam-experiments are comparing it to the libraries listed below
- Using the CLR algorithm for training (https://arxiv.org/abs/1506.01186)☆108Updated 6 years ago
- Implementations of ideas from recent papers☆392Updated 4 years ago
- Complementary code for the Targeted Dropout paper☆255Updated 5 years ago
- repo that holds code for improving on dropout using Stochastic Delta Rule☆142Updated 6 years ago
- All Model summary in PyTorch similar to `model.summary()` in Keras☆88Updated 5 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆213Updated 5 years ago
- PyTorch implementation of the paper Dynamic Routing Between Capsules by Sara Sabour, Nicholas Frosst and Geoffrey Hinton☆170Updated 6 years ago
- A PyTorch implementation of the paper Mixup: Beyond Empirical Risk Minimization in PyTorch☆123Updated 7 years ago
- Random miniprojects with pytorch.☆171Updated 6 years ago
- Implements pytorch code for the Accelerated SGD algorithm.☆215Updated 7 years ago
- Utilities for Pytorch☆89Updated 2 years ago
- Implementation and experiments for AdamW on Pytorch☆93Updated 5 years ago
- pytorch implement of Lookahead Optimizer☆189Updated 2 years ago
- Neural networks training pipeline based on PyTorch☆311Updated 4 years ago
- Implementation for the Lookahead Optimizer.☆240Updated 2 years ago
- Corrupted labels and label smoothing☆128Updated 7 years ago
- Snapshot Ensembles in Torch (Snapshot Ensembles: Train 1, Get M for Free)☆188Updated 7 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 4 years ago
- PyTorch implementation of PNASNet-5 on ImageNet☆317Updated 2 years ago
- Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs☆116Updated 5 years ago
- PyTorch implementation of CVPR'18 - Perturbative Neural Networks http://xujuefei.com/pnn.html☆138Updated 6 years ago
- This is an example of how to train a MNIST network in Python and run it in c++ with pytorch 1.0☆96Updated 6 years ago
- Implementation of "Learning with Random Learning Rates" in PyTorch.☆102Updated 5 years ago
- lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch☆334Updated 5 years ago
- 2.86% and 15.85% on CIFAR-10 and CIFAR-100☆296Updated 6 years ago
- Transfer Learning Shootout for PyTorch's model zoo (torchvision)☆169Updated 4 years ago
- Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934☆112Updated 5 years ago
- Accelerated Deep Learning with PyTorch at Jupyter Day Atlanta II☆127Updated 6 years ago
- visualization of CNN in PyTorch☆155Updated last year
- Pretrained ConvNets for pytorch: NASNet, ResNeXt, ResNet, InceptionV4, InceptionResnetV2, Xception, DPN, etc.☆77Updated 6 years ago