clovaai / AdamP
AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
☆415Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for AdamP
- Official Pytorch implementation of ReXNet (Rank eXpansion Network) with pretrained models☆453Updated 2 years ago
- Automatic Mixed Precision Tutorials using pytorch. Based on PyTorch 1.6 Official Features, implement classification codebase using custo…☆88Updated 4 years ago
- a Ready-to-use PyTorch Extension of Unofficial CutMix Implementations with more improved performance.☆167Updated 2 years ago
- PyTorch Model Compression☆229Updated last year
- A LARS implementation in PyTorch☆335Updated 4 years ago
- Official PyTorch implementation of "Puzzle Mix: Exploiting Saliency and Local Statistics for Optimal Mixup" (ICML'20)☆158Updated 2 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆159Updated 3 years ago
- NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/☆345Updated 10 months ago
- Multi GPU Training Code for Deep Learning with PyTorch☆202Updated 4 years ago
- Unofficial Pytorch code for "FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence" in NeurIPS'20. This repo co…☆190Updated 3 years ago
- Unofficial PyTorch Implementation of EvoNorm☆121Updated 3 years ago
- ☆440Updated last year
- Unofficial PyTorch Reimplementation of RandAugment.☆628Updated last year
- Learning Features with Parameter-Free Layers, ICLR 2022☆85Updated last year
- Over9000 optimizer☆425Updated last year
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆134Updated last year
- ☆399Updated 2 years ago
- 🛠 Toolbox to extend PyTorch functionalities☆417Updated 6 months ago
- Official implementation of 'FMix: Enhancing Mixed Sample Data Augmentation'☆332Updated 3 years ago
- ☆243Updated 3 years ago
- Tensorflow Implementation of "Slowing Down the Weight Norm Increase in Momentum-based Optimizers"☆46Updated 3 years ago
- Differentiable Data Augmentation Library☆120Updated 2 years ago
- Implementing Lambda Networks using Pytorch☆138Updated 3 years ago
- PyTorch implementations of `BatchSampler` that under/over sample according to a chosen parameter alpha, in order to create a balanced tra…☆84Updated 5 years ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆406Updated last month
- Official Pytorch implementation of CutMix regularizer☆1,221Updated 4 years ago
- Official PyTorch implementation of the paper: "Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results" (2022)☆192Updated last year
- Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)☆480Updated 3 years ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆211Updated 3 years ago
- AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty☆980Updated 3 months ago