clovaai / AdamP
AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
☆413Updated 4 years ago
Alternatives and similar repositories for AdamP:
Users that are interested in AdamP are comparing it to the libraries listed below
- Official Pytorch implementation of ReXNet (Rank eXpansion Network) with pretrained models☆452Updated 3 years ago
- PyTorch Model Compression☆231Updated 2 years ago
- a Ready-to-use PyTorch Extension of Unofficial CutMix Implementations with more improved performance.☆167Updated 2 years ago
- Automatic Mixed Precision Tutorials using pytorch. Based on PyTorch 1.6 Official Features, implement classification codebase using custo…☆88Updated 4 years ago
- Learning Features with Parameter-Free Layers, ICLR 2022☆85Updated last year
- Tensorflow Implementation of "Slowing Down the Weight Norm Increase in Momentum-based Optimizers"☆46Updated 3 years ago
- NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/☆345Updated last year
- A LARS implementation in PyTorch☆343Updated 5 years ago
- ☆449Updated last year
- Unofficial PyTorch Implementation of EvoNorm☆121Updated 3 years ago
- ☆245Updated 3 years ago
- A PyTorch implementation of "EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks".☆113Updated 2 weeks ago
- Unofficial Pytorch code for "FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence" in NeurIPS'20. This repo co…☆190Updated 3 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆159Updated 4 years ago
- Over9000 optimizer☆427Updated 2 years ago
- PyTorch implementations of `BatchSampler` that under/over sample according to a chosen parameter alpha, in order to create a balanced tra…☆84Updated 5 years ago
- FrostNet: Towards Quantization-Aware Network Architecture Search☆107Updated 10 months ago
- Official PyTorch implementation of the paper: "Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results" (2022)☆191Updated 2 years ago
- Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)☆483Updated 3 years ago
- Provides everything needed for high performance data loading and augmentation in pytorch.☆319Updated last year
- Official PyTorch implementation of "Puzzle Mix: Exploiting Saliency and Local Statistics for Optimal Mixup" (ICML'20)☆160Updated 3 years ago
- carrier of tricks for image classification tutorials using pytorch.☆103Updated last year
- A specially designed light version of Fast AutoAugment☆172Updated 4 years ago
- ☆401Updated 2 years ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆426Updated 5 months ago
- ☆47Updated 3 years ago
- Multi GPU Training Code for Deep Learning with PyTorch☆205Updated 5 years ago
- read 1 paper everyday (only weekday)☆56Updated 3 years ago
- Reproduction of Vision Transformer in Tensorflow2. Train from scratch and Finetune.☆48Updated 3 years ago
- Useful PyTorch functions and modules that are not implemented in PyTorch by default☆187Updated 10 months ago