Lance0218 / Pytorch-DistributedDataParallel-Training-TricksLinks
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
☆65Updated 3 years ago
Alternatives and similar repositories for Pytorch-DistributedDataParallel-Training-Tricks
Users that are interested in Pytorch-DistributedDataParallel-Training-Tricks are comparing it to the libraries listed below
Sorting:
- When Does Label Smoothing Help?_pytorch_implementationimp☆126Updated 5 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆85Updated 4 years ago
- Official Pytorch implementation of MixMo framework☆84Updated 4 years ago
- Warmup learning rate wrapper for Pytorch Scheduler☆41Updated 5 years ago
- [ICCV 2021] Influence-balanced Loss for Imbalanced Visual Classification☆102Updated 3 years ago
- Scripts to work with LMDB + PyTorch for Imagenet training☆59Updated 5 years ago
- Example of PyTorch DistributedDataParallel☆60Updated 4 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆116Updated 2 years ago
- Official codes: Self-Supervised Learning by Estimating Twin Class Distribution☆100Updated 3 years ago
- Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning☆133Updated 3 years ago
- PyTorch implementation of EMAN for self-supervised and semi-supervised learning: https://arxiv.org/abs/2101.08482☆103Updated 4 years ago
- [ICML2020] Normalized Loss Functions for Deep Learning with Noisy Labels☆140Updated last year
- Official PyTorch implementation of "Puzzle Mix: Exploiting Saliency and Local Statistics for Optimal Mixup" (ICML'20)☆158Updated 3 years ago
- Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)☆105Updated 3 years ago
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆309Updated 3 years ago
- (NeurIPS 2020 Workshop on SSL) Official Implementation of "MixCo: Mix-up Contrastive Learning for Visual Representation"☆58Updated 2 years ago
- official pytorch implementation of Rethining Self-supervised Learning: Small is Beautiful.☆42Updated 4 years ago
- A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …☆181Updated 3 years ago
- Official repository for "Orthogonal Projection Loss" (ICCV'21)☆125Updated 3 years ago
- Code for CoMatch: Semi-supervised Learning with Contrastive Graph Regularization☆128Updated 5 months ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆218Updated 4 years ago
- [TIP 2022] Towards Better Accuracy-efficiency Trade-offs: Divide and Co-training. Plus, an image classification toolbox includes ResNet, …☆106Updated 3 years ago
- Pretrained SimCLRv2 models in Pytorch☆105Updated 4 years ago
- Papers for normalization techniques, released codes collections.☆227Updated 5 years ago
- Implementation of Online Label Smoothing in PyTorch☆95Updated 3 years ago
- [CVPR 2021] Adaptive Consistency Regularization for Semi-Supervised Transfer Learning☆106Updated 4 years ago
- A crash course on PyTorch hooks☆41Updated 5 years ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆45Updated 4 years ago
- CrossNorm and SelfNorm for Generalization under Distribution Shifts, ICCV 2021☆128Updated 4 years ago
- PyTorch implementations of `BatchSampler` that under/over sample according to a chosen parameter alpha, in order to create a balanced tra…☆85Updated 5 years ago