Lance0218 / Pytorch-DistributedDataParallel-Training-Tricks
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
☆64Updated 2 years ago
Alternatives and similar repositories for Pytorch-DistributedDataParallel-Training-Tricks:
Users that are interested in Pytorch-DistributedDataParallel-Training-Tricks are comparing it to the libraries listed below
- Implementation of various Vision Transformers I found interesting☆84Updated 3 years ago
- Implementations of Recent Papers in Computer Vision☆38Updated 2 years ago
- official pytorch implementation of Rethining Self-supervised Learning: Small is Beautiful.☆42Updated 3 years ago
- ☆24Updated 3 years ago
- UniMoCo: Unsupervised, Semi-Supervised and Full-Supervised Visual Representation Learning☆55Updated 3 years ago
- noisy labels; missing labels; semi-supervised learning; entropy; uncertainty; robustness and generalisation.☆59Updated 2 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- Warmup learning rate wrapper for Pytorch Scheduler☆41Updated 5 years ago
- PyTorch implementation of EMAN for self-supervised and semi-supervised learning: https://arxiv.org/abs/2101.08482☆103Updated 3 years ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆42Updated 3 years ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- ☆26Updated 4 years ago
- Official codes: Self-Supervised Learning by Estimating Twin Class Distribution☆100Updated 3 years ago
- an implementation of mixup☆41Updated 4 years ago
- Pytorch implementation of CVPR2021 paper: SuperMix: Supervising the Mixing Data Augmentation☆92Updated 3 years ago
- MoEx (Moment Exchange)☆141Updated 3 years ago
- Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)☆103Updated 3 years ago
- [NeurIPS 2021] Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆141Updated 3 months ago
- (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better☆43Updated 3 years ago
- (NeurIPS 2020 Workshop on SSL) Official Implementation of "MixCo: Mix-up Contrastive Learning for Visual Representation"☆58Updated 2 years ago
- TF 2 implementation Learning to Resize Images for Computer Vision Tasks (https://arxiv.org/abs/2103.09950v1).☆53Updated 3 years ago
- When Does Label Smoothing Help?_pytorch_implementationimp☆125Updated 5 years ago
- Implementation for our paper exploring a novel 2D adaptive attention span kernel in computer vision.☆35Updated last year
- Official Pytorch implementation of MixMo framework☆83Updated 3 years ago
- Bootstrapping loss function implementation in pytorch☆36Updated 4 years ago
- Learning Loss for Active Learning Pytorch Implementation,(reproduction)☆32Updated 5 years ago
- The official repo of the CVPR2021 oral paper: Representative Batch Normalization with Feature Calibration☆86Updated 2 years ago
- ☆57Updated 3 years ago
- ☆92Updated 4 years ago
- PyTorch implementation of MLP-Mixer☆37Updated 3 years ago