Lance0218 / Pytorch-DistributedDataParallel-Training-Tricks
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
☆64Updated 2 years ago
Alternatives and similar repositories for Pytorch-DistributedDataParallel-Training-Tricks:
Users that are interested in Pytorch-DistributedDataParallel-Training-Tricks are comparing it to the libraries listed below
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- official pytorch implementation of Rethining Self-supervised Learning: Small is Beautiful.☆42Updated 3 years ago
- Warmup learning rate wrapper for Pytorch Scheduler☆41Updated 4 years ago
- PyTorch implementation of EMAN for self-supervised and semi-supervised learning: https://arxiv.org/abs/2101.08482☆103Updated 3 years ago
- UniMoCo: Unsupervised, Semi-Supervised and Full-Supervised Visual Representation Learning☆55Updated 3 years ago
- Pytorch implementation of CVPR2021 paper: SuperMix: Supervising the Mixing Data Augmentation☆92Updated 3 years ago
- official implemntation for "Contrastive Learning with Stronger Augmentations"☆57Updated 3 years ago
- [ICCV 2021] Influence-balanced Loss for Imbalanced Visual Classification☆99Updated 3 years ago
- ☆92Updated 4 years ago
- Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)☆103Updated 3 years ago
- Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]☆88Updated 3 years ago
- When Does Label Smoothing Help?_pytorch_implementationimp☆125Updated 5 years ago
- Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch☆52Updated 3 years ago
- Differentiable Data Augmentation Library☆123Updated 2 years ago
- Implementations of Recent Papers in Computer Vision☆38Updated 2 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆73Updated 4 years ago
- Evaluating AlexNet features at various depths☆39Updated 4 years ago
- Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification☆81Updated 3 years ago
- A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …☆174Updated 3 years ago
- This repository contains some of the latest data augmentation techniques and optimizers for image classification using pytorch and the CI…☆29Updated 3 years ago
- MoEx (Moment Exchange)☆142Updated 3 years ago
- This Module implements Spatial Pyramid Pooling (SPP) and Temporal Pyramid Pooling (TPP) as described in different papers.☆52Updated 5 years ago
- Official repository for "Orthogonal Projection Loss" (ICCV'21)☆120Updated 3 years ago
- ☆23Updated 3 years ago
- This repo contains the code of "ConTNet: Why not use convolution and transformer at the same time?"☆98Updated 3 years ago
- Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)☆106Updated 4 years ago
- The official repo of the CVPR2021 oral paper: Representative Batch Normalization with Feature Calibration☆86Updated 2 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆114Updated 2 years ago
- Batch Renormalization in Pytorch☆45Updated last year