Lance0218 / Pytorch-DistributedDataParallel-Training-Tricks
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
☆63Updated 2 years ago
Alternatives and similar repositories for Pytorch-DistributedDataParallel-Training-Tricks:
Users that are interested in Pytorch-DistributedDataParallel-Training-Tricks are comparing it to the libraries listed below
- official pytorch implementation of Rethining Self-supervised Learning: Small is Beautiful.☆42Updated 3 years ago
- Warmup learning rate wrapper for Pytorch Scheduler☆40Updated 4 years ago
- Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning☆131Updated 2 years ago
- UniMoCo: Unsupervised, Semi-Supervised and Full-Supervised Visual Representation Learning☆54Updated 3 years ago
- (NeurIPS 2020 Workshop on SSL) Official Implementation of "MixCo: Mix-up Contrastive Learning for Visual Representation"☆58Updated 2 years ago
- Implementation of various Vision Transformers I found interesting☆84Updated 3 years ago
- an implementation of mixup☆41Updated 4 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆73Updated 4 years ago
- Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)☆107Updated 4 years ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better☆43Updated 3 years ago
- Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)☆103Updated 3 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- Batch Renormalization in Pytorch☆45Updated last year
- Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]☆88Updated 3 years ago
- ☆23Updated 3 years ago
- PyTorch implementation of EMAN for self-supervised and semi-supervised learning: https://arxiv.org/abs/2101.08482☆102Updated 3 years ago
- Official codes: Self-Supervised Learning by Estimating Twin Class Distribution☆99Updated 3 years ago
- [NeurIPS 2021] Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆140Updated last month
- Official Pytorch implementation of MixMo framework☆84Updated 3 years ago
- This repository contains some of the latest data augmentation techniques and optimizers for image classification using pytorch and the CI…☆29Updated 3 years ago
- Implementations of Recent Papers in Computer Vision☆39Updated 2 years ago
- [WACV 2022] "Sandwich Batch Normalization: A Drop-In Replacement for Feature Distribution Heterogeneity" by Xinyu Gong, Wuyang Chen, Tian…☆50Updated 3 years ago
- When Does Label Smoothing Help?_pytorch_implementationimp☆126Updated 5 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆113Updated 2 years ago
- [ICCV 2021] Influence-balanced Loss for Imbalanced Visual Classification☆99Updated 2 years ago
- Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"☆98Updated 4 years ago
- Official repository for "Orthogonal Projection Loss" (ICCV'21)☆119Updated 3 years ago
- [ICLR 2022] Finding an Unsupervised Image Segmenter in each of your Deep Generative Models☆78Updated 3 years ago
- ☆119Updated 2 years ago