Lance0218 / Pytorch-DistributedDataParallel-Training-TricksLinks
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
☆65Updated 3 years ago
Alternatives and similar repositories for Pytorch-DistributedDataParallel-Training-Tricks
Users that are interested in Pytorch-DistributedDataParallel-Training-Tricks are comparing it to the libraries listed below
Sorting:
- Warmup learning rate wrapper for Pytorch Scheduler☆42Updated 5 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆85Updated 4 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆115Updated 2 years ago
- Example of PyTorch DistributedDataParallel☆60Updated 4 years ago
- Implementation of various Vision Transformers I found interesting☆84Updated 4 years ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)☆103Updated 3 years ago
- official pytorch implementation of Rethining Self-supervised Learning: Small is Beautiful.☆42Updated 3 years ago
- This repository contains some of the latest data augmentation techniques and optimizers for image classification using pytorch and the CI…☆29Updated 4 years ago
- When Does Label Smoothing Help?_pytorch_implementationimp☆125Updated 5 years ago
- Pytorch implementation of CVPR2021 paper: SuperMix: Supervising the Mixing Data Augmentation☆92Updated 3 years ago
- SCOUTER: Slot Attention-based Classifier for Explainable Image Recognition (ICCV 2021)☆98Updated 2 years ago
- ☆24Updated 3 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆76Updated 5 years ago
- [ICCV 2021] Influence-balanced Loss for Imbalanced Visual Classification☆101Updated 3 years ago
- Implementation of ResMLP, an all MLP solution to image classification, in Pytorch☆197Updated 2 years ago
- A PyTorch implementation of CutMix☆52Updated 6 years ago
- MoEx (Moment Exchange)☆141Updated 4 years ago
- Official codes: Self-Supervised Learning by Estimating Twin Class Distribution☆100Updated 3 years ago
- A crash course on PyTorch hooks☆40Updated 5 years ago
- PyTorch implementation of Lambda Network and pretrained Lambda-ResNet☆54Updated 4 years ago
- ☆39Updated 2 years ago
- UniMoCo: Unsupervised, Semi-Supervised and Full-Supervised Visual Representation Learning☆55Updated 3 years ago
- ☆138Updated 3 years ago
- ☆93Updated 4 years ago
- PyTorch implementation of EMAN for self-supervised and semi-supervised learning: https://arxiv.org/abs/2101.08482☆103Updated 4 years ago
- This repo contains the code of "ConTNet: Why not use convolution and transformer at the same time?"☆99Updated 4 years ago
- AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning☆112Updated 4 years ago
- PyTorch Implementation of CvT: Introducing Convolutions to Vision Transformers☆226Updated 4 years ago
- TF 2 implementation Learning to Resize Images for Computer Vision Tasks (https://arxiv.org/abs/2103.09950v1).☆53Updated 3 years ago