Lance0218 / Pytorch-DistributedDataParallel-Training-TricksLinks
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
☆65Updated 3 years ago
Alternatives and similar repositories for Pytorch-DistributedDataParallel-Training-Tricks
Users that are interested in Pytorch-DistributedDataParallel-Training-Tricks are comparing it to the libraries listed below
Sorting:
- [ICCV 2021] Influence-balanced Loss for Imbalanced Visual Classification☆102Updated 3 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆117Updated 3 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆85Updated 4 years ago
- When Does Label Smoothing Help?_pytorch_implementationimp☆126Updated 5 years ago
- official pytorch implementation of Rethining Self-supervised Learning: Small is Beautiful.☆43Updated 4 years ago
- Example of PyTorch DistributedDataParallel☆61Updated 4 years ago
- Warmup learning rate wrapper for Pytorch Scheduler☆41Updated 5 years ago
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆310Updated 4 years ago
- Official Pytorch implementation of MixMo framework☆83Updated 4 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆217Updated 4 years ago
- Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)☆105Updated 4 years ago
- ☆140Updated 4 years ago
- Implementation of various Vision Transformers I found interesting☆84Updated 4 years ago
- PyTorch Implementation of CvT: Introducing Convolutions to Vision Transformers☆229Updated 4 years ago
- A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …☆180Updated 3 years ago
- PyTorch implementation of EMAN for self-supervised and semi-supervised learning: https://arxiv.org/abs/2101.08482☆103Updated 4 years ago
- UniMoCo: Unsupervised, Semi-Supervised and Full-Supervised Visual Representation Learning☆57Updated 4 years ago
- (NeurIPS 2020 Workshop on SSL) Official Implementation of "MixCo: Mix-up Contrastive Learning for Visual Representation"☆58Updated 3 years ago
- MoEx (Moment Exchange)☆141Updated 4 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆75Updated 5 years ago
- Batch Renormalization in Pytorch☆45Updated 2 years ago
- Implementation of ResMLP, an all MLP solution to image classification, in Pytorch☆201Updated 3 years ago
- ☆24Updated 4 years ago
- Implementations of Recent Papers in Computer Vision☆38Updated 3 years ago
- Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones☆200Updated 4 years ago
- A Pytorch Implementation of the following paper "Visual Transformers: Token-based Image Representation and Processing for Computer Vision…☆182Updated 5 years ago
- Implementation of Visual Transformer for Small-size Datasets☆129Updated 3 years ago
- The official code for the paper "Delving Deep into Label Smoothing", IEEE TIP 2021☆81Updated 3 years ago
- [CVPR 2022] This repository includes the official project for the paper: TransMix: Attend to Mix for Vision Transformers.☆158Updated 3 years ago
- This repository contains some of the latest data augmentation techniques and optimizers for image classification using pytorch and the CI…☆29Updated 4 years ago