Lance0218 / Pytorch-DistributedDataParallel-Training-Tricks
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
☆60Updated 2 years ago
Related projects: ⓘ
- Warmup learning rate wrapper for Pytorch Scheduler☆39Updated 4 years ago
- ☆50Updated this week
- official pytorch implementation of Rethining Self-supervised Learning: Small is Beautiful.☆41Updated 3 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated last year
- UniMoCo: Unsupervised, Semi-Supervised and Full-Supervised Visual Representation Learning☆53Updated 3 years ago
- This repository contains some of the latest data augmentation techniques and optimizers for image classification using pytorch and the CI…☆28Updated 3 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆69Updated 4 years ago
- ☆22Updated this week
- ☆44Updated 2 years ago
- Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]☆86Updated 2 years ago
- PyTorch implementation of EMAN for self-supervised and semi-supervised learning: https://arxiv.org/abs/2101.08482☆98Updated 3 years ago
- Official codes: Self-Supervised Learning by Estimating Twin Class Distribution☆96Updated 2 years ago
- Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch☆50Updated 3 years ago
- NeurIPS 2021, Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆138Updated last year
- a pytorch implementation for MoCo V3☆31Updated 3 years ago
- Implementation of various Vision Transformers I found interesting☆82Updated 3 years ago
- (NeurIPS 2020 Workshop on SSL) Official Implementation of "MixCo: Mix-up Contrastive Learning for Visual Representation"☆58Updated last year
- ViTOL☆29Updated 2 years ago
- Metric Learning (npair loss & angular loss) on mnist and Visualizing by t_SNE☆35Updated last year
- Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)☆105Updated 2 years ago
- Unofficial PyTorch implementation of "FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence"☆48Updated 2 years ago
- (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better☆42Updated 2 years ago
- Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification☆81Updated 3 years ago
- MoEx (Moment Exchange)☆143Updated 3 years ago
- Implementations of Recent Papers in Computer Vision☆39Updated 2 years ago
- Pytorch implementation of CVPR2021 paper: SuperMix: Supervising the Mixing Data Augmentation☆89Updated 2 years ago
- CrossNorm and SelfNorm for Generalization under Distribution Shifts, ICCV 2021☆128Updated 3 years ago
- This repo contains the code of "ConTNet: Why not use convolution and transformer at the same time?"☆95Updated 3 years ago
- Batch Renormalization in Pytorch☆44Updated last year