abhuse / cyclic-cosine-decay
Pytorch cyclic cosine decay learning rate scheduler
☆48Updated 3 years ago
Alternatives and similar repositories for cyclic-cosine-decay:
Users that are interested in cyclic-cosine-decay are comparing it to the libraries listed below
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- Batch Renormalization in Pytorch☆45Updated last year
- State-of-the-art data augmentation search algorithms in PyTorch☆47Updated last year
- Recent Advances in MLP-based Models (MLP is all you need!)☆113Updated 2 years ago
- PyTorch, PyTorch Lightning framework for trying knowledge distillation in image classification problems☆32Updated 6 months ago
- Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch☆51Updated 3 years ago
- ☆41Updated 3 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- [WACV 2022] "Sandwich Batch Normalization: A Drop-In Replacement for Feature Distribution Heterogeneity" by Xinyu Gong, Wuyang Chen, Tian…☆50Updated 3 years ago
- Implementing DropPath/StochasticDepth in PyTorch☆16Updated 3 years ago
- (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better☆43Updated 3 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- [NeurIPS 2021] Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆140Updated last month
- Simple MAE (masked autoencoders) with pytorch and pytorch-lightning.☆41Updated last year
- A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stoppin…☆63Updated 2 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆70Updated 2 years ago
- Implementation of the Remixer Block from the Remixer paper, in Pytorch☆35Updated 3 years ago
- (ICML 2022) Official PyTorch implementation of “Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Rob…☆78Updated 2 years ago
- TF 2 implementation Learning to Resize Images for Computer Vision Tasks (https://arxiv.org/abs/2103.09950v1).☆52Updated 3 years ago
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆115Updated 2 years ago
- Unofficial PyTorch reimplemention of the paper "Involution: Inverting the Inherence of Convolution for Visual Recognition" [CVPR 2021].☆21Updated 3 years ago
- Implementation of various Vision Transformers I found interesting☆84Updated 3 years ago
- PyTorch implementation of MLP-Mixer☆36Updated 3 years ago
- PyTorch implementation of MLP-Mixer: An all-MLP Architecture for Vision☆21Updated 3 years ago
- ☆24Updated 3 years ago
- Implementations of Recent Papers in Computer Vision☆39Updated 2 years ago
- Code repository of the paper "Modelling Long Range Dependencies in ND: From Task-Specific to a General Purpose CNN" https://arxiv.org/abs…☆183Updated last year
- Unofficial implementation of YOTO (You Only Train Once) applied to Class balanced loss☆23Updated 4 years ago
- This is a offical PyTorch/GPU implementation of SupMAE.☆77Updated 2 years ago
- [NeurIPS 2021]: Are Transformers More Robust Than CNNs? (Pytorch implementation & checkpoints)☆176Updated 3 years ago