abhuse / cyclic-cosine-decay
Pytorch cyclic cosine decay learning rate scheduler
☆48Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for cyclic-cosine-decay
- State-of-the-art data augmentation search algorithms in PyTorch☆47Updated last year
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- Simple MAE (masked autoencoders) with pytorch and pytorch-lightning.☆41Updated 9 months ago
- Visualizer for PyTorch image models☆40Updated 3 years ago
- A crash course on PyTorch hooks☆40Updated 4 years ago
- Implementation of various Vision Transformers I found interesting☆84Updated 3 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆112Updated last year
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆115Updated last year
- [ICME 2022] code for the paper, SimVit: Exploring a simple vision transformer with sliding windows.☆67Updated 2 years ago
- A compilation of network architectures for vision and others without usage of self-attention mechanism☆77Updated last year
- Testing various improvements to Ranger21 for 2022☆18Updated 2 weeks ago
- ☆30Updated last year
- TF 2 implementation Learning to Resize Images for Computer Vision Tasks (https://arxiv.org/abs/2103.09950v1).☆52Updated 3 years ago
- A TensorFlow 2.x implementation of Masked Autoencoders Are Scalable Vision Learners☆76Updated 2 years ago
- Implementing DropPath/StochasticDepth in PyTorch☆16Updated 2 years ago
- ☆24Updated 3 years ago
- SiT: Self-supervised vision Transformer☆19Updated 3 years ago
- A database of over 1.4 billion 3x3 convolution filters extracted from hundreds of diverse CNN models with relevant meta information (CVPR…☆30Updated last year
- NeurIPS 2021, Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆139Updated last year
- ☆96Updated last year
- A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stoppin…☆61Updated 2 years ago
- Batch Renormalization in Pytorch☆45Updated last year
- [ICLR 2022] Finding an Unsupervised Image Segmenter in each of your Deep Generative Models☆77Updated 2 years ago
- [CVPR2022 - Oral] Official Jax Implementation of Learned Queries for Efficient Local Attention☆114Updated 2 years ago
- ☆241Updated 2 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆97Updated 2 years ago
- ☆41Updated 3 years ago