abhuse / cyclic-cosine-decay
Pytorch cyclic cosine decay learning rate scheduler
☆47Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for cyclic-cosine-decay
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- State-of-the-art data augmentation search algorithms in PyTorch☆47Updated last year
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆115Updated last year
- Recent Advances in MLP-based Models (MLP is all you need!)☆112Updated last year
- (ICML 2022) Official PyTorch implementation of “Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Rob…☆77Updated 2 years ago
- Implementation of various Vision Transformers I found interesting☆84Updated 3 years ago
- A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stoppin…☆60Updated 2 years ago
- Implementation of Depthwise Separable Convolution (pytorch)☆70Updated 4 years ago
- A collection of differentiable SVD methods and ICCV21 "Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance P…☆67Updated last year
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆66Updated last year
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆209Updated 3 years ago
- Feature extraction made simple with torchextractor☆101Updated 3 years ago
- [T-IP 2023] Code for exponential adaptive pooling for PyTorch☆81Updated last year
- A better PyTorch implementation of image local attention which reduces the GPU memory by an order of magnitude.☆136Updated 2 years ago
- A crash course on PyTorch hooks☆40Updated 4 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆140Updated 3 years ago
- A TensorFlow 2.x implementation of Masked Autoencoders Are Scalable Vision Learners☆76Updated 2 years ago
- Implementations of Recent Papers in Computer Vision☆39Updated 2 years ago
- Code repository of the paper "Modelling Long Range Dependencies in ND: From Task-Specific to a General Purpose CNN" https://arxiv.org/abs…☆180Updated last year
- PyTorch implementation of MLP-Mixer☆36Updated 3 years ago
- Visualizer for PyTorch image models☆40Updated 3 years ago
- PyTorch, PyTorch Lightning framework for trying knowledge distillation in image classification problems☆31Updated 3 months ago
- Unofficial PyTorch implementation of Dynamic Convolution: Attention over Convolution Kernels☆43Updated 3 months ago
- A compilation of network architectures for vision and others without usage of self-attention mechanism☆77Updated last year
- Implementing DropPath/StochasticDepth in PyTorch☆16Updated 2 years ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- Batch Renormalization in Pytorch☆45Updated last year
- NeurIPS 2021, Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆139Updated last year
- A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in y…☆45Updated 2 years ago
- Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…☆164Updated 2 years ago