sooftware / pytorch-lr-scheduler
PyTorch implementation of some learning rate schedulers for deep learning researcher.
☆89Updated 2 years ago
Alternatives and similar repositories for pytorch-lr-scheduler
Users that are interested in pytorch-lr-scheduler are comparing it to the libraries listed below
Sorting:
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆138Updated last year
- ☆459Updated 2 years ago
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆167Updated last month
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- Additive margin softmax loss in pytorch☆46Updated 5 years ago
- Implementation of a U-net complete with efficient attention as well as the latest research findings☆279Updated last year
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆260Updated 3 years ago
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆135Updated last month
- Learning Rate Warmup in PyTorch☆410Updated 2 months ago
- Simple project base template for PyTorch deep Learning project. Features clean implementation of DDP training and Hydra config.☆57Updated 5 months ago
- Implementations of Recent Papers in Computer Vision☆38Updated 2 years ago
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆304Updated 3 years ago
- Implementation of Fast Transformer in Pytorch☆173Updated 3 years ago
- Implementation of Linformer for Pytorch☆286Updated last year
- Pytorch cyclic cosine decay learning rate scheduler☆48Updated 3 years ago
- An (unofficial) implementation of Focal Loss, as described in the RetinaNet paper, generalized to the multi-class case.☆235Updated last year
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆177Updated last year
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆225Updated 3 years ago
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆118Updated 3 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆115Updated 2 years ago
- Gradient Reversal Layer for Domain Adaptation☆116Updated 2 years ago
- Tool box for PyTorch☆188Updated last month
- A pytorch template files generator.☆32Updated 2 weeks ago
- [DEPRECATED] A knowledge distillation toolkit based on PyTorch and PyTorch Lightning.☆139Updated last year
- Implementation of Visual Transformer for Small-size Datasets☆123Updated 3 years ago
- PyTorch implementations of `BatchSampler` that under/over sample according to a chosen parameter alpha, in order to create a balanced tra…☆85Updated 5 years ago
- ☆245Updated 3 years ago
- PyTorch Implementation of CvT: Introducing Convolutions to Vision Transformers☆225Updated 3 years ago
- ☆51Updated 4 years ago
- Warmup learning rate wrapper for Pytorch Scheduler☆41Updated 5 years ago