sooftware / pytorch-lr-schedulerLinks
PyTorch implementation of some learning rate schedulers for deep learning researcher.
☆90Updated 2 years ago
Alternatives and similar repositories for pytorch-lr-scheduler
Users that are interested in pytorch-lr-scheduler are comparing it to the libraries listed below
Sorting:
- Learning Rate Warmup in PyTorch☆411Updated 3 weeks ago
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆259Updated 4 years ago
- Gradient Reversal Layer for Domain Adaptation☆121Updated 2 years ago
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆169Updated 3 months ago
- ☆462Updated 2 years ago
- An (unofficial) implementation of Focal Loss, as described in the RetinaNet paper, generalized to the multi-class case.☆236Updated last year
- Additive margin softmax loss in pytorch☆47Updated 6 years ago
- Implementations of Recent Papers in Computer Vision☆38Updated 2 years ago
- [DEPRECATED] A knowledge distillation toolkit based on PyTorch and PyTorch Lightning.☆139Updated last year
- PyTorch implementation of "Squeezeformer: An Efficient Transformer for Automatic Speech Recognition" (NeurIPS 2022)☆142Updated 2 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆180Updated 2 years ago
- A minimal pytorch package implementing a gradient reversal layer.☆158Updated 8 months ago
- Simple project base template for PyTorch deep Learning project. Features clean implementation of DDP training and Hydra config.☆59Updated 7 months ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆225Updated 3 years ago
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆139Updated last year
- ☆30Updated 3 years ago
- Localization of thoracic abnormalities model based on VinBigData (top 1%)☆45Updated 4 years ago
- Implementation of Linformer for Pytorch☆290Updated last year
- Adaptive Gradient Clipping☆135Updated 2 years ago
- Implementation of Fast Transformer in Pytorch☆175Updated 3 years ago
- A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stoppin…☆65Updated 3 years ago
- Implementation of a U-net complete with efficient attention as well as the latest research findings☆282Updated last year
- The missing distributed weighted random sampler for PyTorch☆24Updated 2 years ago
- [NeurIPS'22] Squeezeformer: An Efficient Transformer for Automatic Speech Recognition☆254Updated 2 years ago
- Implementation of Visual Transformer for Small-size Datasets☆124Updated 3 years ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆432Updated 9 months ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆141Updated 4 years ago
- Vision Transformer Cookbook with Tensorflow☆336Updated 3 years ago
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆119Updated 3 years ago