sooftware / pytorch-lr-scheduler
PyTorch implementation of some learning rate schedulers for deep learning researcher.
☆89Updated 2 years ago
Alternatives and similar repositories for pytorch-lr-scheduler:
Users that are interested in pytorch-lr-scheduler are comparing it to the libraries listed below
- ☆446Updated last year
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆256Updated 3 years ago
- Implementation of Online Label Smoothing in PyTorch☆95Updated 2 years ago
- [DEPRECATED] A knowledge distillation toolkit based on PyTorch and PyTorch Lightning.☆139Updated 10 months ago
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆167Updated 2 years ago
- A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stoppin…☆62Updated 2 years ago
- Implementation of Visual Transformer for Small-size Datasets☆117Updated 2 years ago
- Implementations of Recent Papers in Computer Vision☆39Updated 2 years ago
- Additive margin softmax loss in pytorch☆46Updated 5 years ago
- Polynomial Learning Rate Decay Scheduler for PyTorch☆65Updated 3 years ago
- Learning Rate Warmup in PyTorch☆399Updated this week
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆135Updated last year
- Implementation of Fast Transformer in Pytorch☆172Updated 3 years ago
- Implementation of Linformer for Pytorch☆262Updated last year
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆118Updated 3 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆175Updated last year
- Unofficial PyTorch implementation of Dynamic Convolution: Attention over Convolution Kernels☆45Updated 5 months ago
- Tool box for PyTorch☆186Updated 9 months ago
- Gradient Reversal Layer for Domain Adaptation☆114Updated last year
- Simple project base template for PyTorch deep Learning project. Features clean implementation of DDP training and Hydra config.☆57Updated last month
- Recent Advances in MLP-based Models (MLP is all you need!)☆113Updated 2 years ago
- ☆11Updated 2 years ago
- ☆67Updated 3 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆226Updated 2 years ago
- Experimenting with different regression losses. Implemented in Pytorch.☆145Updated 5 years ago
- Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning☆157Updated 11 months ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆214Updated 3 years ago
- Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification☆193Updated 3 years ago
- Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representations☆89Updated 7 months ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆418Updated 3 months ago