sooftware / pytorch-lr-schedulerLinks
PyTorch implementation of some learning rate schedulers for deep learning researcher.
☆91Updated 3 years ago
Alternatives and similar repositories for pytorch-lr-scheduler
Users that are interested in pytorch-lr-scheduler are comparing it to the libraries listed below
Sorting:
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆260Updated 4 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆183Updated 2 years ago
- Learning Rate Warmup in PyTorch☆413Updated 5 months ago
- ☆466Updated 2 years ago
- An (unofficial) implementation of Focal Loss, as described in the RetinaNet paper, generalized to the multi-class case.☆238Updated last year
- [DEPRECATED] A knowledge distillation toolkit based on PyTorch and PyTorch Lightning.☆138Updated last year
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆170Updated 8 months ago
- Gradient Reversal Layer for Domain Adaptation☆129Updated 2 years ago
- PyTorch implementation of "Squeezeformer: An Efficient Transformer for Automatic Speech Recognition" (NeurIPS 2022)☆147Updated 3 years ago
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆138Updated 2 years ago
- Implementation of Fast Transformer in Pytorch☆177Updated 4 years ago
- Implementation of the convolutional module from the Conformer paper, for use in Transformers☆430Updated 2 years ago
- Implementations of Recent Papers in Computer Vision☆38Updated 3 years ago
- ☆30Updated 3 years ago
- Ranger deep learning optimizer rewrite to use newest components☆338Updated last year
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆252Updated 3 years ago
- Simple project base template for PyTorch deep Learning project. Features clean implementation of DDP training and Hydra config.☆61Updated 11 months ago
- [NeurIPS'22] Squeezeformer: An Efficient Transformer for Automatic Speech Recognition☆261Updated 2 years ago
- A minimal pytorch package implementing a gradient reversal layer.☆158Updated last year
- ☆51Updated 5 years ago
- Implementation of Linformer for Pytorch☆301Updated last year
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆228Updated 3 years ago
- Implementation of Online Label Smoothing in PyTorch☆95Updated 3 years ago
- BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation☆221Updated 2 years ago
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆309Updated 3 years ago
- small experimentation about positional encoding☆19Updated 5 years ago
- PyTorch implementation of some attentions for Deep Learning Researchers.☆547Updated 3 years ago
- Additive margin softmax loss in pytorch☆48Updated 6 years ago
- Implementation of Visual Transformer for Small-size Datasets☆128Updated 3 years ago
- Implementation of self-supervised image-level contrastive pretraining methods using Keras.☆70Updated 4 years ago