sooftware / pytorch-lr-scheduler
PyTorch implementation of some learning rate schedulers for deep learning researcher.
☆86Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for pytorch-lr-scheduler
- Gradient Reversal Layer for Domain Adaptation☆107Updated last year
- Additive margin softmax loss in pytorch☆45Updated 5 years ago
- [DEPRECATED] A knowledge distillation toolkit based on PyTorch and PyTorch Lightning.☆137Updated 9 months ago
- Implementations of Recent Papers in Computer Vision☆39Updated 2 years ago
- Implementation of Online Label Smoothing in PyTorch☆94Updated 2 years ago
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆251Updated 3 years ago
- Polynomial Learning Rate Decay Scheduler for PyTorch☆65Updated 2 years ago
- A minimal pytorch package implementing a gradient reversal layer.☆156Updated 2 weeks ago
- Implementation of Linformer for Pytorch☆257Updated 10 months ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆73Updated 4 years ago
- Implementation of Visual Transformer for Small-size Datasets☆117Updated 2 years ago
- A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stoppin…☆60Updated 2 years ago
- Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representations☆88Updated 5 months ago
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆134Updated last year
- ☆440Updated last year
- PyTorch implementation of "Squeezeformer: An Efficient Transformer for Automatic Speech Recognition" (NeurIPS 2022)☆130Updated last year
- A 1D implementation of a deformable convolutional layer in PyTorch with a few tricks.☆36Updated last year
- ☆65Updated 3 years ago
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆167Updated 2 years ago
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆122Updated 10 months ago
- Attention mechanism☆52Updated 3 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆222Updated 2 years ago
- PyTorch reimplementation of per-channel energy normalization for audio.☆94Updated 5 years ago
- ☆51Updated 4 years ago
- Simple MAE (masked autoencoders) with pytorch and pytorch-lightning.☆41Updated 9 months ago
- Adaptive Gradient Clipping☆117Updated 2 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 2 years ago
- Learning Rate Warmup in PyTorch☆392Updated this week
- ☆29Updated 2 years ago
- [ASRU 2021] Efficient Conformer: Progressive Downsampling and Grouped Attention for Automatic Speech Recognition☆210Updated last year