sooftware / pytorch-lr-scheduler
PyTorch implementation of some learning rate schedulers for deep learning researcher.
☆86Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for pytorch-lr-scheduler
- Additive margin softmax loss in pytorch☆45Updated 5 years ago
- Implementations of Recent Papers in Computer Vision☆39Updated 2 years ago
- ☆438Updated last year
- Deep Learning project template for PyTorch (multi-gpu training is supported)☆134Updated last year
- A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stoppin…☆60Updated 2 years ago
- This Module implements Spatial Pyramid Pooling (SPP) and Temporal Pyramid Pooling (TPP) as described in different papers.☆52Updated 5 years ago
- Implementation of Fast Transformer in Pytorch☆171Updated 3 years ago
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆251Updated 3 years ago
- Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification☆188Updated 3 years ago
- [DEPRECATED] A knowledge distillation toolkit based on PyTorch and PyTorch Lightning.☆137Updated 8 months ago
- Learning Rate Warmup in PyTorch☆393Updated this week
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆167Updated 2 years ago
- PyTorch implementation of "Squeezeformer: An Efficient Transformer for Automatic Speech Recognition" (NeurIPS 2022)☆131Updated last year
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆300Updated 2 years ago
- Implementation of Linformer for Pytorch☆255Updated 10 months ago
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆122Updated 9 months ago
- Gradient Reversal Layer for Domain Adaptation☆106Updated last year
- A pytorch template files generator.☆32Updated 9 months ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆209Updated 3 years ago
- ☆65Updated 3 years ago
- Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning☆155Updated 8 months ago
- Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.☆67Updated 2 years ago
- A minimal pytorch package implementing a gradient reversal layer.☆155Updated this week
- Unofficial PyTorch implementation of Masked Autoencoders that Listen☆63Updated 2 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆172Updated last year
- Implementation of Dat2Vec2.0 for vision☆16Updated last year
- Unofficial PyTorch implementation of Dynamic Convolution: Attention over Convolution Kernels☆43Updated 3 months ago
- Simple project base template for PyTorch deep Learning project. Features clean implementation of DDP training and Hydra config.☆57Updated 2 years ago
- Adaptive Gradient Clipping☆117Updated 2 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆112Updated last year