fadel / pytorch_ema
Tiny PyTorch library for maintaining a moving average of a collection of parameters.
☆418Updated 3 months ago
Alternatives and similar repositories for pytorch_ema:
Users that are interested in pytorch_ema are comparing it to the libraries listed below
- A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model☆548Updated last month
- ☆446Updated last year
- Learning Rate Warmup in PyTorch☆399Updated this week
- A LARS implementation in PyTorch☆338Updated 4 years ago
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"☆808Updated 2 years ago
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆982Updated 3 months ago
- An All-MLP solution for Vision, from Google AI☆1,007Updated 4 months ago
- PyTorch implementation of Barlow Twins.☆966Updated 2 years ago
- NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/☆347Updated 11 months ago
- Masked Siamese Networks for Label-Efficient Learning (https://arxiv.org/abs/2204.07141)☆454Updated 2 years ago
- A Pytorch-Lightning implementation of self-supervised algorithms☆536Updated 2 years ago
- A PyTorch implementation of the 1d and 2d Sinusoidal positional encoding/embedding.☆250Updated 4 years ago
- PyTorch implementation of Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning☆480Updated 2 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆214Updated 3 years ago
- Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch☆1,115Updated last year
- Implementation of ConvMixer for "Patches Are All You Need? 🤷"☆1,063Updated 2 years ago
- Standalone TFRecord reader/writer with PyTorch data loaders☆872Updated 4 months ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆724Updated 8 months ago
- Unofficial PyTorch Reimplementation of RandAugment.☆631Updated last year
- Pytorch reimplementation for "Gradient Surgery for Multi-Task Learning"☆311Updated 3 years ago
- EsViT: Efficient self-supervised Vision Transformers☆409Updated last year
- Fast, differentiable sorting and ranking in PyTorch☆786Updated last year
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆167Updated 2 years ago
- Ranger deep learning optimizer rewrite to use newest components☆325Updated 11 months ago
- Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models☆769Updated 6 months ago
- 🛠 Toolbox to extend PyTorch functionalities☆417Updated 8 months ago
- Implementation of 1D, 2D, and 3D FFT convolutions in PyTorch. Much faster than direct convolutions for large kernel sizes.☆488Updated last year
- Implementation of Linformer for Pytorch☆262Updated last year
- Self-labelling via simultaneous clustering and representation learning. (ICLR 2020)☆538Updated 5 months ago
- Code snippets created for the PyTorch discussion board☆550Updated 3 years ago