fadel / pytorch_ema
Tiny PyTorch library for maintaining a moving average of a collection of parameters.
☆428Updated 6 months ago
Alternatives and similar repositories for pytorch_ema:
Users that are interested in pytorch_ema are comparing it to the libraries listed below
- A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model☆569Updated 4 months ago
- ☆455Updated 2 years ago
- Learning Rate Warmup in PyTorch☆406Updated last month
- A LARS implementation in PyTorch☆343Updated 5 years ago
- A Pytorch-Lightning implementation of self-supervised algorithms☆537Updated 3 years ago
- PyTorch implementation of SimCLR: supports multi-GPU training and closely reproduces results☆203Updated 11 months ago
- Implementation of Slot Attention from GoogleAI☆424Updated 7 months ago
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆988Updated 6 months ago
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"☆813Updated 2 years ago
- Unofficial PyTorch Reimplementation of RandAugment.☆635Updated 2 years ago
- Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)☆484Updated 3 years ago
- Implementation of 1D, 2D, and 3D FFT convolutions in PyTorch. Much faster than direct convolutions for large kernel sizes.☆494Updated last year
- The correct way to resize images or tensors. For Numpy or Pytorch (differentiable).☆558Updated last year
- EsViT: Efficient self-supervised Vision Transformers☆410Updated last year
- Implementation of ConvMixer for "Patches Are All You Need? 🤷"☆1,069Updated 2 years ago
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆166Updated 3 weeks ago
- Project site for "Your Classifier is Secretly an Energy-Based Model and You Should Treat it Like One"☆421Updated 2 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆159Updated 4 years ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆755Updated 11 months ago
- Implementation of Pixel-level Contrastive Learning, proposed in the paper "Propagate Yourself", in Pytorch☆259Updated 4 years ago
- Masked Siamese Networks for Label-Efficient Learning (https://arxiv.org/abs/2204.07141)☆457Updated 2 years ago
- PyTorch implementation of Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning☆491Updated 2 years ago
- iBOT : Image BERT Pre-Training with Online Tokenizer (ICLR 2022)☆720Updated 3 years ago
- Compute CNN receptive field size in pytorch in one line☆359Updated 11 months ago
- A PyTorch implementation of the 1d and 2d Sinusoidal positional encoding/embedding.☆252Updated 4 years ago
- The Official PyTorch Implementation of "NVAE: A Deep Hierarchical Variational Autoencoder" (NeurIPS 2020 spotlight paper)☆1,047Updated 2 years ago
- NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/☆345Updated last year
- 🛠 Toolbox to extend PyTorch functionalities☆418Updated 11 months ago
- Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)☆521Updated 5 months ago
- Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch☆1,136Updated last year