fadel / pytorch_ema
Tiny PyTorch library for maintaining a moving average of a collection of parameters.
☆406Updated last month
Related projects ⓘ
Alternatives and complementary repositories for pytorch_ema
- ☆440Updated last year
- Learning Rate Warmup in PyTorch☆392Updated this week
- A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model☆517Updated last month
- A LARS implementation in PyTorch☆335Updated 4 years ago
- A Pytorch-Lightning implementation of self-supervised algorithms☆536Updated 2 years ago
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆977Updated last month
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"☆806Updated 2 years ago
- PyTorch implementation of SimCLR: supports multi-GPU training and closely reproduces results☆192Updated 6 months ago
- PyTorch implementation of Barlow Twins.☆968Updated 2 years ago
- Implementation of Linformer for Pytorch☆257Updated 10 months ago
- EsViT: Efficient self-supervised Vision Transformers☆408Updated last year
- Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch☆1,097Updated last year
- An All-MLP solution for Vision, from Google AI☆1,003Updated 2 months ago
- PyTorch implementation of Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning☆479Updated 2 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆159Updated 3 years ago
- ☆566Updated 3 weeks ago
- Masked Siamese Networks for Label-Efficient Learning (https://arxiv.org/abs/2204.07141)☆449Updated 2 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆140Updated 3 years ago
- The correct way to resize images or tensors. For Numpy or Pytorch (differentiable).☆548Updated last year
- NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/☆345Updated 10 months ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆698Updated 6 months ago
- 🛠 Toolbox to extend PyTorch functionalities☆417Updated 6 months ago
- Implementation of 1D, 2D, and 3D FFT convolutions in PyTorch. Much faster than direct convolutions for large kernel sizes.☆477Updated last year
- Ranger deep learning optimizer rewrite to use newest components☆323Updated 9 months ago
- Implementation of ConvMixer for "Patches Are All You Need? 🤷"☆1,062Updated 2 years ago
- Unofficial PyTorch implementation of "Meta Pseudo Labels"☆383Updated 10 months ago
- Compare neural networks by their feature similarity☆343Updated last year
- NeurIPS 2020, Debiased Contrastive Learning☆283Updated last year
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆167Updated 2 years ago
- A PyTorch implementation of the 1d and 2d Sinusoidal positional encoding/embedding.☆250Updated 4 years ago