fadel / pytorch_ema
Tiny PyTorch library for maintaining a moving average of a collection of parameters.
☆428Updated 7 months ago
Alternatives and similar repositories for pytorch_ema:
Users that are interested in pytorch_ema are comparing it to the libraries listed below
- A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model☆577Updated 5 months ago
- ☆457Updated 2 years ago
- Learning Rate Warmup in PyTorch☆410Updated last month
- A LARS implementation in PyTorch☆345Updated 5 years ago
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆989Updated 6 months ago
- A Pytorch-Lightning implementation of self-supervised algorithms☆538Updated 3 years ago
- Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch☆1,138Updated last year
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆763Updated last year
- The correct way to resize images or tensors. For Numpy or Pytorch (differentiable).☆558Updated last year
- Compare neural networks by their feature similarity☆359Updated last year
- A PyTorch implementation of the 1d and 2d Sinusoidal positional encoding/embedding.☆253Updated 4 years ago
- Implementation of Linformer for Pytorch☆282Updated last year
- Implementation of Slot Attention from GoogleAI☆425Updated 8 months ago
- An implementation of 1D, 2D, and 3D positional encoding in Pytorch and TensorFlow☆582Updated 6 months ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆217Updated 4 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆225Updated 3 years ago
- Project site for "Your Classifier is Secretly an Energy-Based Model and You Should Treat it Like One"☆423Updated 2 years ago
- Fast, differentiable sorting and ranking in PyTorch☆808Updated last year
- Ranger deep learning optimizer rewrite to use newest components☆329Updated last year
- NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/☆345Updated last year
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆167Updated last month
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆143Updated 3 years ago
- Code snippets created for the PyTorch discussion board☆561Updated 4 years ago
- EsViT: Efficient self-supervised Vision Transformers☆410Updated last year
- Implementation of 1D, 2D, and 3D FFT convolutions in PyTorch. Much faster than direct convolutions for large kernel sizes.☆494Updated last year
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆209Updated last year
- Useful PyTorch functions and modules that are not implemented in PyTorch by default☆187Updated last year
- Implementation of Pixel-level Contrastive Learning, proposed in the paper "Propagate Yourself", in Pytorch☆258Updated 4 years ago
- An All-MLP solution for Vision, from Google AI☆1,020Updated 7 months ago
- Compute CNN receptive field size in pytorch in one line☆360Updated 11 months ago