Alternatives and similar repositories for pytorch_warmup:

Users that are interested in pytorch_warmup are comparing it to the libraries listed below

• katsura-jp / pytorch-cosine-annealing-with-warmup
  ☆449Updated last year
• ildoonet / pytorch-gradual-warmup-lr
  Gradually-Warmup Learning Rate Scheduler for PyTorch
  ☆988Updated 5 months ago
• fadel / pytorch_ema
  Tiny PyTorch library for maintaining a moving average of a collection of parameters.
  ☆426Updated 5 months ago
• SHI-Labs / Compact-Transformers
  Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)
  ☆520Updated 4 months ago
• PistonY / torch-toolbox
  🛠 Toolbox to extend PyTorch functionalities
  ☆418Updated 10 months ago
• locuslab / convmixer
  Implementation of ConvMixer for "Patches Are All You Need? 🤷"
  ☆1,070Updated 2 years ago
• wzlxjtu / PositionalEncoding2D
  A PyTorch implementation of the 1d and 2d Sinusoidal positional encoding/embedding.
  ☆252Updated 4 years ago
• rishikksh20 / convolution-vision-transformers
  PyTorch Implementation of CvT: Introducing Convolutions to Vision Transformers
  ☆226Updated 3 years ago
• lucidrains / mlp-mixer-pytorch
  An All-MLP solution for Vision, from Google AI
  ☆1,015Updated 6 months ago
• vballoli / nfnets-pytorch
  NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/
  ☆345Updated last year
• xxxnell / how-do-vits-work
  (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"
  ☆811Updated 2 years ago
• Fangyh09 / pytorch-receptive-field
  Compute CNN receptive field size in pytorch in one line
  ☆357Updated 10 months ago
• SwinTransformer / Transformer-SSL
  This is an official implementation for "Self-Supervised Learning with Swin Transformers".
  ☆648Updated 3 years ago
• sthalles / PyTorch-BYOL
  PyTorch implementation of Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
  ☆488Updated 2 years ago
• facebookresearch / convit
  Code for the Convolutional Vision Transformer (ConViT)
  ☆466Updated 3 years ago
• clcarwin / focal_loss_pytorch
  A PyTorch Implementation of Focal Loss.
  ☆979Updated 5 years ago
• lucidrains / bottleneck-transformer-pytorch
  Implementation of Bottleneck Transformer in Pytorch
  ☆676Updated 3 years ago
• Lyken17 / Efficient-PyTorch
  My best practice of training large dataset using PyTorch.
  ☆1,092Updated 10 months ago
• ildoonet / pytorch-randaugment
  Unofficial PyTorch Reimplementation of RandAugment.
  ☆633Updated 2 years ago
• imbue-ai / self_supervised
  A Pytorch-Lightning implementation of self-supervised algorithms
  ☆537Updated 2 years ago
• vahidk / tfrecord
  Standalone TFRecord reader/writer with PyTorch data loaders
  ☆879Updated 7 months ago
• microsoft / esvit
  EsViT: Efficient self-supervised Vision Transformers
  ☆410Updated last year
• vandit15 / Class-balanced-loss-pytorch
  Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"
  ☆792Updated last year
• cmsflash / efficient-attention
  An implementation of the efficient attention module.
  ☆305Updated 4 years ago
• leaderj1001 / Stand-Alone-Self-Attention
  Implementing Stand-Alone Self-Attention in Vision Models using Pytorch
  ☆454Updated 5 years ago
• chinhsuanwu / coatnet-pytorch
  A PyTorch implementation of "CoAtNet: Marrying Convolution and Attention for All Data Sizes"
  ☆380Updated 3 years ago
• lucidrains / linear-attention-transformer
  Transformer based on a variant of attention that is linear complexity in respect to sequence length
  ☆751Updated 10 months ago
• facebookresearch / simsiam
  PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566
  ☆1,182Updated 2 years ago
• lucidrains / byol-pytorch
  Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
  ☆1,798Updated 8 months ago
• WXinlong / DenseCL
  Dense Contrastive Learning (DenseCL) for self-supervised representation learning, CVPR 2021 Oral.
  ☆557Updated last year