Alternatives and similar repositories for torch_swa_examples

Users that are interested in torch_swa_examples are comparing it to the libraries listed below

• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆61Updated last year
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆46Updated 5 years ago
• HolyBayes / pytorch_ard
  Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks
  ☆83Updated 3 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• lnsmith54 / BOSS
  This repository provides the code for replicating the experiments in the paper "Building One-Shot Semi-supervised (BOSS) Learning up to F…
  ☆36Updated 5 years ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆55Updated 2 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 4 years ago
• digantamisra98 / EvoNorm
  Unofficial PyTorch Implementation of EvoNorm
  ☆122Updated 3 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆79Updated 4 years ago
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆19Updated 4 years ago
• yaohungt / Adaptive-Regularization-Neural-Network
  [NeurIPS'19] [PyTorch] Adaptive Regularization in NN
  ☆68Updated 5 years ago
• sajadn / Exemplar-VAE
  Exemplar VAE: Linking Generative Models, Nearest Neighbor Retrieval, and Data Augmentation
  ☆68Updated 4 years ago
• michaelsdr / momentumnet
  Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities
  ☆208Updated last year
• facebookresearch / qhoptim
  Implementations of quasi-hyperbolic optimization algorithms.
  ☆102Updated 5 years ago
• j-min / Dropouts
  PyTorch Implementations of Dropout Variants
  ☆87Updated 7 years ago
• sayakpaul / Adaptive-Gradient-Clipping
  Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.
  ☆85Updated 4 years ago
• taoyang1122 / GradAug
  [NeurIPS'20] GradAug: A New Regularization Method for Deep Neural Networks
  ☆94Updated 4 years ago
• ssnl / PyTorch-Reparam-Module
  Reparameterize your PyTorch modules
  ☆71Updated 4 years ago
• yukimasano / linear-probes
  Evaluating AlexNet features at various depths
  ☆40Updated 4 years ago
• ankandrew / online-label-smoothing-pt
  Implementation of Online Label Smoothing in PyTorch
  ☆95Updated 2 years ago
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆29Updated 5 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆72Updated 3 years ago
• editable-ICLR2020 / editable
  ☆32Updated 5 years ago
• minyoungg / overparam
  ☆41Updated 2 years ago
• vacancy / AdvancedIndexing-PyTorch
  (Batched) advanced indexing for PyTorch.
  ☆53Updated 8 months ago
• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 5 years ago
• facebookresearch / irmae
  PyTorch implementation of IRMAE https//arxiv.org/abs/2010.00679
  ☆47Updated 3 years ago
• moskomule / anatome
  Ἀνατομή is a PyTorch library to analyze representation of neural networks
  ☆65Updated 2 months ago
• Randl / kmeans_selfsuper
  ☆54Updated 3 years ago