Alternatives and similar repositories for torch_swa_examples

Users that are interested in torch_swa_examples are comparing it to the libraries listed below

• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆46Updated 5 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated last year
• lnsmith54 / BOSS
  This repository provides the code for replicating the experiments in the paper "Building One-Shot Semi-supervised (BOSS) Learning up to F…
  ☆36Updated 5 years ago
• digantamisra98 / EvoNorm
  Unofficial PyTorch Implementation of EvoNorm
  ☆122Updated 4 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 4 years ago
• yukimasano / linear-probes
  Evaluating AlexNet features at various depths
  ☆40Updated 4 years ago
• ssnl / PyTorch-Reparam-Module
  Reparameterize your PyTorch modules
  ☆71Updated 4 years ago
• j-min / Dropouts
  PyTorch Implementations of Dropout Variants
  ☆87Updated 7 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆79Updated 4 years ago
• HolyBayes / pytorch_ard
  Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks
  ☆84Updated 3 years ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆55Updated 2 years ago
• Randl / kmeans_selfsuper
  ☆54Updated 3 years ago
• editable-ICLR2020 / editable
  ☆32Updated 5 years ago
• lucidrains / omninet-pytorch
  Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch
  ☆58Updated 4 years ago
• moskomule / anatome
  Ἀνατομή is a PyTorch library to analyze representation of neural networks
  ☆65Updated 2 months ago
• yaohungt / Adaptive-Regularization-Neural-Network
  [NeurIPS'19] [PyTorch] Adaptive Regularization in NN
  ☆68Updated 5 years ago
• universome / loss-patterns
  Loss Patterns of Neural Networks
  ☆85Updated 3 years ago
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆19Updated 5 years ago
• michaelsdr / momentumnet
  Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities
  ☆208Updated last year
• facebookresearch / qhoptim
  Implementations of quasi-hyperbolic optimization algorithms.
  ☆102Updated 5 years ago
• RAIVNLab / supsup
  Code for "Supermasks in Superposition"
  ☆124Updated last year
• vacancy / AdvancedIndexing-PyTorch
  (Batched) advanced indexing for PyTorch.
  ☆53Updated 8 months ago
• JiJingYu / delta_orthogonal_init_pytorch
  Delta Orthogonal Initialization for PyTorch
  ☆18Updated 7 years ago
• tmbdev-archive / pytorch-imagenet-wds
  ☆25Updated 4 years ago
• ducha-aiki / LSUV-pytorch
  Simple implementation of the LSUV initialization in PyTorch
  ☆58Updated last year
• taoyang1122 / GradAug
  [NeurIPS'20] GradAug: A New Regularization Method for Deep Neural Networks
  ☆94Updated 4 years ago
• minyoungg / overparam
  ☆41Updated 2 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆77Updated 7 years ago