Alternatives and similar repositories for torch_swa_examples

Users that are interested in torch_swa_examples are comparing it to the libraries listed below

• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆46Updated 5 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated last year
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 5 years ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆54Updated 3 years ago
• michaelsdr / momentumnet
  Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities
  ☆208Updated last year
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• HolyBayes / pytorch_ard
  Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks
  ☆84Updated 4 years ago
• j-min / Dropouts
  PyTorch Implementations of Dropout Variants
  ☆88Updated 7 years ago
• ssnl / PyTorch-Reparam-Module
  Reparameterize your PyTorch modules
  ☆71Updated 4 years ago
• yukimasano / linear-probes
  Evaluating AlexNet features at various depths
  ☆40Updated 5 years ago
• moskomule / anatome
  Ἀνατομή is a PyTorch library to analyze representation of neural networks
  ☆66Updated 5 months ago
• sayakpaul / Adaptive-Gradient-Clipping
  Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.
  ☆85Updated 4 years ago
• yk / PyTorch_CIFAR10
  Pretrained TorchVision models on CIFAR10 dataset (with weights)
  ☆24Updated 5 years ago
• taoyang1122 / GradAug
  [NeurIPS'20] GradAug: A New Regularization Method for Deep Neural Networks
  ☆94Updated 4 years ago
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆28Updated 5 years ago
• lnsmith54 / BOSS
  This repository provides the code for replicating the experiments in the paper "Building One-Shot Semi-supervised (BOSS) Learning up to F…
  ☆36Updated 5 years ago
• minyoungg / overparam
  ☆42Updated 2 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆79Updated 5 years ago
• yaohungt / Adaptive-Regularization-Neural-Network
  [NeurIPS'19] [PyTorch] Adaptive Regularization in NN
  ☆68Updated 6 years ago
• digantamisra98 / EvoNorm
  Unofficial PyTorch Implementation of EvoNorm
  ☆123Updated 4 years ago
• Lightning-Universe / paper-AAVAE
  ☆47Updated 3 years ago
• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆87Updated 4 years ago
• Randl / kmeans_selfsuper
  ☆55Updated 4 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆72Updated 4 years ago
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆19Updated 5 years ago
• sajadn / Exemplar-VAE
  Exemplar VAE: Linking Generative Models, Nearest Neighbor Retrieval, and Data Augmentation
  ☆69Updated 4 years ago
• JiJingYu / delta_orthogonal_init_pytorch
  Delta Orthogonal Initialization for PyTorch
  ☆18Updated 7 years ago
• RAIVNLab / supsup
  Code for "Supermasks in Superposition"
  ☆124Updated 2 years ago
• eladhoffer / utils.pytorch
  Utilities for Pytorch
  ☆88Updated 3 years ago