Alternatives and similar repositories for torch_swa_examples

Users that are interested in torch_swa_examples are comparing it to the libraries listed below

• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆61Updated last year
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 4 years ago
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆46Updated 5 years ago
• moskomule / anatome
  Ἀνατομή is a PyTorch library to analyze representation of neural networks
  ☆65Updated last month
• HolyBayes / pytorch_ard
  Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks
  ☆83Updated 3 years ago
• j-min / Dropouts
  PyTorch Implementations of Dropout Variants
  ☆87Updated 7 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆79Updated 4 years ago
• digantamisra98 / EvoNorm
  Unofficial PyTorch Implementation of EvoNorm
  ☆122Updated 3 years ago
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆19Updated 4 years ago
• ssnl / PyTorch-Reparam-Module
  Reparameterize your PyTorch modules
  ☆71Updated 4 years ago
• michaelsdr / momentumnet
  Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities
  ☆209Updated last year
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆55Updated 2 years ago
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆28Updated 5 years ago
• lnsmith54 / BOSS
  This repository provides the code for replicating the experiments in the paper "Building One-Shot Semi-supervised (BOSS) Learning up to F…
  ☆36Updated 4 years ago
• yaohungt / Adaptive-Regularization-Neural-Network
  [NeurIPS'19] [PyTorch] Adaptive Regularization in NN
  ☆68Updated 5 years ago
• lucidrains / omninet-pytorch
  Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch
  ☆58Updated 4 years ago
• minyoungg / overparam
  ☆41Updated 2 years ago
• ducha-aiki / LSUV-pytorch
  Simple implementation of the LSUV initialization in PyTorch
  ☆58Updated last year
• Randl / kmeans_selfsuper
  ☆54Updated 3 years ago
• vacancy / AdvancedIndexing-PyTorch
  (Batched) advanced indexing for PyTorch.
  ☆53Updated 7 months ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆77Updated 7 years ago
• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆87Updated 4 years ago
• sayakpaul / Adaptive-Gradient-Clipping
  Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.
  ☆85Updated 4 years ago
• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 5 years ago
• lucidrains / isab-pytorch
  An implementation of (Induced) Set Attention Block, from the Set Transformers paper
  ☆60Updated 2 years ago
• ankandrew / online-label-smoothing-pt
  Implementation of Online Label Smoothing in PyTorch
  ☆94Updated 2 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆72Updated 3 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated last year