Alternatives and similar repositories for torch_swa_examples

Users that are interested in torch_swa_examples are comparing it to the libraries listed below

• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆46Updated 5 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 4 years ago
• Separius / CudaRelativeAttention
  custom cuda kernel for {2, 3}d relative attention with pytorch wrapper
  ☆43Updated 5 years ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆55Updated 2 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆79Updated 4 years ago
• digantamisra98 / EvoNorm
  Unofficial PyTorch Implementation of EvoNorm
  ☆122Updated 3 years ago
• fabio-deep / ReZero-ResNet
  Unofficial pytorch implementation of ReZero in ResNet
  ☆23Updated 5 years ago
• j-min / Dropouts
  PyTorch Implementations of Dropout Variants
  ☆87Updated 7 years ago
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆28Updated 5 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 5 years ago
• vinbhaskara / adams
  Exploiting Uncertainty of Loss Landscape for Stochastic Optimization
  ☆15Updated 6 years ago
• eladhoffer / utils.pytorch
  Utilities for Pytorch
  ☆89Updated 2 years ago
• ankandrew / online-label-smoothing-pt
  Implementation of Online Label Smoothing in PyTorch
  ☆94Updated 2 years ago
• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆87Updated 4 years ago
• hrayrhar / limit-label-memorization
  Improving generalization by controlling label-noise information in neural network weights.
  ☆40Updated 4 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated 11 months ago
• yukimasano / linear-probes
  Evaluating AlexNet features at various depths
  ☆40Updated 4 years ago
• Randl / kmeans_selfsuper
  ☆54Updated 3 years ago
• ducha-aiki / LSUV-pytorch
  Simple implementation of the LSUV initialization in PyTorch
  ☆58Updated last year
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆74Updated 7 years ago
• ag14774 / diffdist
  ☆62Updated 5 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆72Updated 3 years ago
• taoyang1122 / GradAug
  [NeurIPS'20] GradAug: A New Regularization Method for Deep Neural Networks
  ☆94Updated 4 years ago
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆107Updated 4 years ago
• moskomule / anatome
  Ἀνατομή is a PyTorch library to analyze representation of neural networks
  ☆64Updated this week
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆19Updated 4 years ago
• jotaf98 / pytorch-curveball
  A second-order optimizer for deep networks
  ☆25Updated 5 years ago
• google-research / diffstride
  TF/Keras code for DiffStride, a pooling layer with learnable strides.
  ☆124Updated 3 years ago