Alternatives and similar repositories for lookahead_pytorch

Users that are interested in lookahead_pytorch are comparing it to the libraries listed below

• alphadl / lookahead.pytorch
  lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch
  ☆337Updated 6 years ago
• majumderb / rezero
  Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆412Updated last year
• egg-west / AdamW-pytorch
  Implementation and experiments for AdamW on Pytorch
  ☆94Updated 5 years ago
• lessw2020 / mish
  Mish Deep Learning Activation Function for PyTorch / FastAI
  ☆161Updated 5 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆376Updated 4 years ago
• vfdev-5 / UDA-pytorch
  Unsupervised Data Augmentation experiments in PyTorch
  ☆60Updated 6 years ago
• digantamisra98 / EvoNorm
  Unofficial PyTorch Implementation of EvoNorm
  ☆122Updated 3 years ago
• google / bi-tempered-loss
  Robust Bi-Tempered Logistic Loss Based on Bregman Divergences. https://arxiv.org/pdf/1906.03361.pdf
  ☆147Updated 3 years ago
• Mrpatekful / swats
  Unofficial implementation of Switching from Adam to SGD optimization in PyTorch.
  ☆66Updated 2 years ago
• eladhoffer / utils.pytorch
  Utilities for Pytorch
  ☆88Updated 2 years ago
• XuezheMax / apollo
  Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization
  ☆182Updated 3 years ago
• bojone / keras_lookahead
  lookahead optimizer for keras
  ☆171Updated 5 years ago
• sdoria / SimpleSelfAttention
  A simpler version of the self-attention layer from SAGAN, and some image classification results.
  ☆212Updated 5 years ago
• karanchahal / distiller
  A large scale study of Knowledge Distillation.
  ☆220Updated 5 years ago
• mgrankin / over9000
  Over9000 optimizer
  ☆425Updated 2 years ago
• bojone / accum_optimizer_for_keras
  wrapping a keras optimizer to implement gradient accumulation
  ☆119Updated 4 years ago
• michaelrzhang / lookahead
  Implementation for the Lookahead Optimizer.
  ☆241Updated 3 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆61Updated last year
• pytorch / contrib
  Implementations of ideas from recent papers
  ☆392Updated 4 years ago
• anandsaha / pytorch.cyclic.learning.rate
  Using the CLR algorithm for training (https://arxiv.org/abs/1506.01186)
  ☆108Updated 7 years ago
• sgugger / Adam-experiments
  Experiments with Adam/AdamW/amsgrad
  ☆201Updated 6 years ago
• lessw2020 / Ranger-Mish-ImageWoof-5
  Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs
  ☆116Updated 5 years ago
• justheuristic / prefetch_generator
  Simple package that makes your generator work in background thread
  ☆280Updated 3 years ago
• ymcui / LAMB_Optimizer_TF
  LAMB Optimizer for Large Batch Training (TensorFlow version)
  ☆120Updated 5 years ago
• lonePatient / multi-sample_dropout_pytorch
  a simple pytorch implement of Multi-Sample Dropout
  ☆57Updated 6 years ago
• thegregyang / LossUpAccUp
  Loss and accuracy go opposite ways...right?
  ☆95Updated 5 years ago
• mhmoodlan / cyclic-learning-rate
  Cyclic learning rate TensorFlow implementation.
  ☆66Updated 6 years ago
• loshchil / AdamW-and-SGDW
  Decoupled Weight Decay Regularization (ICLR 2019)
  ☆277Updated 6 years ago
• mpyrozhok / adamwr
  Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neu…
  ☆151Updated 6 years ago
• hosseinshn / GradNorm
  This in my Demo of Chen et al. "GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks" ICML 2018
  ☆180Updated 3 years ago