Alternatives and similar repositories for lookahead_pytorch:

Users that are interested in lookahead_pytorch are comparing it to the libraries listed below

• alphadl / lookahead.pytorch
  lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch
  ☆334Updated 5 years ago
• pytorch / contrib
  Implementations of ideas from recent papers
  ☆391Updated 4 years ago
• mgrankin / over9000
  Over9000 optimizer
  ☆425Updated 2 years ago
• egg-west / AdamW-pytorch
  Implementation and experiments for AdamW on Pytorch
  ☆93Updated 5 years ago
• majumderb / rezero
  Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆408Updated 6 months ago
• lessw2020 / mish
  Mish Deep Learning Activation Function for PyTorch / FastAI
  ☆161Updated 4 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆372Updated 4 years ago
• sgugger / Adam-experiments
  Experiments with Adam/AdamW/amsgrad
  ☆197Updated 6 years ago
• XuezheMax / apollo
  Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization
  ☆182Updated 3 years ago
• michaelrzhang / lookahead
  Implementation for the Lookahead Optimizer.
  ☆240Updated 2 years ago
• loshchil / AdamW-and-SGDW
  Decoupled Weight Decay Regularization (ICLR 2019)
  ☆267Updated 6 years ago
• bojone / keras_lookahead
  lookahead optimizer for keras
  ☆170Updated 5 years ago
• digantamisra98 / EvoNorm
  Unofficial PyTorch Implementation of EvoNorm
  ☆121Updated 3 years ago
• mpyrozhok / adamwr
  Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neu…
  ☆149Updated 5 years ago
• Yonghongwei / Gradient-Centralization
  A New Optimization Technique for Deep Neural Networks
  ☆535Updated 3 years ago
• lessw2020 / Best-Deep-Learning-Optimizers
  Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable
  ☆211Updated 3 years ago
• sdoria / SimpleSelfAttention
  A simpler version of the self-attention layer from SAGAN, and some image classification results.
  ☆212Updated 5 years ago
• eladhoffer / utils.pytorch
  Utilities for Pytorch
  ☆89Updated 2 years ago
• lyakaap / VAT-pytorch
  Virtual Adversarial Training (VAT) implementation for PyTorch
  ☆296Updated 6 years ago
• lessw2020 / Ranger-Mish-ImageWoof-5
  Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs
  ☆116Updated 5 years ago
• zsef123 / EfficientNets-PyTorch
  A PyTorch implementation of " EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks."
  ☆309Updated 5 years ago
• hongyi-zhang / Fixup
  A Re-implementation of Fixed-update Initialization
  ☆152Updated 5 years ago
• csrhddlam / pytorch-checkpoint
  ☆165Updated 6 years ago
• hendrycks / GELUs
  A smoother activation function (undergrad code)
  ☆108Updated 4 years ago
• mhmoodlan / cyclic-learning-rate
  Cyclic learning rate TensorFlow implementation.
  ☆66Updated 5 years ago
• anandsaha / pytorch.cyclic.learning.rate
  Using the CLR algorithm for training (https://arxiv.org/abs/1506.01186)
  ☆108Updated 6 years ago
• ildoonet / unsupervised-data-augmentation
  Unofficial PyTorch Implementation of Unsupervised Data Augmentation.
  ☆146Updated 4 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆361Updated 6 years ago
• sseung0703 / KD_methods_with_TF
  Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)
  ☆265Updated 5 years ago
• OverLordGoldDragon / keras-adamw
  Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
  ☆167Updated 3 years ago