Alternatives and similar repositories for lookahead:

Users that are interested in lookahead are comparing it to the libraries listed below

• pytorch / contrib
  Implementations of ideas from recent papers
  ☆393Updated 4 years ago
• lessw2020 / Best-Deep-Learning-Optimizers
  Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable
  ☆214Updated 4 years ago
• lonePatient / lookahead_pytorch
  pytorch implement of Lookahead Optimizer
  ☆189Updated 2 years ago
• mgrankin / over9000
  Over9000 optimizer
  ☆426Updated 2 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆374Updated 4 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆365Updated 7 years ago
• szymonmaszke / torchfunc
  PyTorch functions and utilities to make your life easier
  ☆195Updated 4 years ago
• majumderb / rezero
  Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆408Updated 9 months ago
• t-vi / pytorch-tvmisc
  Totally Versatile Miscellanea for Pytorch
  ☆470Updated 3 years ago
• AlexiaJM / MaximumMarginGANs
  Code for paper: "Support Vector Machines, Wasserstein's distance and gradient-penalty GANs maximize a margin"
  ☆178Updated 5 years ago
• alphadl / lookahead.pytorch
  lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch
  ☆335Updated 5 years ago
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆345Updated 5 years ago
• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆146Updated 11 months ago
• wgrathwohl / JEM
  Project site for "Your Classifier is Secretly an Energy-Based Model and You Should Treat it Like One"
  ☆423Updated 2 years ago
• szymonmaszke / torchdatasets
  PyTorch dataset extended with map, cache etc. (tensorflow.data like)
  ☆329Updated 2 years ago
• loeweX / Greedy_InfoMax
  Code for the paper: Putting An End to End-to-End: Gradient-Isolated Learning of Representations
  ☆285Updated 2 years ago
• uber-research / intrinsic-dimension
  ☆219Updated 6 years ago
• loshchil / AdamW-and-SGDW
  Decoupled Weight Decay Regularization (ICLR 2019)
  ☆274Updated 6 years ago
• rahulkidambi / AccSGD
  Implements pytorch code for the Accelerated SGD algorithm.
  ☆215Updated 7 years ago
• hongyi-zhang / Fixup
  A Re-implementation of Fixed-update Initialization
  ☆153Updated 5 years ago
• SirRob1997 / Crowded-Valley---Results
  This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
  ☆180Updated 3 years ago
• uber-research / deconstructing-lottery-tickets
  ☆144Updated 2 years ago
• facebookresearch / luckmatters
  Understanding Training Dynamics of Deep ReLU Networks
  ☆291Updated 3 months ago
• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆262Updated 3 years ago
• Vermeille / Torchelie
  Torchélie is a set of utility functions, layers, losses, models, trainers and other things for PyTorch.
  ☆110Updated 4 months ago
• jxbz / fromage
  🧀 Pytorch code for the Fromage optimiser.
  ☆124Updated 9 months ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆545Updated 4 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆251Updated 2 years ago
• liamcli / randomNAS_release
  Code release for paper "Random Search and Reproducibility for NAS"
  ☆167Updated 5 years ago
• amirgholami / adahessian
  ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
  ☆275Updated 2 years ago