Alternatives and similar repositories for lookahead:

Users that are interested in lookahead are comparing it to the libraries listed below

• t-vi / pytorch-tvmisc
  Totally Versatile Miscellanea for Pytorch
  ☆470Updated 3 years ago
• noahgolmant / pytorch-hessian-eigenthings
  Efficient PyTorch Hessian eigendecomposition tools!
  ☆370Updated last year
• pytorch / contrib
  Implementations of ideas from recent papers
  ☆392Updated 4 years ago
• szymonmaszke / torchdatasets
  PyTorch dataset extended with map, cache etc. (tensorflow.data like)
  ☆328Updated 2 years ago
• rahulkidambi / AccSGD
  Implements pytorch code for the Accelerated SGD algorithm.
  ☆215Updated 7 years ago
• szymonmaszke / torchfunc
  PyTorch functions and utilities to make your life easier
  ☆195Updated 4 years ago
• mariogeiger / hessian
  hessian in pytorch
  ☆187Updated 4 years ago
• wgrathwohl / JEM
  Project site for "Your Classifier is Secretly an Energy-Based Model and You Should Treat it Like One"
  ☆420Updated 2 years ago
• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆145Updated 9 months ago
• lessw2020 / Best-Deep-Learning-Optimizers
  Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable
  ☆212Updated 3 years ago
• lonePatient / lookahead_pytorch
  pytorch implement of Lookahead Optimizer
  ☆189Updated 2 years ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆546Updated 4 years ago
• johnhw / differentiable_sorting
  Differentiable bitonic sorting
  ☆139Updated 4 years ago
• loshchil / AdamW-and-SGDW
  Decoupled Weight Decay Regularization (ICLR 2019)
  ☆271Updated 6 years ago
• SirRob1997 / Crowded-Valley---Results
  This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
  ☆180Updated 3 years ago
• dalmia / siren
  PyTorch implementation of Sinusodial Representation networks (SIREN)
  ☆263Updated 2 years ago
• facebookresearch / jacobian_regularizer
  A pytorch implementation of our jacobian regularizer to encourage learning representations more robust to input perturbations.
  ☆125Updated last year
• mgrankin / over9000
  Over9000 optimizer
  ☆427Updated 2 years ago
• michaelsdr / momentumnet
  Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities
  ☆209Updated 10 months ago
• TimDettmers / sparse_learning
  Sparse learning library and sparse momentum resources.
  ☆379Updated 2 years ago
• f-dangel / backpack
  BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.
  ☆572Updated 2 months ago
• google-research / rigl
  End-to-end training of sparse deep neural networks with little-to-no performance loss.
  ☆319Updated 2 years ago
• Vermeille / Torchelie
  Torchélie is a set of utility functions, layers, losses, models, trainers and other things for PyTorch.
  ☆110Updated 3 months ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆145Updated last year
• liamcli / randomNAS_release
  Code release for paper "Random Search and Reproducibility for NAS"
  ☆167Updated 5 years ago
• uber-research / deconstructing-lottery-tickets
  ☆144Updated last year
• IssamLaradji / sls
  Implements stochastic line search
  ☆118Updated 2 years ago
• brain-research / realistic-ssl-evaluation
  Open source release of the evaluation benchmark suite described in "Realistic Evaluation of Deep Semi-Supervised Learning Algorithms"
  ☆460Updated 5 years ago
• silvandeleemput / memcnn
  PyTorch Framework for Developing Memory Efficient Deep Invertible Networks
  ☆252Updated last year
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆372Updated 4 years ago