Alternatives and similar repositories for Weight-Decay

Users that are interested in Weight-Decay are comparing it to the libraries listed below

• gd-zhang / noisy-K-FAC
  Natural Gradient, Variational Inference
  ☆29Updated 5 years ago
• pomonam / NoisyNaturalGradient
  TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".
  ☆60Updated 6 years ago
• locuslab / monotone_op_net
  Monotone operator equilibrium networks
  ☆54Updated 5 years ago
• modestyachts / neural_kernels_code
  ☆36Updated 4 years ago
• mariogeiger / hessian
  hessian in pytorch
  ☆187Updated 5 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆49Updated 9 months ago
• lezcano / expRNN
  Optimization with orthogonal constraints and on general manifolds
  ☆130Updated 5 years ago
• ermongroup / higher_order_invariance
  Code for "Accelerating Natural Gradient with Higher-Order Invariance"
  ☆30Updated 6 years ago
• plai-group / tvo
  Code for the Thermodynamic Variational Objective
  ☆26Updated 3 years ago
• conormdurkan / autoregressive-energy-machines
  Autoregressive Energy Machines
  ☆78Updated 3 years ago
• PrincetonLIPS / RandomizedAutomaticDifferentiation
  Experiment code for "Randomized Automatic Differentiation"
  ☆67Updated 5 years ago
• rgrosse / csc2541_examples
  ☆30Updated 4 years ago
• Bonnevie / rebar
  A Python implementation of the gradient REBAR estimator.
  ☆46Updated 7 years ago
• MethodsOfMachineLearning / probabilistic_line_search
  Probabilistic line search algorithm for stochastic optimization with a TensorFlow interface.
  ☆22Updated 8 years ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆148Updated 2 years ago
• yaroslavvb / kfac_pytorch
  ☆134Updated 8 years ago
• gehring / fax
  ☆80Updated 4 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆77Updated last year
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆149Updated 2 years ago
• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆147Updated last year
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆124Updated 5 years ago
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Updated 6 years ago
• aboustati / vargrad
  Code accompanying VarGrad: A Low-Variance Gradient Estimator for Variational Inference
  ☆12Updated 5 years ago
• ganguli-lab / deepchaos
  Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"
  ☆74Updated 9 years ago
• asteroidhouse / self-tuning-networks
  Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088
  ☆58Updated 6 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 5 years ago
• emtiyaz / vadam
  Code for ICML 2018 paper on "Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam" by Khan, Nielsen, Tangkaratt, Lin, …
  ☆112Updated 6 years ago
• tyohei / chainerkfac
  A Chainer extension for K-FAC
  ☆20Updated 6 years ago
• fdraxler / PyTorch-AutoNEB
  PyTorch AutoNEB implementation to identify minimum energy paths, e.g. in neural network loss landscapes
  ☆56Updated 3 years ago
• thjashin / spectral-stein-grad
  Code for "A Spectral Approach to Gradient Estimation for Implicit Distributions" (ICML'18)
  ☆34Updated 2 years ago