Alternatives and similar repositories for Weight-Decay:

Users that are interested in Weight-Decay are comparing it to the libraries listed below

• pomonam / NoisyNaturalGradient
  TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".
  ☆60Updated 6 years ago
• gd-zhang / noisy-K-FAC
  Natural Gradient, Variational Inference
  ☆29Updated 5 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆47Updated 3 weeks ago
• plai-group / tvo
  Code for the Thermodynamic Variational Objective
  ☆26Updated 2 years ago
• ermongroup / higher_order_invariance
  Code for "Accelerating Natural Gradient with Higher-Order Invariance"
  ☆30Updated 5 years ago
• locuslab / monotone_op_net
  Monotone operator equilibrium networks
  ☆51Updated 4 years ago
• modestyachts / neural_kernels_code
  ☆36Updated 3 years ago
• thjashin / spectral-stein-grad
  Code for "A Spectral Approach to Gradient Estimation for Implicit Distributions" (ICML'18)
  ☆33Updated last year
• gehring / fax
  ☆80Updated 3 years ago
• wouterkool / estimating-gradients-without-replacement
  Estimating Gradients for Discrete Random Variables by Sampling without Replacement
  ☆40Updated 5 years ago
• rgrosse / csc2541_examples
  ☆29Updated 4 years ago
• ganguli-lab / deepchaos
  Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"
  ☆70Updated 8 years ago
• aboustati / vargrad
  Code accompanying VarGrad: A Low-Variance Gradient Estimator for Variational Inference
  ☆12Updated 4 years ago
• YingzhenLi / SteinGrad
  Code release for the ICLR paper
  ☆20Updated 6 years ago
• conormdurkan / autoregressive-energy-machines
  Autoregressive Energy Machines
  ☆77Updated 2 years ago
• Runjing-Liu120 / RaoBlackwellizedSGD
  A public repository for our paper, Rao-Blackwellized Stochastic Gradients for Discrete Distributions
  ☆22Updated 5 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆74Updated 8 months ago
• thegregyang / NNspectra
  Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube
  ☆48Updated 5 years ago
• AllanYangZhou / metalearning-symmetries
  Experiments for Meta-Learning Symmetries by Reparameterization
  ☆56Updated 3 years ago
• asteroidhouse / self-tuning-networks
  Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088
  ☆53Updated 5 years ago
• team-approx-bayes / dnn2gp
  Approximate Inference Turns Deep Networks into Gaussian Processes (dnn2gp)
  ☆48Updated 5 years ago
• tyohei / chainerkfac
  A Chainer extension for K-FAC
  ☆20Updated 5 years ago
• fissoreg / relative-gradient-jacobian
  Relative gradient optimization of the Jacobian term in unsupervised deep learning, NeurIPS 2020
  ☆21Updated 3 years ago
• gd-zhang / noisy-quadratic-model
  Large-batch Training, Neural Network Optimization
  ☆9Updated 5 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 4 years ago
• cunningham-lab / igr
  ☆31Updated 4 years ago
• brain-research / ncp
  Reliable Uncertainty Estimates in Deep Neural Networks using Noise Contrastive Priors
  ☆62Updated 4 years ago
• wgrathwohl / VERA
  ☆64Updated last year
• Bonnevie / rebar
  A Python implementation of the gradient REBAR estimator.
  ☆46Updated 6 years ago
• larsmaaloee / BIVA
  BIVA: A Very Deep Hierarchy of Latent Variables forGenerative Modeling
  ☆29Updated 5 years ago