gd-zhang / Weight-DecayView external linksLinks
Regularization, Neural Network Training Dynamics
☆14Jan 13, 2020Updated 6 years ago
Alternatives and similar repositories for Weight-Decay
Users that are interested in Weight-Decay are comparing it to the libraries listed below
Sorting:
- Natural Gradient, Variational Inference☆29Jan 13, 2020Updated 6 years ago
- ☆30Feb 11, 2021Updated 5 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Jan 12, 2019Updated 7 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆132Jul 2, 2019Updated 6 years ago
- ☆16Jun 3, 2025Updated 8 months ago
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆19May 19, 2019Updated 6 years ago
- Actor Critic using Kronecker-Factored Trust Region☆19Jul 3, 2018Updated 7 years ago
- Variational Autoencoders & Normalizing Flows Project☆18Dec 16, 2016Updated 9 years ago
- An implementation of KFAC for TensorFlow☆199Feb 11, 2022Updated 4 years ago
- A Chainer extension for K-FAC☆20Jun 16, 2019Updated 6 years ago
- ☆23Nov 24, 2018Updated 7 years ago
- Code for "Functional variational Bayesian neural networks" (https://arxiv.org/abs/1903.05779)☆86Jul 19, 2020Updated 5 years ago
- ☆23Mar 1, 2022Updated 3 years ago
- This repository is no longer maintained. Check☆81Apr 23, 2020Updated 5 years ago
- Implementation of the Deep Frank-Wolfe Algorithm -- Pytorch☆62Mar 6, 2021Updated 4 years ago
- A lightweight library for tensorflow 2.0☆65Dec 3, 2019Updated 6 years ago
- Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088☆61Jun 18, 2019Updated 6 years ago
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆75Jul 1, 2025Updated 7 months ago
- ☆77Sep 18, 2017Updated 8 years ago
- ☆135Oct 23, 2017Updated 8 years ago
- Understanding Short-Horizon Bias in Stochastic Meta-Optimization☆37Mar 8, 2018Updated 7 years ago
- Build and run container environment for LFRic☆10Jan 8, 2024Updated 2 years ago
- Example implementation of the Bayesian neural network in "Structured and Efficient Variational Deep Learning with Matrix Gaussian Posteri…☆30Jul 17, 2020Updated 5 years ago
- SKFAC Preconditioner for MindSpore☆12Jul 2, 2021Updated 4 years ago
- Distributed Communication-Optimal Shuffle and Transpose Algorithm☆14Feb 4, 2026Updated last week
- Sample implementation accompanying the NeurIPS 2019 paper 'Powerset Convolutional Neural Networks' by Chris Wendler, Dan Alistarh, and Ma…☆10Oct 26, 2020Updated 5 years ago
- Compiler with automatic differentiation☆49Oct 18, 2023Updated 2 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆152Jun 22, 2023Updated 2 years ago
- Solver in the low-rank tensor train format with cross approximation approach for the multidimensional Fokker-Planck equation☆14Oct 24, 2023Updated 2 years ago
- Pytorch package for geometric softmax☆12Jun 13, 2019Updated 6 years ago
- Hyperoctree construction and manipulation☆11Jan 4, 2021Updated 5 years ago
- Tidy autoregressive inference in JAX☆15Sep 1, 2025Updated 5 months ago
- The implementation of the Block Coordinate Regularization by Denoising (BC-RED) algorithm (NeurIPS 2019)☆10Oct 15, 2019Updated 6 years ago
- Bidirectional transformation between Yao IR and QASM.☆11Dec 6, 2020Updated 5 years ago
- Standalone mini-app of the ECMWF cloud microphysics parameterization☆12Feb 6, 2026Updated last week
- Testing AVX capabilities with GCC☆11Jan 24, 2016Updated 10 years ago
- Playing around with CNNs☆11Sep 17, 2018Updated 7 years ago
- The code generates preferential attachment networks with homophily and two groups.☆13Apr 4, 2018Updated 7 years ago
- Build languages on Python.☆12May 2, 2021Updated 4 years ago