Regularization, Neural Network Training Dynamics
☆14Jan 13, 2020Updated 6 years ago
Alternatives and similar repositories for Weight-Decay
Users that are interested in Weight-Decay are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆61Jan 12, 2019Updated 7 years ago
- Large-batch Training, Neural Network Optimization☆10Nov 8, 2019Updated 6 years ago
- Natural Gradient, Variational Inference☆29Jan 13, 2020Updated 6 years ago
- A curated list of resources to help with computational research.☆21Jun 11, 2022Updated 4 years ago
- ☆16Jun 3, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆134Jul 2, 2019Updated 7 years ago
- Contains code for the NeurIPS 2020 paper by Pan et al., "Continual Deep Learning by FunctionalRegularisation of Memorable Past"☆44Nov 10, 2020Updated 5 years ago
- A Chainer extension for K-FAC☆20Jun 16, 2019Updated 7 years ago
- An implementation of KFAC for TensorFlow☆198Feb 11, 2022Updated 4 years ago
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆19May 19, 2019Updated 7 years ago
- Simulate a small network of simple, diverse spiking neurons and analyze results☆12Dec 19, 2021Updated 4 years ago
- Understanding Short-Horizon Bias in Stochastic Meta-Optimization☆37Mar 8, 2018Updated 8 years ago
- Framework to train and simulate a spiking neural network (SNN) using Brian2, that implements a learning rule that combines STDP with a gl…☆14May 1, 2018Updated 8 years ago
- Variational Autoencoders & Normalizing Flows Project☆18Dec 16, 2016Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- barabasi albert algorithm to generate a scale free network.☆12Aug 29, 2019Updated 6 years ago
- This repository is no longer maintained. Check☆81Apr 23, 2020Updated 6 years ago
- Actor Critic using Kronecker-Factored Trust Region☆19Jul 3, 2018Updated 8 years ago
- Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088☆62Jun 18, 2019Updated 7 years ago
- Tensorflow implementation of Bayes-by-Backprop algorithm from "Weight uncertainty in neural networks" paper☆14Mar 6, 2019Updated 7 years ago
- Example implementation of the Bayesian neural network in "Structured and Efficient Variational Deep Learning with Matrix Gaussian Posteri…☆30Jul 17, 2020Updated 6 years ago
- Bidirectional transformation between Yao IR and QASM.☆11Dec 6, 2020Updated 5 years ago
- Learning protein structure with a differentiable simulator☆27Jul 8, 2019Updated 7 years ago
- Implementation of the Deep Frank-Wolfe Algorithm -- Pytorch☆63Mar 6, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Sep 2, 2020Updated 5 years ago
- [ICML'21 Oral] Improving Lossless Compression Rates via Monte Carlo Bits-Back Coding☆14Jun 10, 2021Updated 5 years ago
- A framework for simulating mean-field neural mass models of spiking neurons, comparing them to large network simulations, and predicting …☆21Mar 29, 2020Updated 6 years ago
- The implementation of the Block Coordinate Regularization by Denoising (BC-RED) algorithm (NeurIPS 2019)☆10Oct 15, 2019Updated 6 years ago
- Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)☆16Apr 27, 2019Updated 7 years ago
- PLASMA parallel library for dense linear algebra.☆10May 30, 2017Updated 9 years ago
- ☆64Feb 7, 2024Updated 2 years ago
- ☆22Nov 24, 2018Updated 7 years ago
- Limitations of the Empirical Fisher Approximation☆48Mar 3, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Working on this project as part of 3D-Vision course at ETH☆11Jul 20, 2020Updated 6 years ago
- This repo is for reproducing our results in “Lipschitz Generative Adversarial Nets”.☆11Sep 26, 2020Updated 5 years ago
- ☆40May 2, 2021Updated 5 years ago
- Distributed Communication-Optimal LU-factorization Algorithm☆12Aug 1, 2021Updated 4 years ago
- Pytorch optimizers implementing Hilbert Constrained Gradient Descent☆19May 9, 2019Updated 7 years ago
- Echo Noise Channel for Exact Mutual Information Calculation☆17Jul 17, 2020Updated 6 years ago
- This is a repository with implementations of neuron models, synapses, and spiking neural networks (SNN). It's still in development and it…☆32Aug 5, 2020Updated 5 years ago