johncava / SVRG-pytorch
Implementation of Stochastic Variance Reduced Gradient Descent
☆8Updated 7 years ago
Alternatives and similar repositories for SVRG-pytorch:
Users that are interested in SVRG-pytorch are comparing it to the libraries listed below
- Implementation of an efficient variant of SVRG that relies on mini-batching implemented in Pytorch☆26Updated 6 years ago
- SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning☆23Updated 6 years ago
- Lua implementation of Entropy-SGD☆82Updated 7 years ago
- CoLa - Decentralized Linear Learning: https://arxiv.org/abs/1808.04883☆20Updated 3 years ago
- Computing various norms/measures on over-parametrized neural networks☆49Updated 6 years ago
- Implementation of SVRG and SAGA optimization algorithms for deep learning topics.☆73Updated 4 years ago
- ☆42Updated 6 years ago
- Code for Augment & Reduce, a scalable stochastic algorithm for large categorical distributions☆10Updated 6 years ago
- ☆30Updated 4 years ago
- Implementation of the paper "Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes Theory", Ron Amit and Ron Meir, ICML 2018☆22Updated 5 years ago
- Implementation of the paper "Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes Theory", Ron Amit and Ron Meir, ICML 2018☆18Updated 4 years ago
- Low-variance and unbiased gradient for backpropagation through categorical random variables, with application in variational auto-encoder…☆17Updated 4 years ago
- Explaining a black-box using Deep Variational Information Bottleneck Approach☆46Updated 2 years ago
- Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"☆71Updated 8 years ago
- MDL Complexity computations and experiments from the paper "Revisiting complexity and the bias-variance tradeoff".☆18Updated last year
- Tensorflow code for "Hierarchical Decompositional Mixtures of Variational Autoencoders" (ICML'19)☆12Updated 4 years ago
- This repo contains the code used for NeurIPS 2019 paper "Asymmetric Valleys: Beyond Sharp and Flat Local Minima".☆14Updated 5 years ago
- ☆35Updated last year
- Implementation of Methods Proposed in Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networks (NeurIPS 2019)☆35Updated 4 years ago
- Large-batch Training, Neural Network Optimization☆9Updated 5 years ago
- EigenPro2 iteration in Tensorflow (Keras)☆23Updated 6 years ago
- ☆65Updated 9 months ago
- Code for Knowledge-Adaptation Priors based on the NeurIPS 2021 paper by Khan and Swaroop.☆16Updated 3 years ago
- A study on the following problems: what the memorization problem is in meta-learning; why memorization problem happens; and how we can pr…☆21Updated 2 years ago
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 3 years ago
- Distributional and Outlier Robust Optimization (ICML 2021)☆27Updated 3 years ago
- PyTorch implementation of efficient algorithms for DRO with CVaR and Chi-Square uncertainty sets☆59Updated 2 years ago
- This repository contains the Julia code for the paper "Competitive Gradient Descent"☆24Updated 5 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆40Updated 6 years ago
- PyTorch implementation of nonsymmetric determinantal point process (DPP) learning.☆24Updated 2 years ago