johncava / SVRG-pytorchLinks
Implementation of Stochastic Variance Reduced Gradient Descent
☆8Updated 7 years ago
Alternatives and similar repositories for SVRG-pytorch
Users that are interested in SVRG-pytorch are comparing it to the libraries listed below
Sorting:
- Implementation of an efficient variant of SVRG that relies on mini-batching implemented in Pytorch☆26Updated 6 years ago
- Implementation of SVRG and SAGA optimization algorithms for deep learning topics.☆72Updated 4 years ago
- CoLa - Decentralized Linear Learning: https://arxiv.org/abs/1808.04883☆20Updated 3 years ago
- SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning☆23Updated 6 years ago
- Lua implementation of Entropy-SGD☆82Updated 7 years ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆39Updated 4 years ago
- ☆43Updated 6 years ago
- Implementation of the paper "Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes Theory", Ron Amit and Ron Meir, ICML 2018☆18Updated 4 years ago
- ZOSVRG-BlackBox-Adv☆12Updated 6 years ago
- ☆13Updated 2 years ago
- Convolutional Neural Tangent Kernel☆111Updated 5 years ago
- ☆74Updated 5 years ago
- ☆12Updated 4 years ago
- ☆50Updated 2 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆105Updated 4 years ago
- Ancestral Gumbel-Top-k Sampling☆24Updated 5 years ago
- Code for "On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length", ICLR 2019☆11Updated 2 years ago
- A simple Jax implementation of influence functions.☆16Updated last year
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 3 years ago
- ☆35Updated last year
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆46Updated 5 years ago
- A compressed adaptive optimizer for training large-scale deep learning models using PyTorch☆27Updated 5 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆40Updated 6 years ago
- SGD and Ordered SGD codes for deep learning, SVM, and logistic regression☆35Updated 4 years ago
- can calculate the Hessian matrix and/or its spectrum for simple neural nets☆10Updated 7 years ago
- ☆65Updated 10 months ago
- Code for Augment & Reduce, a scalable stochastic algorithm for large categorical distributions☆10Updated 7 years ago
- Computing various norms/measures on over-parametrized neural networks☆49Updated 6 years ago
- Implementation of the paper "Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes Theory", Ron Amit and Ron Meir, ICML 2018☆22Updated 5 years ago
- MDL Complexity computations and experiments from the paper "Revisiting complexity and the bias-variance tradeoff".☆18Updated last year