johncava / SVRG-pytorch
Implementation of Stochastic Variance Reduced Gradient Descent
☆8Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for SVRG-pytorch
- Implementation of an efficient variant of SVRG that relies on mini-batching implemented in Pytorch☆26Updated 5 years ago
- Implementation of SVRG and SAGA optimization algorithms for deep learning topics.☆69Updated 3 years ago
- SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning☆23Updated 6 years ago
- ☆35Updated last year
- ZOSVRG-BlackBox-Adv☆11Updated 6 years ago
- ☆42Updated 6 years ago
- Low-variance and unbiased gradient for backpropagation through categorical random variables, with application in variational auto-encoder…☆17Updated 4 years ago
- MDL Complexity computations and experiments from the paper "Revisiting complexity and the bias-variance tradeoff".☆18Updated last year
- A compressed adaptive optimizer for training large-scale deep learning models using PyTorch☆27Updated 4 years ago
- A study on the following problems: what the memorization problem is in meta-learning; why memorization problem happens; and how we can pr…☆20Updated last year
- PyTorch implementation of efficient algorithms for DRO with CVaR and Chi-Square uncertainty sets☆58Updated 2 years ago
- ☆65Updated 3 months ago
- Distributional and Outlier Robust Optimization (ICML 2021)☆27Updated 3 years ago
- ☆29Updated 4 years ago
- Lua implementation of Entropy-SGD☆81Updated 6 years ago
- Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"☆25Updated 3 years ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆39Updated 4 years ago
- ☆49Updated last year
- Computing various norms/measures on over-parametrized neural networks☆49Updated 5 years ago
- Implementation of SVRG for training neural networks☆19Updated 4 years ago
- Low-variance, efficient and unbiased gradient estimation for optimizing models with binary latent variables. (ICLR 2019)☆28Updated 5 years ago
- CoLa - Decentralized Linear Learning: https://arxiv.org/abs/1808.04883☆19Updated 2 years ago
- ☆57Updated last year
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆97Updated 4 years ago
- Implementation of the paper "Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes Theory", Ron Amit and Ron Meir, ICML 2018☆22Updated 5 years ago
- [JMLR] TRADES + random smoothing for certifiable robustness☆14Updated 4 years ago
- Regularized Learning under label shifts☆18Updated 5 years ago
- Toy datasets to evaluate algorithms for domain generalization and invariance learning.☆42Updated 2 years ago
- Code for Reparameterizable Subset Sampling via Continuous Relaxations, IJCAI 2019.☆52Updated last year