johncava / SVRG-pytorch
Implementation of Stochastic Variance Reduced Gradient Descent
☆8Updated 7 years ago
Alternatives and similar repositories for SVRG-pytorch:
Users that are interested in SVRG-pytorch are comparing it to the libraries listed below
- Implementation of an efficient variant of SVRG that relies on mini-batching implemented in Pytorch☆26Updated 6 years ago
- Implementation of SVRG and SAGA optimization algorithms for deep learning topics.☆70Updated 4 years ago
- SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning☆23Updated 6 years ago
- Computing various norms/measures on over-parametrized neural networks☆49Updated 6 years ago
- CoLa - Decentralized Linear Learning: https://arxiv.org/abs/1808.04883☆20Updated 3 years ago
- PyTorch implementation of nonsymmetric determinantal point process (DPP) learning.☆24Updated last year
- A compressed adaptive optimizer for training large-scale deep learning models using PyTorch☆27Updated 5 years ago
- Lua implementation of Entropy-SGD☆81Updated 6 years ago
- ☆65Updated 6 months ago
- Explaining a black-box using Deep Variational Information Bottleneck Approach☆46Updated 2 years ago
- Implementation of the paper "Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes Theory", Ron Amit and Ron Meir, ICML 2018☆22Updated 5 years ago
- An implementation of Wasserstein Fair Classification, a conference paper submitted to UAI 2019.☆21Updated 5 years ago
- PyTorch implementation of Proximal Gradient Algorithms a la Parikh and Boyd (2014). Useful for Auto-Sizing (Murray and Chiang 2015, Murra…☆41Updated 4 years ago
- Code for paper "Dimensionality-Driven Learning with Noisy Labels" - ICML 2018☆59Updated 7 months ago
- ☆13Updated 2 years ago
- Code for "On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length", ICLR 2019☆11Updated 2 years ago
- Official PyTorch code release for Implicit Gradient Transport, NeurIPS'19☆21Updated 5 years ago
- Jupyter notebook on Gumbel-max and Gumbel-softmax tricks☆41Updated 2 years ago
- Ancestral Gumbel-Top-k Sampling☆22Updated 4 years ago
- MDL Complexity computations and experiments from the paper "Revisiting complexity and the bias-variance tradeoff".☆18Updated last year
- ZOSVRG-BlackBox-Adv☆11Updated 6 years ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆47Updated 3 years ago
- ☆29Updated 4 years ago
- ☆50Updated last year
- Low-variance and unbiased gradient for backpropagation through categorical random variables, with application in variational auto-encoder…☆17Updated 4 years ago
- Code for Reparameterizable Subset Sampling via Continuous Relaxations, IJCAI 2019.☆54Updated last year
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆136Updated 5 years ago
- "Predict, then Interpolate: A Simple Algorithm to Learn Stable Classifiers" ICML 2021☆18Updated 3 years ago
- [ICLR 2020] FSPool: Learning Set Representations with Featurewise Sort Pooling☆42Updated last year
- SGD and Ordered SGD codes for deep learning, SVM, and logistic regression☆35Updated 4 years ago