kilianFatras / variance_reduced_neural_networks
Implementation of SVRG and SAGA optimization algorithms for deep learning topics.
☆69Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for variance_reduced_neural_networks
- Implementation of an efficient variant of SVRG that relies on mini-batching implemented in Pytorch☆26Updated 5 years ago
- Tilted Empirical Risk Minimization (ICLR '21)☆59Updated 11 months ago
- Minimax Optimization, Stackelberg Games, Generative Adversarial Networks☆18Updated 4 years ago
- Code for the signSGD paper☆80Updated 3 years ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆43Updated 2 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆49Updated 3 years ago
- ☆29Updated 4 years ago
- Implementation of SVRG for training neural networks☆19Updated 4 years ago
- This is the source code for Learning Deep Kernels for Non-Parametric Two-Sample Tests (ICML2020).☆46Updated 3 years ago
- ☆119Updated 5 months ago
- SGD and Ordered SGD codes for deep learning, SVM, and logistic regression☆34Updated 4 years ago
- PyTorch implementation of FIM and empirical FIM☆58Updated 6 years ago
- Random Fourier Features☆49Updated 7 years ago
- SGD with compressed gradients and error-feedback: https://arxiv.org/abs/1901.09847☆29Updated 3 months ago
- demonstration of the information bottleneck theory for deep learning☆59Updated 7 years ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆64Updated 4 years ago
- Implementation of Stochastic Variance Reduced Gradient Descent☆8Updated 6 years ago
- Distributional and Outlier Robust Optimization (ICML 2021)☆27Updated 3 years ago
- Implementation of Invariant Risk Minimization https://arxiv.org/abs/1907.02893☆85Updated 4 years ago
- Code for Global Convergence of Block Coordinate Descent in Deep Learning (ICML 2019)☆34Updated 5 years ago
- ZOSVRG-BlackBox-Adv☆11Updated 6 years ago
- Certifying Some Distributional Robustness with Principled Adversarial Training (https://arxiv.org/abs/1710.10571)☆45Updated 6 years ago
- ☆73Updated 5 years ago
- ☆57Updated last year
- Limitations of the Empirical Fisher Approximation☆45Updated 4 years ago
- ☆66Updated 5 years ago
- ☆82Updated 4 years ago
- Public code for a paper "Lipschitz-Margin Training: Scalable Certification of Perturbation Invariance for Deep Neural Networks."☆34Updated 5 years ago
- Generative Model for Neural Networks☆25Updated 4 years ago