SamuelHorvath / Variance_Reduced_Optimizers_Pytorch
PyTorch Implementation of Variance Reduced Optimization Algorithms -- SARAH and SVRG.
☆11Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for Variance_Reduced_Optimizers_Pytorch
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆143Updated 2 weeks ago
- Neural Tangent Kernel Papers☆92Updated 8 months ago
- Welcome to the 'In Context Learning Theory' Reading Group☆22Updated this week
- An implementation of the penalty-based bilevel gradient descent (PBGD) algorithm and the iterative differentiation (ITD/RHG) methods.☆16Updated last year
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆18Updated 2 years ago
- Repository for Deep Learning Theory papers☆15Updated 9 months ago
- Implementation of an efficient variant of SVRG that relies on mini-batching implemented in Pytorch☆26Updated 5 years ago
- Open-L2O: A Comprehensive and Reproducible Benchmark for Learning to Optimize Algorithms☆262Updated last year
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆43Updated 2 years ago
- This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success o…☆249Updated 7 months ago
- ☆18Updated last year
- summer school materials☆45Updated last year
- Research Pipeline (RPipe)☆21Updated this week
- Python implementation of Scaling Neural Tangent Kernels via Sketching and Random Features☆14Updated 2 years ago
- Experiments for distributed optimization algorithms☆69Updated last year
- This repository contains the official implementation for the manuscript: Make Landscape Flatter in Differentially Private Federated Lear…☆39Updated last year
- Bi-level Optimization for Advanced Deep Learning☆39Updated 2 years ago
- ☆210Updated last year
- Hey,this is a torch implementation of LEAF(a benchmark of FL)☆24Updated 3 years ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆270Updated last week
- Code repository is for "Federated Composite Optimization", to appear in ICML 2021☆11Updated 2 years ago
- Benchmark for bi-level optimization solvers☆36Updated 2 weeks ago
- Summer course on mathematical theory of deep learning☆52Updated 5 years ago
- ☆78Updated 2 years ago
- Federated Learning - PyTorch☆15Updated 3 years ago
- A fast algorithm to optimally compose privacy guarantees of differentially private (DP) mechanisms to arbitrary accuracy.☆68Updated 8 months ago
- Example Code for paper "Provably Faster Algorithms for Bilevel Optimization"☆14Updated 2 years ago
- A lecture note for understanding deep learning☆189Updated 3 months ago
- LipSDP - Lipschitz Estimation for Neural Networks☆62Updated 2 years ago
- ☆55Updated 3 years ago