IssamLaradji / sls
Implements stochastic line search
☆118Updated 2 years ago
Alternatives and similar repositories for sls:
Users that are interested in sls are comparing it to the libraries listed below
- Official code for the Stochastic Polyak step-size optimizer☆139Updated 9 months ago
- The Singular Values of Convolutional Layers☆72Updated 6 years ago
- Code for: Implicit Competitive Regularization in GANs☆114Updated 3 years ago
- Hypergradient descent☆145Updated 10 months ago
- 🧀 Pytorch code for the Fromage optimiser.☆123Updated 8 months ago
- Probabilistic classification in PyTorch/TensorFlow/scikit-learn with Fenchel-Young losses☆184Updated last year
- Source code for ICLR 2020 paper: "Learning to Guide Random Search"☆39Updated 7 months ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆104Updated last year
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- This repository is no longer maintained. Check☆81Updated 4 years ago
- [IJCAI'19, NeurIPS'19] Anode: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs☆103Updated 4 years ago
- Loss Patterns of Neural Networks☆84Updated 3 years ago
- Original PyTorch implementation of the Leap meta-learner (https://arxiv.org/abs/1812.01054) along with code for running the Omniglot expe…☆148Updated last year
- Autoregressive Energy Machines☆77Updated 2 years ago
- Codebase for Learning Invariances in Neural Networks☆94Updated 2 years ago
- Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks☆83Updated 3 years ago
- Differentiable bitonic sorting☆139Updated 4 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago
- This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"☆180Updated 3 years ago
- ☆153Updated 4 years ago
- [NeurIPS'19] [PyTorch] Adaptive Regularization in NN☆68Updated 5 years ago
- ☆61Updated 2 years ago
- ☆144Updated 2 years ago
- Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088☆53Updated 5 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago
- ☆32Updated 6 years ago
- Implementation of "Learning with Random Learning Rates" in PyTorch.☆102Updated 5 years ago
- Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934☆112Updated 5 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆74Updated 8 months ago