IssamLaradji / sls
Implements stochastic line search
☆118Updated last year
Alternatives and similar repositories for sls:
Users that are interested in sls are comparing it to the libraries listed below
- Official code for the Stochastic Polyak step-size optimizer☆138Updated 8 months ago
- This repository is no longer maintained. Check☆81Updated 4 years ago
- Probabilistic classification in PyTorch/TensorFlow/scikit-learn with Fenchel-Young losses☆184Updated last year
- Hypergradient descent☆145Updated 9 months ago
- The Singular Values of Convolutional Layers☆71Updated 6 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆123Updated 7 months ago
- Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks☆83Updated 3 years ago
- Code for: Implicit Competitive Regularization in GANs☆114Updated 3 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- [IJCAI'19, NeurIPS'19] Anode: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs☆103Updated 4 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Source code for ICLR 2020 paper: "Learning to Guide Random Search"☆39Updated 6 months ago
- This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"☆180Updated 3 years ago
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated last year
- Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934☆112Updated 5 years ago
- Prescribed Generative Adversarial Networks☆143Updated 4 years ago
- Variance Networks: When Expectation Does Not Meet Your Expectations, ICLR 2019☆39Updated 5 years ago
- Autoregressive Energy Machines☆77Updated 2 years ago
- Implementation of "Learning with Random Learning Rates" in PyTorch.☆102Updated 5 years ago
- Implementations of quasi-hyperbolic optimization algorithms.☆102Updated 4 years ago
- Optimization with orthogonal constraints and on general manifolds☆127Updated 4 years ago
- Code to accompany the paper Radial Bayesian Neural Networks: Beyond Discrete Support In Large-Scale Bayesian Deep Learning☆33Updated 4 years ago
- [NeurIPS'19] [PyTorch] Adaptive Regularization in NN☆67Updated 5 years ago
- Understanding normalizing flows☆131Updated 5 years ago
- Code for ICML 2018 paper on "Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam" by Khan, Nielsen, Tangkaratt, Lin, …☆112Updated 6 years ago
- Loss Patterns of Neural Networks☆84Updated 3 years ago
- Original PyTorch implementation of the Leap meta-learner (https://arxiv.org/abs/1812.01054) along with code for running the Omniglot expe…☆148Updated last year
- ☆61Updated last year
- Implementation for the Lookahead Optimizer.☆240Updated 2 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated 4 years ago