fsschneider / DeepOBS
DeepOBS: A Deep Learning Optimizer Benchmark Suite
☆106Updated last year
Alternatives and similar repositories for DeepOBS:
Users that are interested in DeepOBS are comparing it to the libraries listed below
- This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"☆180Updated 3 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆124Updated 9 months ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated 2 months ago
- This repository is no longer maintained. Check☆81Updated 5 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- Official code for the Stochastic Polyak step-size optimizer☆139Updated 10 months ago
- Hessian spectral density estimation in TF and Jax☆123Updated 4 years ago
- paper lists and information on mean-field theory of deep learning☆74Updated 6 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆142Updated last year
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆109Updated 2 years ago
- Experiment code for "Randomized Automatic Differentiation"☆67Updated 4 years ago
- Codebase for Learning Invariances in Neural Networks☆95Updated 2 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆78Updated 4 years ago
- ☆99Updated 3 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆75Updated 9 months ago
- ☆153Updated 4 years ago
- ☆166Updated 9 months ago
- ☆15Updated 5 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆132Updated 5 years ago
- Code for: Implicit Competitive Regularization in GANs☆114Updated 3 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago
- ☆33Updated 4 years ago
- Implements stochastic line search☆118Updated 2 years ago
- A selection of neural network models ported from torchvision for JAX & Flax.☆44Updated 4 years ago
- Bayesianize: A Bayesian neural network wrapper in pytorch☆88Updated 11 months ago
- Neural network verification in JAX☆142Updated last year
- Pytorch implementation of 'Semi-Implicit Methods for Deep Neural Networks'☆24Updated 5 years ago
- Convolutional Neural Tangent Kernel☆111Updated 5 years ago
- Autoregressive Energy Machines☆77Updated 2 years ago