fsschneider / DeepOBS
DeepOBS: A Deep Learning Optimizer Benchmark Suite
☆103Updated last year
Alternatives and similar repositories for DeepOBS:
Users that are interested in DeepOBS are comparing it to the libraries listed below
- This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"☆180Updated 3 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆123Updated 6 months ago
- Limitations of the Empirical Fisher Approximation☆47Updated 4 years ago
- This repository is no longer maintained. Check☆81Updated 4 years ago
- ☆98Updated 3 years ago
- A selection of neural network models ported from torchvision for JAX & Flax.☆44Updated 4 years ago
- ☆163Updated 5 months ago
- paper lists and information on mean-field theory of deep learning☆75Updated 5 years ago
- Codebase for Learning Invariances in Neural Networks☆93Updated 2 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆72Updated 6 months ago
- Code to accompany the paper Radial Bayesian Neural Networks: Beyond Discrete Support In Large-Scale Bayesian Deep Learning☆33Updated 4 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 3 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆144Updated last year
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago
- ☆15Updated 4 years ago
- ☆33Updated 4 years ago
- The Singular Values of Convolutional Layers☆71Updated 6 years ago
- Official code for the Stochastic Polyak step-size optimizer☆138Updated 7 months ago
- Hessian spectral density estimation in TF and Jax☆120Updated 4 years ago
- A library for evaluating representations.☆74Updated 3 years ago
- ☆77Updated 4 years ago
- Implements stochastic line search☆118Updated last year
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆106Updated 2 years ago
- Experiment code for "Randomized Automatic Differentiation"☆66Updated 4 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆141Updated last year
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆182Updated last month
- Convolutional Neural Tangent Kernel☆109Updated 5 years ago
- Structured matrices for compressing neural networks☆66Updated last year
- Statistical adaptive stochastic optimization methods☆33Updated 4 years ago