SirRob1997 / Crowded-Valley---Results
This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
☆180Updated 3 years ago
Alternatives and similar repositories for Crowded-Valley---Results:
Users that are interested in Crowded-Valley---Results are comparing it to the libraries listed below
- Official code for the Stochastic Polyak step-size optimizer☆139Updated 9 months ago
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆106Updated last year
- 🧀 Pytorch code for the Fromage optimiser.☆123Updated 9 months ago
- Implements stochastic line search☆118Updated 2 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆78Updated 4 years ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆209Updated 11 months ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆577Updated 3 months ago
- Codebase for Learning Invariances in Neural Networks☆94Updated 2 years ago
- ☆157Updated 2 years ago
- ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning☆274Updated 2 years ago
- Efficient PyTorch Hessian eigendecomposition tools!☆370Updated last year
- ☆99Updated 3 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆108Updated 2 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- This library would form a permanent home for reusable components for deep probabilistic programming. The library would form and harness a…☆306Updated last month
- ☆133Updated 4 years ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆185Updated 4 months ago
- Hessian spectral density estimation in TF and Jax☆123Updated 4 years ago
- ☆153Updated 4 years ago
- Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.☆60Updated 3 years ago
- Cyclical Stochastic Gradient MCMC for Bayesian Deep Learning☆92Updated 4 years ago
- ☆144Updated 2 years ago
- Last-layer Laplace approximation code examples☆83Updated 3 years ago
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆211Updated this week
- ☆468Updated 8 months ago
- ☆122Updated 10 months ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Project site for "Your Classifier is Secretly an Energy-Based Model and You Should Treat it Like One"☆421Updated 2 years ago
- ☆202Updated 2 years ago
- A Machine Learning workflow for Slurm.☆149Updated 4 years ago