SirRob1997 / Crowded-Valley---Results
This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
☆180Updated 3 years ago
Alternatives and similar repositories for Crowded-Valley---Results:
Users that are interested in Crowded-Valley---Results are comparing it to the libraries listed below
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated last year
- Official code for the Stochastic Polyak step-size optimizer☆138Updated 8 months ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆123Updated 7 months ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆572Updated last month
- ☆98Updated 3 years ago
- ☆153Updated 4 years ago
- ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning☆270Updated last year
- ☆156Updated 2 years ago
- ☆213Updated 3 years ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆209Updated 9 months ago
- Codebase for Learning Invariances in Neural Networks☆93Updated 2 years ago
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 4 years ago
- Implements stochastic line search☆118Updated last year
- ☆134Updated 3 years ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆211Updated 3 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆107Updated 2 years ago
- This library would form a permanent home for reusable components for deep probabilistic programming. The library would form and harness a…☆305Updated 2 months ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆183Updated 2 months ago
- ☆143Updated last year
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- Gradient based Hyperparameter Tuning library in PyTorch☆289Updated 4 years ago
- Hessian spectral density estimation in TF and Jax☆121Updated 4 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Differentiable Sorting Networks☆110Updated last year
- A Machine Learning workflow for Slurm.☆149Updated 4 years ago
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆474Updated 2 years ago
- Create animations for the optimization trajectory of neural nets☆145Updated last year
- Last-layer Laplace approximation code examples☆83Updated 3 years ago
- Hypergradient descent☆145Updated 8 months ago