SirRob1997 / Crowded-Valley---Results
This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
☆180Updated 3 years ago
Alternatives and similar repositories for Crowded-Valley---Results:
Users that are interested in Crowded-Valley---Results are comparing it to the libraries listed below
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆106Updated last year
- 🧀 Pytorch code for the Fromage optimiser.☆124Updated 9 months ago
- Official code for the Stochastic Polyak step-size optimizer☆139Updated 10 months ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆209Updated last year
- ☆99Updated 3 years ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆214Updated 4 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆78Updated 4 years ago
- ☆153Updated 4 years ago
- Implements stochastic line search☆118Updated 2 years ago
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆476Updated 2 years ago
- Codebase for Learning Invariances in Neural Networks☆95Updated 2 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆109Updated 2 years ago
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 4 years ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆258Updated last year
- ☆133Updated 4 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Gradient based Hyperparameter Tuning library in PyTorch☆289Updated 4 years ago
- Efficient PyTorch Hessian eigendecomposition tools!☆373Updated last year
- ☆157Updated 2 years ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆185Updated 5 months ago
- A library for evaluating representations.☆76Updated 3 years ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆580Updated 4 months ago
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆251Updated 2 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆127Updated 2 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- Differentiable Algorithms and Algorithmic Supervision.☆115Updated last year
- ☆67Updated last year
- Understanding Training Dynamics of Deep ReLU Networks☆291Updated 3 months ago
- ☆144Updated 2 years ago
- ☆205Updated 2 years ago