SirRob1997 / Crowded-Valley---Results
This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
☆180Updated 3 years ago
Alternatives and similar repositories for Crowded-Valley---Results:
Users that are interested in Crowded-Valley---Results are comparing it to the libraries listed below
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated last year
- Official code for the Stochastic Polyak step-size optimizer☆138Updated 6 months ago
- ☆98Updated 3 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆122Updated 6 months ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆209Updated 8 months ago
- Codebase for Learning Invariances in Neural Networks☆93Updated 2 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆125Updated 2 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- Implements stochastic line search☆118Updated last year
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆106Updated 2 years ago
- Differentiable Sorting Networks☆109Updated last year
- Hessian spectral density estimation in TF and Jax☆120Updated 4 years ago
- ☆153Updated 4 years ago
- ☆156Updated 2 years ago
- Functional deep learning☆108Updated 2 years ago
- A Machine Learning workflow for Slurm.☆148Updated 4 years ago
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆473Updated 2 years ago
- PyTorch dataset extended with map, cache etc. (tensorflow.data like)☆328Updated 2 years ago
- A library for evaluating representations.☆74Updated 3 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆52Updated 3 years ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆568Updated 2 weeks ago
- Learning to Initialize Neural Networks for Stable and Efficient Training☆138Updated 2 years ago
- Implementation for the Lookahead Optimizer.☆240Updated 2 years ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆182Updated last month
- ☆134Updated 3 years ago
- Hypergradient descent☆143Updated 7 months ago
- Stochastic Automatic Differentiation library for PyTorch.☆195Updated 4 months ago
- ☆15Updated 4 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆146Updated last month
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆142Updated last year