SirRob1997 / Crowded-Valley---Results
This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
☆176Updated 3 years ago
Related projects: ⓘ
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated 8 months ago
- 🧀 Pytorch code for the Fromage optimiser.☆120Updated 2 months ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆207Updated 4 months ago
- Official code for the Stochastic Polyak step-size optimizer☆137Updated 2 months ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆103Updated 2 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 3 years ago
- ☆153Updated 2 years ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆555Updated 4 months ago
- Hessian spectral density estimation in TF and Jax☆112Updated 4 years ago
- ☆96Updated 2 years ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆176Updated last month
- Efficient PyTorch Hessian eigendecomposition tools!☆355Updated 6 months ago
- ☆156Updated 4 years ago
- ☆133Updated 3 years ago
- A Machine Learning workflow for Slurm.☆145Updated 3 years ago
- Differentiable Algorithms and Algorithmic Supervision.☆101Updated last year
- Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …☆105Updated this week
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆474Updated 2 years ago
- ☆142Updated last year
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆212Updated 3 years ago
- Implementation of Estimating Training Data Influence by Tracing Gradient Descent (NeurIPS 2020)☆214Updated 2 years ago
- Create animations for the optimization trajectory of neural nets☆133Updated 7 months ago
- ☆231Updated last year
- Implementation for the Lookahead Optimizer.☆236Updated 2 years ago
- ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning☆263Updated last year
- This library would form a permanent home for reusable components for deep probabilistic programming. The library would form and harness a…☆300Updated 6 months ago
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆126Updated 8 months ago
- Codebase for Learning Invariances in Neural Networks☆94Updated last year
- PIX is an image processing library in JAX, for JAX.☆379Updated 2 months ago
- Implements stochastic line search☆117Updated last year