fsschneider / DeepOBS
DeepOBS: A Deep Learning Optimizer Benchmark Suite
☆106Updated last year
Alternatives and similar repositories for DeepOBS:
Users that are interested in DeepOBS are comparing it to the libraries listed below
- This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"☆180Updated 3 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆123Updated 9 months ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago
- This repository is no longer maintained. Check☆81Updated 4 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- ☆33Updated 4 years ago
- Implements stochastic line search☆118Updated 2 years ago
- paper lists and information on mean-field theory of deep learning☆75Updated 6 years ago
- Official code for the Stochastic Polyak step-size optimizer☆139Updated 9 months ago
- Limitations of the Empirical Fisher Approximation☆47Updated last month
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Bayesianize: A Bayesian neural network wrapper in pytorch☆88Updated 11 months ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆78Updated 4 years ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆185Updated 4 months ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆131Updated 5 years ago
- ☆166Updated 8 months ago
- ☆99Updated 3 years ago
- Codebase for Learning Invariances in Neural Networks☆94Updated 2 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆108Updated 2 years ago
- pyhessian is a TensorFlow module which can be used to estimate Hessian matrices☆24Updated 4 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆142Updated last year
- ☆77Updated 4 years ago
- ☆153Updated 4 years ago
- CHOP: An optimization library based on PyTorch, with applications to adversarial examples and structured neural network training.☆77Updated last year
- Code to accompany the paper Radial Bayesian Neural Networks: Beyond Discrete Support In Large-Scale Bayesian Deep Learning☆33Updated 4 years ago
- Experiment code for "Randomized Automatic Differentiation"☆66Updated 4 years ago
- The Singular Values of Convolutional Layers☆72Updated 6 years ago
- ☆67Updated last year
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆209Updated 11 months ago
- Hessian spectral density estimation in TF and Jax☆123Updated 4 years ago