SirRob1997 / Crowded-Valley---Results
This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
☆180Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for Crowded-Valley---Results
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated 11 months ago
- 🧀 Pytorch code for the Fromage optimiser.☆122Updated 4 months ago
- Official code for the Stochastic Polyak step-size optimizer☆137Updated 5 months ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- ☆97Updated 2 years ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆208Updated 6 months ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆179Updated 3 months ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆561Updated this week
- ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning☆266Updated last year
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆104Updated 2 years ago
- A Machine Learning workflow for Slurm.☆146Updated 3 years ago
- Codebase for Learning Invariances in Neural Networks☆94Updated 2 years ago
- ☆235Updated last year
- Implementation of Estimating Training Data Influence by Tracing Gradient Descent (NeurIPS 2020)☆219Updated 2 years ago
- A library for evaluating representations.☆76Updated 2 years ago
- ☆155Updated 4 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …☆127Updated last month
- Differentiable Sorting Networks☆107Updated last year
- Efficient PyTorch Hessian eigendecomposition tools!☆364Updated 8 months ago
- This library would form a permanent home for reusable components for deep probabilistic programming. The library would form and harness a…☆301Updated 3 weeks ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆211Updated 3 years ago
- Implements stochastic line search☆117Updated last year
- ☆134Updated 3 years ago
- Hessian spectral density estimation in TF and Jax☆115Updated 4 years ago
- Structured matrices for compressing neural networks☆67Updated last year
- ☆153Updated 2 years ago
- Code for: Implicit Competitive Regularization in GANs☆114Updated 2 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆142Updated last year
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 3 years ago
- A pytorch implementation of our jacobian regularizer to encourage learning representations more robust to input perturbations.☆123Updated last year