This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
☆182Jul 17, 2021Updated 5 years ago
Alternatives and similar repositories for Crowded-Valley---Results
Users that are interested in Crowded-Valley---Results are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆109Dec 21, 2023Updated 2 years ago
- [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…☆17Jul 19, 2023Updated 3 years ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆618Jul 17, 2026Updated 3 months ago
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆490Jul 1, 2022Updated 4 years ago
- Source code for my PhD thesis: Backpropagation Beyond the Gradient☆21Feb 25, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Probabilistic ODE solvers are fun, but are they fast? See also: https://github.com/pnkraemer/probdiffeq for JAX code or https://github.c…☆22Jul 20, 2024Updated 2 years ago
- Probabilistic numerical finite differences. Compute finite difference weights and differentiation matrices on scattered data sites and wi…☆15May 8, 2023Updated 3 years ago
- ☆37Feb 4, 2022Updated 4 years ago
- Posterior Refinement Improves Sample Efficiency in Bayesian Neural Networks☆11Oct 21, 2022Updated 4 years ago
- A package for computing matrix exponentials and finite horizon Gramians☆11Jan 21, 2026Updated 9 months ago
- [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)☆15Nov 4, 2024Updated last year
- Label shift experiments☆17Dec 3, 2020Updated 5 years ago
- ☆12Sep 26, 2019Updated 7 years ago
- A lightweight library for tensorflow 2.0☆65Dec 3, 2019Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A search engine implementation using OpenAI's clip model☆10Jun 20, 2021Updated 5 years ago
- torch-optimizer -- collection of optimizers for Pytorch☆3,173Mar 22, 2024Updated 2 years ago
- Limitations of the Empirical Fisher Approximation☆50Mar 3, 2025Updated last year
- Distributed K-FAC preconditioner for PyTorch☆98Updated this week
- Cyclemoid implementation for PyTorch☆90Apr 2, 2022Updated 4 years ago
- A conda-smithy repository for nvcc.☆13Jan 23, 2025Updated last year
- A generic library for linear and non-linear Gaussian smoothing problems. The code leverages JAX and implements several linearization algo…☆15Apr 20, 2026Updated 6 months ago
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Jan 22, 2021Updated 5 years ago
- Github for the conference paper GLOD-Gaussian Likelihood OOD detector☆16Apr 18, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Sketched linear operations for PyTorch☆102Oct 24, 2025Updated 11 months ago
- Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"☆1,069Aug 9, 2024Updated 2 years ago
- (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.☆21Jul 13, 2022Updated 4 years ago
- Natural Gradient, Variational Inference☆29Jan 13, 2020Updated 6 years ago
- Figure sizes, font sizes, fonts, and more configurations at minimal overhead. Fix your journal papers, conference proceedings, and other …☆757Oct 12, 2026Updated last week
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆206Apr 24, 2024Updated 2 years ago
- Official Code for MIMETIC^2☆13Nov 19, 2024Updated last year
- Pychastic is a stochastic differential equations integrator written entirely in python.☆11Feb 12, 2025Updated last year
- code for "Semi-Discrete Normalizing Flows through Differentiable Tessellation"☆26Dec 10, 2022Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Simple CIFAR10 ResNet example with JAX.☆23Jun 1, 2021Updated 5 years ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆260Oct 29, 2023Updated 2 years ago
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆20Dec 28, 2021Updated 4 years ago
- This code accompanies the manuscript "A Generative Framework for Probabilistic, Spatiotemporally Coherent Downscaling of Climate Simulati…☆37Jul 21, 2025Updated last year
- Code for the ICCV 2023 paper "Benchmarking Low-Shot Robustness to Natural Distribution Shifts"☆11Jan 21, 2024Updated 2 years ago
- Probabilistic Numerics in Python.☆463Jul 3, 2025Updated last year
- Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"☆26Nov 2, 2021Updated 4 years ago