IssamLaradji / sps
Official code for the Stochastic Polyak step-size optimizer
☆137Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for sps
- Implements stochastic line search☆117Updated last year
- 🧀 Pytorch code for the Fromage optimiser.☆122Updated 4 months ago
- This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"☆180Updated 3 years ago
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated 11 months ago
- ☆97Updated 2 years ago
- My implementation of DeepMind's Perceiver☆63Updated 3 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 3 years ago
- Bayesianize: A Bayesian neural network wrapper in pytorch☆87Updated 6 months ago
- ☆235Updated last year
- ☆76Updated 4 years ago
- Code for: Implicit Competitive Regularization in GANs☆114Updated 2 years ago
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 3 years ago
- Python implementation of GLN in different frameworks☆95Updated 4 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- Last-layer Laplace approximation code examples☆80Updated 3 years ago
- Codebase for Learning Invariances in Neural Networks☆94Updated 2 years ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆208Updated 6 months ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆104Updated 2 years ago
- A library for evaluating representations.☆76Updated 3 years ago
- Quick modules to turn regular Neural Networks to Bayesian Neural Networks with Dropout.☆35Updated 3 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆142Updated last year
- ☆155Updated 4 years ago
- Implementation of Estimating Training Data Influence by Tracing Gradient Descent (NeurIPS 2020)☆219Updated 2 years ago
- [IJCAI'19, NeurIPS'19] Anode: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs☆104Updated 4 years ago
- Loss Patterns of Neural Networks☆82Updated 3 years ago
- ☆67Updated last year
- Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …☆127Updated last month
- Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks☆84Updated 2 years ago
- ☆15Updated 4 years ago
- Prescribed Generative Adversarial Networks☆143Updated 4 years ago