JRC1995 / DemonRangerOptimizerLinks
Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
☆25Updated 4 years ago
Alternatives and similar repositories for DemonRangerOptimizer
Users that are interested in DemonRangerOptimizer are comparing it to the libraries listed below
Sorting:
- Implements stochastic line search☆118Updated 2 years ago
- This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"☆181Updated 4 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆125Updated last year
- Layerwise Batch Entropy Regularization☆23Updated 2 years ago
- Python implementation of GLN in different frameworks☆97Updated 4 years ago
- Keras implementation of Legendre Memory Units☆215Updated 2 weeks ago
- My implementation of DeepMind's Perceiver☆63Updated 4 years ago
- Official code for the Stochastic Polyak step-size optimizer☆139Updated last year
- Easy-to-use AdaHessian optimizer (PyTorch)☆79Updated 4 years ago
- Structured matrices for compressing neural networks☆67Updated last year
- ☆36Updated last year
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆127Updated 2 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆63Updated 4 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Partial implementation of ODE-GAN technique from the paper Training Generative Adversarial Networks by Solving Ordinary Differential Equa…☆16Updated 4 years ago
- Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks☆83Updated 3 years ago
- Torchélie is a set of utility functions, layers, losses, models, trainers and other things for PyTorch.☆110Updated 7 months ago
- Functional deep learning☆108Updated 2 years ago
- Cyclemoid implementation for PyTorch☆90Updated 3 years ago
- Code for: "Neural Rough Differential Equations for Long Time Series", (ICML 2021)☆118Updated 4 years ago
- Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.☆60Updated 3 years ago
- ☆144Updated 2 years ago
- Implementations of quasi-hyperbolic optimization algorithms.☆102Updated 5 years ago
- Gradient based Hyperparameter Tuning library in PyTorch☆289Updated 5 years ago
- ☆163Updated 2 years ago
- Adaptive Gradient Clipping☆136Updated 2 years ago
- Asynchronous Distributed Hyperparameter Optimization.☆299Updated 5 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆179Updated last month
- Ἀνατομή is a PyTorch library to analyze representation of neural networks☆64Updated last month
- Lightweight Hyperparameter Optimization 🚂☆148Updated 10 months ago