Alternatives and similar repositories for DemonRangerOptimizer

Users that are interested in DemonRangerOptimizer are comparing it to the libraries listed below

• SirRob1997 / Crowded-Valley---Results
  This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
  ☆184Updated 4 years ago
• IssamLaradji / sps
  Official code for the Stochastic Polyak step-size optimizer
  ☆139Updated last year
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆79Updated 5 years ago
• IssamLaradji / sls
  Implements stochastic line search
  ☆118Updated 2 years ago
• aiwabdn / pygln
  Python implementation of GLN in different frameworks
  ☆96Updated 5 years ago
• rasbt / cyclemoid-pytorch
  Cyclemoid implementation for PyTorch
  ☆90Updated 3 years ago
• jxbz / madam
  👩 Pytorch and Jax code for the Madam optimiser.
  ☆53Updated 5 years ago
• jxbz / fromage
  🧀 Pytorch code for the Fromage optimiser.
  ☆129Updated last year
• louislva / deepmind-perceiver
  My implementation of DeepMind's Perceiver
  ☆63Updated 4 years ago
• HolyBayes / pytorch_ard
  Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks
  ☆85Updated 4 years ago
• facebookresearch / qhoptim
  Implementations of quasi-hyperbolic optimization algorithms.
  ☆102Updated 5 years ago
• ml-research / pau
  Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network
  ☆64Updated 4 years ago
• HomebrewML / revlib
  Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
  ☆132Updated 3 years ago
• abr / keras-lmu
  Keras implementation of Legendre Memory Units
  ☆214Updated 2 months ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆24Updated 3 years ago
• cair / pyTsetlinMachine
  Implements the Tsetlin Machine, Convolutional Tsetlin Machine, Regression Tsetlin Machine, Weighted Tsetlin Machine, and Embedding Tsetli…
  ☆149Updated 10 months ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated 2 years ago
• uber-research / deconstructing-lottery-tickets
  ☆145Updated 2 years ago
• jambo6 / neuralRDEs
  Code for: "Neural Rough Differential Equations for Long Time Series", (ICML 2021)
  ☆122Updated 4 years ago
• moskomule / anatome
  Ἀνατομή is a PyTorch library to analyze representation of neural networks
  ☆66Updated 7 months ago
• Lightning-Universe / paper-AAVAE
  ☆47Updated 3 years ago
• zhuchen03 / gradinit
  Learning to Initialize Neural Networks for Stable and Efficient Training
  ☆138Updated 3 years ago
• optimizedlearning / mechanic
  ☆36Updated 2 years ago
• lessw2020 / Best-Deep-Learning-Optimizers
  Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable
  ☆218Updated 4 years ago
• jiaweizzhao / ZerO-initialization
  ☆75Updated 3 years ago
• pseeth / autoclip
  Adaptive Gradient Clipping
  ☆152Updated 3 years ago
• brohrer / sharpened-cosine-similarity
  An alternative to convolution in neural networks
  ☆259Updated last year
• OATML / RHO-Loss
  ☆212Updated 3 years ago
• ma3oun / hrn
  Hash-routed Networks
  ☆20Updated 5 years ago
• srush / parallax
  ☆153Updated 5 years ago