Alternatives and similar repositories for AdaX

Users that are interested in AdaX are comparing it to the libraries listed below

• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated 2 years ago
• Yonghongwei / Advanced-optimizer-with-Gradient-Centralization
  Advanced optimizer with Gradient-Centralization
  ☆21Updated 4 years ago
• lonePatient / EvoNorms_PyTorch
  Evolving Normalization-Activation Layers
  ☆19Updated 5 years ago
• dizam92 / pyTorchReg
  Applied Sparse regularization (L1), Weight decay regularization (L2), ElasticNet, GroupLasso and GroupSparseLasso to Neuronal Network.
  ☆38Updated 3 years ago
• gan3sh500 / revrnn
  Reversible Recurrent Neural Network Pytorch Implementation
  ☆21Updated 7 years ago
• WarBean / emp
  Easy Multiprocessing for Python
  ☆43Updated 4 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆61Updated last year
• egg-west / AdamW-pytorch
  Implementation and experiments for AdamW on Pytorch
  ☆94Updated 5 years ago
• ppwwyyxx / FRN-on-common-ImageNet-baseline
  Filter Response Normalization tested on better ImageNet baselines.
  ☆35Updated 5 years ago
• Irynei / SafeAugmentation
  ☆16Updated last month
• znxlwm / pytorch-apex-experiment
  Simple experiment of Apex (A PyTorch Extension)
  ☆47Updated 5 years ago
• gan3sh500 / octaveconv-pytorch
  Implementation of Octave Convolution from Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convol…
  ☆57Updated 6 years ago
• lonePatient / lookahead_pytorch
  pytorch implement of Lookahead Optimizer
  ☆192Updated 3 years ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆55Updated 2 years ago
• kfzyqin / Research-Softmax-with-Mutual-Information
  Full implementation of the paper "Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator".
  ☆102Updated 5 years ago
• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 5 years ago
• Kipok / understanding-momentum
  Code for the paper "Understanding the Role of Momentum in Stochastic Gradient Methods"
  ☆14Updated 5 years ago
• thomasbrandon / swish-torch
  Swish Activation - PyTorch CUDA Implementation
  ☆37Updated 5 years ago
• SHTUPLUS / ContextLab
  ContextLab: A Toolbox for Context Feature Augmentation developed with PyTorch
  ☆39Updated 5 years ago
• dot-delta / Meta-SGD
  Meta-SGD Algorithms Implementation
  ☆22Updated last year
• ispgroupucl / layer-rotation-tools
  Implementation of tools to control and monitor layer rotation in different DL libraries
  ☆40Updated 6 years ago
• xjtushujun / Meta-weight-net_class-imbalance
  NeurIPS'19: Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting (Pytorch implementation for class imbalance).
  ☆34Updated 5 years ago
• zhuhui123 / EENA
  ☆10Updated 6 years ago
• gbup-group / IEBN
  The official implementation of paper "Instance Enhancement Batch Normalization: an Adaptive Regulator of Batch Noise".
  ☆40Updated 2 years ago
• neilliang90 / Sadam
  ☆14Updated 5 years ago
• fabio-deep / ReZero-ResNet
  Unofficial pytorch implementation of ReZero in ResNet
  ☆23Updated 5 years ago
• ispgroupucl / layer-rotation-paper-experiments
  Code for reproducing results of the paper "Layer rotation: a surprisingly powerful indicator of generalization in deep networks?"
  ☆50Updated 6 years ago
• DequanWang / weightnet.pytorch
  WeightNet: Revisiting the Design Space of Weight Networks
  ☆19Updated 4 years ago
• ZhangLi-CS / GCP_Optimization
  ☆28Updated 5 years ago