Alternatives and similar repositories for AdaX

Users that are interested in AdaX are comparing it to the libraries listed below

• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated 2 years ago
• Kipok / understanding-momentum
  Code for the paper "Understanding the Role of Momentum in Stochastic Gradient Methods"
  ☆14Updated 6 years ago
• Yonghongwei / Advanced-optimizer-with-Gradient-Centralization
  Advanced optimizer with Gradient-Centralization
  ☆21Updated 5 years ago
• WarBean / emp
  Easy Multiprocessing for Python
  ☆42Updated 5 years ago
• kfzyqin / Research-Softmax-with-Mutual-Information
  Full implementation of the paper "Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator".
  ☆101Updated 5 years ago
• RahulBhalley / gan-qp.pytorch
  Unofficial PyTorch implementation of "GAN-QP: A Novel GAN Framework without Gradient Vanishing and Lipschitz Constraint"
  ☆31Updated 6 years ago
• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 6 years ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆54Updated 3 years ago
• lonePatient / EvoNorms_PyTorch
  Evolving Normalization-Activation Layers
  ☆19Updated 5 years ago
• xjtushujun / Meta-weight-net_class-imbalance
  NeurIPS'19: Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting (Pytorch implementation for class imbalance).
  ☆34Updated 6 years ago
• SHTUPLUS / ContextLab
  ContextLab: A Toolbox for Context Feature Augmentation developed with PyTorch
  ☆39Updated 6 years ago
• lonePatient / lookahead_pytorch
  pytorch implement of Lookahead Optimizer
  ☆195Updated 3 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated last year
• thomasbrandon / swish-torch
  Swish Activation - PyTorch CUDA Implementation
  ☆37Updated 6 years ago
• gan3sh500 / revrnn
  Reversible Recurrent Neural Network Pytorch Implementation
  ☆21Updated 8 years ago
• dot-delta / Meta-SGD
  Meta-SGD Algorithms Implementation
  ☆22Updated last year
• zhuhui123 / EENA
  ☆10Updated 6 years ago
• brianlan / complex-grad-norm
  a much more complex case using GradNorm, where the layer sharing situation is sophisticated.
  ☆15Updated 6 years ago
• moskomule / ssl-suite
  SSL using PyTorch
  ☆49Updated 5 years ago
• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• dizam92 / pyTorchReg
  Applied Sparse regularization (L1), Weight decay regularization (L2), ElasticNet, GroupLasso and GroupSparseLasso to Neuronal Network.
  ☆38Updated 3 years ago
• egg-west / AdamW-pytorch
  Implementation and experiments for AdamW on Pytorch
  ☆94Updated 6 years ago
• keivanalizadeh / ButterflyTransform
  ☆41Updated 4 years ago
• CyberZHG / keras-octave-conv
  Octave convolution
  ☆34Updated 3 years ago
• gan3sh500 / octaveconv-pytorch
  Implementation of Octave Convolution from Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convol…
  ☆57Updated 6 years ago
• gbup-group / IEBN
  The official implementation of paper "Instance Enhancement Batch Normalization: an Adaptive Regulator of Batch Noise".
  ☆41Updated 2 years ago
• taki0112 / RAdam-Tensorflow
  Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"
  ☆97Updated 5 years ago
• lessw2020 / mish
  Mish Deep Learning Activation Function for PyTorch / FastAI
  ☆161Updated 5 years ago
• katsura-jp / efficientnet-pytorch
  PyTorch implementation of "EfficientNet", ICML 2019
  ☆45Updated 6 years ago
• ofsoundof / learning_filter_basis
  Pytorch implemenation of "Learning Filter Basis for Convolutional Neural Network Compression" ICCV2019
  ☆18Updated 3 years ago