Alternatives and similar repositories for AdaX

Users that are interested in AdaX are comparing it to the libraries listed below

• lonePatient / EvoNorms_PyTorch
  Evolving Normalization-Activation Layers
  ☆19Updated 5 years ago
• WarBean / emp
  Easy Multiprocessing for Python
  ☆43Updated 5 years ago
• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated 2 years ago
• xjtushujun / Meta-weight-net_class-imbalance
  NeurIPS'19: Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting (Pytorch implementation for class imbalance).
  ☆34Updated 6 years ago
• dizam92 / pyTorchReg
  Applied Sparse regularization (L1), Weight decay regularization (L2), ElasticNet, GroupLasso and GroupSparseLasso to Neuronal Network.
  ☆38Updated 3 years ago
• Yonghongwei / Advanced-optimizer-with-Gradient-Centralization
  Advanced optimizer with Gradient-Centralization
  ☆21Updated 5 years ago
• SHTUPLUS / ContextLab
  ContextLab: A Toolbox for Context Feature Augmentation developed with PyTorch
  ☆39Updated 6 years ago
• gan3sh500 / revrnn
  Reversible Recurrent Neural Network Pytorch Implementation
  ☆21Updated 7 years ago
• Kipok / understanding-momentum
  Code for the paper "Understanding the Role of Momentum in Stochastic Gradient Methods"
  ☆14Updated 6 years ago
• CyberZHG / keras-octave-conv
  Octave convolution
  ☆34Updated 3 years ago
• dot-delta / Meta-SGD
  Meta-SGD Algorithms Implementation
  ☆22Updated last year
• kfzyqin / Research-Softmax-with-Mutual-Information
  Full implementation of the paper "Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator".
  ☆101Updated 5 years ago
• zhuhui123 / EENA
  ☆10Updated 6 years ago
• lonePatient / lookahead_pytorch
  pytorch implement of Lookahead Optimizer
  ☆195Updated 3 years ago
• Mrpatekful / swats
  Unofficial implementation of Switching from Adam to SGD optimization in PyTorch.
  ☆68Updated 2 years ago
• rmlin / CoMHE
  Implementation for <Regularizing Neural Networks via Minimizing Hyperspherical Energy> in CVPR'20.
  ☆24Updated 5 years ago
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆46Updated 5 years ago
• asvcode / 1_cycle
  A disciplined approach to neural network parameters - Reviewing the approach for setting Hyper parameters by Leslie Smith
  ☆12Updated 7 years ago
• egg-west / AdamW-pytorch
  Implementation and experiments for AdamW on Pytorch
  ☆94Updated 5 years ago
• minicheshire / InResNet
  Interpolation between Residual and Non-Residual Networks, ICML 2020. https://arxiv.org/abs/2006.05749
  ☆26Updated 5 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated last year
• keivanalizadeh / ButterflyTransform
  ☆41Updated 4 years ago
• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• RahulBhalley / gan-qp.pytorch
  Unofficial PyTorch implementation of "GAN-QP: A Novel GAN Framework without Gradient Vanishing and Lipschitz Constraint"
  ☆31Updated 6 years ago
• moskomule / ssl-suite
  SSL using PyTorch
  ☆49Updated 5 years ago
• ispgroupucl / layer-rotation-tools
  Implementation of tools to control and monitor layer rotation in different DL libraries
  ☆40Updated 6 years ago
• ppwwyyxx / FRN-on-common-ImageNet-baseline
  Filter Response Normalization tested on better ImageNet baselines.
  ☆35Updated 5 years ago
• Irynei / SafeAugmentation
  ☆16Updated 5 months ago
• thomasbrandon / swish-torch
  Swish Activation - PyTorch CUDA Implementation
  ☆37Updated 6 years ago
• wenwei202 / autogrow
  AutoGrow: Automatic Layer Growing in Deep Convolutional Networks (KDD 2020)
  ☆40Updated 6 years ago