Alternatives and similar repositories for AdaX

Users that are interested in AdaX are comparing it to the libraries listed below

• lonePatient / EvoNorms_PyTorch
  Evolving Normalization-Activation Layers
  ☆19Updated 5 years ago
• gan3sh500 / revrnn
  Reversible Recurrent Neural Network Pytorch Implementation
  ☆21Updated 8 years ago
• dizam92 / pyTorchReg
  Applied Sparse regularization (L1), Weight decay regularization (L2), ElasticNet, GroupLasso and GroupSparseLasso to Neuronal Network.
  ☆38Updated 3 years ago
• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated 2 years ago
• Yonghongwei / Advanced-optimizer-with-Gradient-Centralization
  Advanced optimizer with Gradient-Centralization
  ☆21Updated 5 years ago
• xjtushujun / Meta-weight-net_class-imbalance
  NeurIPS'19: Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting (Pytorch implementation for class imbalance).
  ☆34Updated 6 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated last year
• dot-delta / Meta-SGD
  Meta-SGD Algorithms Implementation
  ☆22Updated last year
• WarBean / emp
  Easy Multiprocessing for Python
  ☆42Updated 5 years ago
• SHTUPLUS / ContextLab
  ContextLab: A Toolbox for Context Feature Augmentation developed with PyTorch
  ☆39Updated 6 years ago
• kfzyqin / Research-Softmax-with-Mutual-Information
  Full implementation of the paper "Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator".
  ☆101Updated 5 years ago
• RahulBhalley / gan-qp.pytorch
  Unofficial PyTorch implementation of "GAN-QP: A Novel GAN Framework without Gradient Vanishing and Lipschitz Constraint"
  ☆31Updated 6 years ago
• Kipok / understanding-momentum
  Code for the paper "Understanding the Role of Momentum in Stochastic Gradient Methods"
  ☆14Updated 6 years ago
• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 6 years ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆55Updated 3 years ago
• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• keivanalizadeh / ButterflyTransform
  ☆41Updated 4 years ago
• fawazsammani / mogrifier-lstm-pytorch
  Implementation of Mogrifier LSTM in PyTorch
  ☆34Updated 5 years ago
• yanxp / ASM-Pytorch
  Cost-Effective Object Detection: Active Sample Mining with Switchable Selection Criteria
  ☆12Updated 7 years ago
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆46Updated 5 years ago
• ppwwyyxx / FRN-on-common-ImageNet-baseline
  Filter Response Normalization tested on better ImageNet baselines.
  ☆35Updated 5 years ago
• doerlbh / UnsupervisedAttentionMechanism
  Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".
  ☆20Updated 4 years ago
• Irynei / SafeAugmentation
  ☆16Updated 6 months ago
• ChristopherSweeney / SlimNets
  Various implementations and experimentation for deep neural network model compression
  ☆24Updated 7 years ago
• CyberZHG / keras-octave-conv
  Octave convolution
  ☆34Updated 3 years ago
• ZhangLi-CS / GCP_Optimization
  ☆29Updated 5 years ago
• Zhaoxiangyun / Multi-Task-Modulation-Module
  Code release for paper "A Modulation Module for Multi-task Learning with Applications in Image Retrieval"
  ☆32Updated 7 years ago
• wy1iu / NSL
  Implementation for <Neural Similarity Learning> in NeurIPS'19.
  ☆33Updated 5 years ago
• HuangxingLin123 / Learning-Rate-Dropout
  Pytorch implementation of Learning Rate Dropout.
  ☆42Updated 6 years ago
• asvcode / 1_cycle
  A disciplined approach to neural network parameters - Reviewing the approach for setting Hyper parameters by Leslie Smith
  ☆12Updated 7 years ago