Alternatives and similar repositories for ReZero-ResNet:

Users that are interested in ReZero-ResNet are comparing it to the libraries listed below

• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 5 years ago
• vinbhaskara / adams
  Exploiting Uncertainty of Loss Landscape for Stochastic Optimization
  ☆15Updated 5 years ago
• ppwwyyxx / FRN-on-common-ImageNet-baseline
  Filter Response Normalization tested on better ImageNet baselines.
  ☆35Updated 4 years ago
• ducha-aiki / LSUV-pytorch
  Simple implementation of the LSUV initialization in PyTorch
  ☆58Updated last year
• eladhoffer / norm_matters
  ☆23Updated 6 years ago
• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated last year
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆18Updated 4 years ago
• BayesWatch / deficient-efficient
  Successfully training approximations to full-rank matrices for efficiency in deep learning.
  ☆16Updated 4 years ago
• yk / PyTorch_CIFAR10
  Pretrained TorchVision models on CIFAR10 dataset (with weights)
  ☆24Updated 4 years ago
• znxlwm / pytorch-apex-experiment
  Simple experiment of Apex (A PyTorch Extension)
  ☆47Updated 5 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆74Updated 6 years ago
• thomasbrandon / swish-torch
  Swish Activation - PyTorch CUDA Implementation
  ☆37Updated 5 years ago
• JiJingYu / delta_orthogonal_init_pytorch
  Delta Orthogonal Initialization for PyTorch
  ☆18Updated 6 years ago
• ananyahjha93 / libself
  PyTorch Lightning based framework to run experiments for self-supervised learning tasks.
  ☆10Updated 5 years ago
• mahayat / SimCLR-2
  PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representations
  ☆16Updated 4 years ago
• sayakpaul / Training-BatchNorm-and-Only-BatchNorm
  Experiments with the ideas presented in https://arxiv.org/abs/2003.00152 by Frankle et al.
  ☆29Updated 4 years ago
• joe-siyuan-qiao / NeuralRejuvenation-CVPR19
  Neural Rejuvenation: Improving Deep Network Training by Enhancing Computational Resource Utilization at CVPR'19
  ☆48Updated 5 years ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆55Updated 2 years ago
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆28Updated 4 years ago
• NVlabs / iccv2019-mixed-precision-tutorial
  ☆28Updated 4 years ago
• AlexiaJM / GANsBeyondDivergenceMin
  Code for replication of the paper "GANs beyond divergence minimization"
  ☆21Updated 6 years ago
• sebastiani / pytorch-attention-augmented-convolution
  A pytorch implementation of https://arxiv.org/abs/1904.09925
  ☆16Updated 5 years ago
• BayesWatch / pytorch-blockswap
  Code for BlockSwap (ICLR 2020).
  ☆33Updated 3 years ago
• ShangyuanTong / PairGAN
  ☆21Updated 5 years ago
• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆86Updated 4 years ago
• ispgroupucl / layer-rotation-tools
  Implementation of tools to control and monitor layer rotation in different DL libraries
  ☆40Updated 5 years ago
• cogsys-tuebingen / PAL
  Reference implementation of the PAL optimizer
  ☆20Updated 4 years ago
• vacancy / AdvancedIndexing-PyTorch
  (Batched) advanced indexing for PyTorch.
  ☆53Updated 2 months ago
• izmailovpavel / torch_swa_examples
  ☆47Updated 4 years ago
• kumar-shridhar / ProbAct-Probabilistic-Activation-Function
  Official PyTorch implementation of the paper : ProbAct: A Probabilistic Activation Function for Deep Neural Networks.
  ☆13Updated 5 years ago