Alternatives and similar repositories for ReZero-ResNet

Users that are interested in ReZero-ResNet are comparing it to the libraries listed below

• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 5 years ago
• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated 2 years ago
• BayesWatch / pytorch-blockswap
  Code for BlockSwap (ICLR 2020).
  ☆33Updated 4 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆77Updated 7 years ago
• vinbhaskara / adams
  Exploiting Uncertainty of Loss Landscape for Stochastic Optimization
  ☆15Updated 6 years ago
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆19Updated 5 years ago
• ducha-aiki / LSUV-pytorch
  Simple implementation of the LSUV initialization in PyTorch
  ☆58Updated last year
• vacancy / AdvancedIndexing-PyTorch
  (Batched) advanced indexing for PyTorch.
  ☆53Updated 8 months ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆55Updated 2 years ago
• eladhoffer / norm_matters
  ☆23Updated 6 years ago
• Randl / kmeans_selfsuper
  ☆54Updated 3 years ago
• Healbadbad / curveball-pytorch
  An Implementation of "Small steps and giant leaps: Minimal Newton solvers for Deep Learning" In pytorch
  ☆21Updated 7 years ago
• ppwwyyxx / FRN-on-common-ImageNet-baseline
  Filter Response Normalization tested on better ImageNet baselines.
  ☆35Updated 5 years ago
• NVlabs / iccv2019-mixed-precision-tutorial
  ☆28Updated 5 years ago
• xternalz / SDPoint
  Stochastic Downsampling for Cost-Adjustable Inference and Improved Regularization in Convolutional Networks
  ☆18Updated 5 years ago
• lnsmith54 / BOSS
  This repository provides the code for replicating the experiments in the paper "Building One-Shot Semi-supervised (BOSS) Learning up to F…
  ☆36Updated 5 years ago
• human-analysis / pytorchnet
  Generalized Framework for PyTorch
  ☆32Updated 3 years ago
• thomasbrandon / swish-torch
  Swish Activation - PyTorch CUDA Implementation
  ☆37Updated 5 years ago
• MerHS / SASA-pytorch
  Unofficial implementation of Stand-Alone Self-Attention in Vision Models (obsolete)
  ☆44Updated 6 years ago
• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• znxlwm / pytorch-apex-experiment
  Simple experiment of Apex (A PyTorch Extension)
  ☆47Updated 6 years ago
• sebastiani / pytorch-attention-augmented-convolution
  A pytorch implementation of https://arxiv.org/abs/1904.09925
  ☆16Updated 6 years ago
• shellysheynin / Locally-SAG-Transformer
  Official Pytorch implementation of the paper: "Locally Shifted Attention With Early Global Integration"
  ☆15Updated 3 years ago
• sayakpaul / Adaptive-Gradient-Clipping
  Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.
  ☆85Updated 4 years ago
• odegeasslbc / pytorch-IBGAN
  A pytorch implementation of Information Bottleneck GAN
  ☆28Updated 6 years ago
• ChristopherSweeney / SlimNets
  Various implementations and experimentation for deep neural network model compression
  ☆24Updated 7 years ago
• joe-siyuan-qiao / NeuralRejuvenation-CVPR19
  Neural Rejuvenation: Improving Deep Network Training by Enhancing Computational Resource Utilization at CVPR'19
  ☆48Updated 6 years ago
• doerlbh / UnsupervisedAttentionMechanism
  Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".
  ☆21Updated 3 years ago
• knjcode / filter-response-normalization-layer-pytorch
  Unofficial PyTorch implementation of "Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Ne…
  ☆22Updated 5 years ago
• google-research / noisy-fewshot-learning
  ☆23Updated 4 years ago