Alternatives and similar repositories for AdaBatch

Users that are interested in AdaBatch are comparing it to the libraries listed below

• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆87Updated 4 years ago
• BayesWatch / deficient-efficient
  Successfully training approximations to full-rank matrices for efficiency in deep learning.
  ☆17Updated 4 years ago
• liamcli / darts_asha
  Code release to reproduce ASHA experiments from "Random Search and Reproducibility for NAS."
  ☆22Updated 6 years ago
• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 6 years ago
• BayesWatch / pytorch-blockswap
  Code for BlockSwap (ICLR 2020).
  ☆33Updated 4 years ago
• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated 2 years ago
• JiJingYu / delta_orthogonal_init_pytorch
  Delta Orthogonal Initialization for PyTorch
  ☆18Updated 7 years ago
• evcu / pytorchpruner
  ☆22Updated 7 years ago
• eladhoffer / norm_matters
  ☆23Updated 7 years ago
• wenwei202 / autogrow
  AutoGrow: Automatic Layer Growing in Deep Convolutional Networks (KDD 2020)
  ☆40Updated 6 years ago
• fabio-deep / ReZero-ResNet
  Unofficial pytorch implementation of ReZero in ResNet
  ☆24Updated 5 years ago
• stevenygd / SWALP
  Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".
  ☆62Updated 6 years ago
• znxlwm / pytorch-apex-experiment
  Simple experiment of Apex (A PyTorch Extension)
  ☆47Updated 6 years ago
• BayesWatch / pytorch-moonshine
  Cheap distillation for convolutional neural networks.
  ☆35Updated 7 years ago
• gan3sh500 / octaveconv-pytorch
  Implementation of Octave Convolution from Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convol…
  ☆57Updated 6 years ago
• angelajiang / SelectiveBackprop
  SelectiveBackprop accelerates training by dynamically prioritizing useful examples with high loss
  ☆32Updated 5 years ago
• kcyu2014 / multi-model-forgetting
  ICML2019 Accepted Paper. Overcoming Multi-Model Forgetting
  ☆14Updated 6 years ago
• ducha-aiki / LSUV-pytorch
  Simple implementation of the LSUV initialization in PyTorch
  ☆58Updated last year
• csyhhu / Co-Prune
  Codes for accepted paper "Cooperative Pruning in Cross-Domain Deep Neural Network Compression" in IJCAI 2019.
  ☆12Updated 6 years ago
• alondj / Pytorch-Gpipe
  ☆26Updated 6 years ago
• lolemacs / soft-sharing
  Implementation of soft parameter sharing for neural networks
  ☆70Updated 4 years ago
• csyhhu / L-DNQ
  Codes for AAAI2019 paper: Deep Neural Network Quantization via Layer-Wise Optimization using Limited Training Data
  ☆41Updated 6 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆78Updated 7 years ago
• NVlabs / unas
  Official implementation of "UNAS: Differentiable Architecture Search Meets Reinforcement Learning", CVPR 2020 Oral
  ☆62Updated 2 years ago
• xternalz / SDPoint
  Stochastic Downsampling for Cost-Adjustable Inference and Improved Regularization in Convolutional Networks
  ☆18Updated 6 years ago
• vinbhaskara / AdamS
  PyTorch Code for the Paper: "Exploiting Uncertainty of Loss Landscape for Stochastic Optimization [Bhaskara et al. (2019)]
  ☆15Updated this week
• eladhoffer / fix_your_classifier
  ☆34Updated 7 years ago
• ChristopherSweeney / SlimNets
  Various implementations and experimentation for deep neural network model compression
  ☆24Updated 7 years ago
• kcyu2014 / eval-nas
  PyTorch Code for "Evaluating the search phase of Neural Architecture Search" @ ICLR 2020
  ☆49Updated 5 years ago
• lottery-ticket / rewinding-iclr20-public
  ☆69Updated 5 years ago