Alternatives and similar repositories for AdaBatch

Users that are interested in AdaBatch are comparing it to the libraries listed below

• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆87Updated 4 years ago
• BayesWatch / deficient-efficient
  Successfully training approximations to full-rank matrices for efficiency in deep learning.
  ☆17Updated 4 years ago
• BayesWatch / pytorch-blockswap
  Code for BlockSwap (ICLR 2020).
  ☆33Updated 4 years ago
• stevenygd / SWALP
  Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".
  ☆62Updated 6 years ago
• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated 2 years ago
• evcu / pytorchpruner
  ☆22Updated 7 years ago
• eladhoffer / norm_matters
  ☆23Updated 6 years ago
• liamcli / darts_asha
  Code release to reproduce ASHA experiments from "Random Search and Reproducibility for NAS."
  ☆22Updated 5 years ago
• eladhoffer / fix_your_classifier
  ☆34Updated 6 years ago
• ducha-aiki / LSUV-pytorch
  Simple implementation of the LSUV initialization in PyTorch
  ☆58Updated last year
• JiJingYu / delta_orthogonal_init_pytorch
  Delta Orthogonal Initialization for PyTorch
  ☆18Updated 7 years ago
• lottery-ticket / rewinding-iclr20-public
  ☆70Updated 5 years ago
• houlu369 / Loss-aware-weight-quantization
  Implementation of ICLR 2018 paper "Loss-aware Weight Quantization of Deep Networks"
  ☆26Updated 5 years ago
• eBay / AutoOpt
  Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent
  ☆46Updated 5 years ago
• kcyu2014 / multi-model-forgetting
  ICML2019 Accepted Paper. Overcoming Multi-Model Forgetting
  ☆14Updated 6 years ago
• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 5 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆61Updated last year
• biswajitsc / sparse-embed
  Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020
  ☆20Updated 5 years ago
• wenwei202 / autogrow
  AutoGrow: Automatic Layer Growing in Deep Convolutional Networks (KDD 2020)
  ☆40Updated 6 years ago
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆29Updated 5 years ago
• arberzela / EfficientNAS
  Towards Automated Deep Learning: Efficient Joint Neural Architecture and Hyperparameter Search https://arxiv.org/abs/1807.06906
  ☆49Updated 5 years ago
• znxlwm / pytorch-apex-experiment
  Simple experiment of Apex (A PyTorch Extension)
  ☆47Updated 5 years ago
• ChristopherSweeney / SlimNets
  Various implementations and experimentation for deep neural network model compression
  ☆24Updated 6 years ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 5 years ago
• BayesWatch / pytorch-moonshine
  Cheap distillation for convolutional neural networks.
  ☆33Updated 6 years ago
• lolemacs / soft-sharing
  Implementation of soft parameter sharing for neural networks
  ☆69Updated 4 years ago
• fabio-deep / ReZero-ResNet
  Unofficial pytorch implementation of ReZero in ResNet
  ☆24Updated 5 years ago
• gan3sh500 / octaveconv-pytorch
  Implementation of Octave Convolution from Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convol…
  ☆57Updated 6 years ago
• RUSH-LAB / LSH_Memory
  One-Shot Learning using Nearest-Neighbor Search (NNS) and Locality-Sensitive Hashing LSH
  ☆74Updated 7 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆77Updated 7 years ago