Alternatives and similar repositories for large-batch-training

Users that are interested in large-batch-training are comparing it to the libraries listed below

• eladhoffer / bigBatch
  Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training o…
  ☆149Updated 8 years ago
• rahulkidambi / AccSGD
  Implements pytorch code for the Accelerated SGD algorithm.
  ☆215Updated 7 years ago
• leonardblier / alrao
  Implementation of "Learning with Random Learning Rates" in PyTorch.
  ☆102Updated 6 years ago
• pluskid / fitting-random-labels
  Example code for the paper "Understanding deep learning requires rethinking generalization"
  ☆178Updated 5 years ago
• loshchil / SGDR
  ☆253Updated 9 years ago
• lmzintgraf / DeepVis-PredDiff
  Visualizing Deep Neural Network Decisions: Prediction Difference Analysis
  ☆121Updated 8 years ago
• alecwangcq / EigenDamage-Pytorch
  Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934
  ☆113Updated 5 years ago
• KarenUllrich / Tutorial_BayesianCompressionForDL
  A tutorial on "Bayesian Compression for Deep Learning" published at NIPS (2017).
  ☆206Updated 7 years ago
• YixuanLi / convergent_learning
  Code for paper "Convergent Learning: Do different neural networks learn the same representations?"
  ☆86Updated 9 years ago
• gaohuang / SnapshotEnsemble
  Snapshot Ensembles in Torch (Snapshot Ensembles: Train 1, Get M for Free)
  ☆188Updated 8 years ago
• negrinho / deep_architect_legacy
  DeepArchitect: Automatically Designing and Training Deep Architectures
  ☆145Updated 6 years ago
• vsyrgkanis / optimistic_GAN_training
  ☆46Updated 7 years ago
• ucla-vision / entropy-sgd
  Lua implementation of Entropy-SGD
  ☆81Updated 7 years ago
• uber-research / intrinsic-dimension
  ☆219Updated 7 years ago
• jotaf98 / curveball
  Second-order optimiser for deep networks
  ☆76Updated 7 years ago
• han-cai / EAS
  Efficient Architecture Search by Network Transformation, in AAAI 2018
  ☆168Updated 6 years ago
• yaroslavvb / kfac_pytorch
  ☆135Updated 8 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆78Updated 7 years ago
• necludov / group-sparsity-sbp
  Structured Bayesian Pruning, NIPS 2017
  ☆74Updated 5 years ago
• kimhc6028 / pathnet-pytorch
  PyTorch implementation of PathNet: Evolution Channels Gradient Descent in Super Neural Networks
  ☆81Updated 8 years ago
• ducha-aiki / LSUV-pytorch
  Simple implementation of the LSUV initialization in PyTorch
  ☆58Updated 2 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 5 years ago
• lballes / msvag
  TensorFlow implementation of (Momentum) Stochastic Variance-Adapted Gradient.
  ☆44Updated 7 years ago
• lnsmith54 / super-convergence
  Files to create the figures in the paper "Super-Convergence: Very Fast Training of Residual Networks Using Large Learning Rates"
  ☆191Updated 8 years ago
• KarenUllrich / Tutorial-SoftWeightSharingForNNCompression
  A tutorial on 'Soft weight-sharing for Neural Network compression' published at ICLR2017
  ☆147Updated 8 years ago
• xgastaldi / shake-shake
  2.86% and 15.85% on CIFAR-10 and CIFAR-100
  ☆297Updated 7 years ago
• jcjohnson / tiny-imagenet
  ☆38Updated 10 years ago
• wassname / viz_torch_optim
  Videos of deep learning optimizers moving on 3D problem-landscapes
  ☆107Updated last year
• tfrerix / proxprop
  Proximal Backpropagation - a neural network training algorithm that takes implicit instead of explicit gradient steps
  ☆42Updated 6 years ago
• bayesgroup / variational-dropout-sparsifies-dnn
  Sparse Variational Dropout, ICML 2017
  ☆313Updated 5 years ago