Alternatives and similar repositories for large-batch-training:

Users that are interested in large-batch-training are comparing it to the libraries listed below

• eladhoffer / bigBatch
  Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training o…
  ☆149Updated 7 years ago
• rahulkidambi / AccSGD
  Implements pytorch code for the Accelerated SGD algorithm.
  ☆215Updated 7 years ago
• leonardblier / alrao
  Implementation of "Learning with Random Learning Rates" in PyTorch.
  ☆102Updated 5 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆74Updated 7 years ago
• alecwangcq / EigenDamage-Pytorch
  Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934
  ☆112Updated 5 years ago
• pluskid / fitting-random-labels
  Example code for the paper "Understanding deep learning requires rethinking generalization"
  ☆178Updated 4 years ago
• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆86Updated 4 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 4 years ago
• ucla-vision / entropy-sgd
  Lua implementation of Entropy-SGD
  ☆81Updated 7 years ago
• oval-group / dfw
  Implementation of the Deep Frank-Wolfe Algorithm -- Pytorch
  ☆62Updated 4 years ago
• modestyachts / CIFAR-10.1
  Release of CIFAR-10.1, a new test set for CIFAR-10.
  ☆222Updated 4 years ago
• wassname / viz_torch_optim
  Videos of deep learning optimizers moving on 3D problem-landscapes
  ☆108Updated 8 months ago
• lmzintgraf / DeepVis-PredDiff
  Visualizing Deep Neural Network Decisions: Prediction Difference Analysis
  ☆117Updated 7 years ago
• necludov / group-sparsity-sbp
  Structured Bayesian Pruning, NIPS 2017
  ☆73Updated 4 years ago
• ShiyuLiang / odin-pytorch
  Principled Detection of Out-of-Distribution Examples in Neural Networks
  ☆201Updated 7 years ago
• jotaf98 / curveball
  Second-order optimiser for deep networks
  ☆76Updated 6 years ago
• yulongwang12 / visual-attribution
  Pytorch Implementation of recent visual attribution methods for model interpretability
  ☆145Updated 5 years ago
• yaroslavvb / kfac_pytorch
  ☆133Updated 7 years ago
• YixuanLi / convergent_learning
  Code for paper "Convergent Learning: Do different neural networks learn the same representations?"
  ☆86Updated 8 years ago
• uber-research / loss-change-allocation
  ☆61Updated 2 years ago
• KarenUllrich / Tutorial_BayesianCompressionForDL
  A tutorial on "Bayesian Compression for Deep Learning" published at NIPS (2017).
  ☆206Updated 6 years ago
• BayesWatch / cinic-10
  A drop-in replacement for CIFAR-10.
  ☆240Updated 4 years ago
• goodfeli / forgetting
  Repository of code for the experiments for the ICLR submission "An Empirical Investigation of Catastrophic Forgetting in Gradient-Based N…
  ☆68Updated 11 years ago
• wiseodd / natural-gradients
  Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)
  ☆139Updated 5 years ago
• siddharth-agrawal / Generative-Moment-Matching-Networks
  ☆63Updated 8 years ago
• ducha-aiki / LSUVinit
  Reference caffe implementation of LSUV initialization
  ☆113Updated 7 years ago
• ashafaei / OD-test
  OD-test: A Less Biased Evaluation of Out-of-Distribution (Outlier) Detectors (PyTorch)
  ☆62Updated last year
• lanpa / tensorboard-pytorch-examples
  A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
  ☆83Updated 6 years ago
• lopezpaz / distillation_privileged_information
  Code for "Unifying distillation and privileged information" (ICLR 2016).
  ☆48Updated 9 years ago
• cybertronai / autograd-hacks
  ☆157Updated 2 years ago