Alternatives and similar repositories for delta_orthogonal_init_pytorch

Users that are interested in delta_orthogonal_init_pytorch are comparing it to the libraries listed below

• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆29Updated 5 years ago
• alecwangcq / EigenDamage-Pytorch
  Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934
  ☆113Updated 5 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 5 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆77Updated 7 years ago
• alinlab / lookahead_pruning
  Lookahead: A Far-sighted Alternative of Magnitude-based Pruning (ICLR 2020)
  ☆33Updated 4 years ago
• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆87Updated 4 years ago
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆46Updated 5 years ago
• cc-hpc-itwm / GradVis
  ☆39Updated 5 years ago
• hongyi-zhang / Fixup
  A Re-implementation of Fixed-update Initialization
  ☆155Updated 6 years ago
• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated 2 years ago
• eladhoffer / norm_matters
  ☆23Updated 6 years ago
• hongyanz / TRADES-smoothing
  [JMLR] TRADES + random smoothing for certifiable robustness
  ☆14Updated 5 years ago
• vcl-iisc / ZSKD
  Zero-Shot Knowledge Distillation in Deep Networks
  ☆67Updated 3 years ago
• eladhoffer / fix_your_classifier
  ☆34Updated 6 years ago
• asteroidhouse / self-tuning-networks
  Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088
  ☆54Updated 6 years ago
• huangleiBuaa / OthogonalWN
  This project is the Torch implementation of our accepted AAAI 2018 paper : orthogonal weight normalization method for solving orthogonali…
  ☆57Updated 5 years ago
• VITA-Group / Orthogonality-in-CNNs
  [NeurIPS '18] "Can We Gain More from Orthogonality Regularizations in Training Deep CNNs?" Official Implementation.
  ☆129Updated 3 years ago
• uber-research / loss-change-allocation
  ☆61Updated 2 years ago
• mpezeshki / Gradient_Starvation
  Gradient Starvation: A Learning Proclivity in Neural Networks
  ☆61Updated 4 years ago
• BayesWatch / pytorch-moonshine
  Cheap distillation for convolutional neural networks.
  ☆33Updated 6 years ago
• varungohil / Generalizing-Lottery-Tickets
  This repository contains code to replicate the experiments given in NeurIPS 2019 paper "One ticket to win them all: generalizing lottery …
  ☆51Updated last year
• tbung / pytorch-revnet
  Implementation of the reversible residual network in pytorch
  ☆105Updated 3 years ago
• stevenygd / SWALP
  Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".
  ☆62Updated 6 years ago
• oval-group / dfw
  Implementation of the Deep Frank-Wolfe Algorithm -- Pytorch
  ☆62Updated 4 years ago
• ColinQiyangLi / LConvNet
  Implementation of Methods Proposed in Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networks (NeurIPS 2019)
  ☆35Updated 5 years ago
• ducha-aiki / LSUV-pytorch
  Simple implementation of the LSUV initialization in PyTorch
  ☆58Updated last year
• moskomule / cca.pytorch
  CCAs for looking into DNNs
  ☆70Updated 5 years ago
• izmailovpavel / torch_swa_examples
  ☆47Updated 4 years ago
• BayesWatch / pytorch-blockswap
  Code for BlockSwap (ICLR 2020).
  ☆33Updated 4 years ago
• j-min / Dropouts
  PyTorch Implementations of Dropout Variants
  ☆87Updated 7 years ago