Alternatives and similar repositories for SRSGD

Users that are interested in SRSGD are comparing it to the libraries listed below

• ColinQiyangLi / LConvNet
  Implementation of Methods Proposed in Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networks (NeurIPS 2019)
  ☆35Updated 5 years ago
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆46Updated 5 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 5 years ago
• hongyanz / TRADES-smoothing
  [JMLR] TRADES + random smoothing for certifiable robustness
  ☆14Updated 5 years ago
• JiJingYu / delta_orthogonal_init_pytorch
  Delta Orthogonal Initialization for PyTorch
  ☆18Updated 7 years ago
• preetum / cifar5m
  CIFAR-5m dataset
  ☆39Updated 4 years ago
• ssnl / PyTorch-Reparam-Module
  Reparameterize your PyTorch modules
  ☆71Updated 4 years ago
• SebFar / radial_bnn
  Code to accompany the paper Radial Bayesian Neural Networks: Beyond Discrete Support In Large-Scale Bayesian Deep Learning
  ☆33Updated 5 years ago
• briancheung / superposition
  ☆45Updated 5 years ago
• asteroidhouse / self-tuning-networks
  Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088
  ☆54Updated 6 years ago
• yaohungt / Adaptive-Regularization-Neural-Network
  [NeurIPS'19] [PyTorch] Adaptive Regularization in NN
  ☆68Updated 6 years ago
• 962086838 / code-for-Asymmetric-Valley
  This repo contains the code used for NeurIPS 2019 paper "Asymmetric Valleys: Beyond Sharp and Flat Local Minima".
  ☆14Updated 6 years ago
• cc-hpc-itwm / GradVis
  ☆39Updated 5 years ago
• fmi-basel / neural-tangent-transfer
  Code accompanying our paper "Finding trainable sparse networks through Neural Tangent Transfer" to be published at ICML-2020.
  ☆13Updated 5 years ago
• minyoungg / overparam
  ☆41Updated 2 years ago
• mpezeshki / Gradient_Starvation
  Gradient Starvation: A Learning Proclivity in Neural Networks
  ☆61Updated 4 years ago
• ucla-vision / information-dropout
  Implementation of Information Dropout
  ☆39Updated 8 years ago
• cunningham-lab / igr
  ☆30Updated 5 years ago
• k9k2 / qSGD
  SGD and Ordered SGD codes for deep learning, SVM, and logistic regression
  ☆36Updated 5 years ago
• lin-shuyu / ladder-latent-data-distribution-modelling
  In this paper, we show that the performance of a learnt generative model is closely related to the model's ability to accurately represen…
  ☆41Updated 4 years ago
• uclaml / Padam
  Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …
  ☆39Updated 2 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆48Updated 7 months ago
• ermongroup / f-wgan
  Code for "Bridging the Gap between f-GANs and Wasserstein GANs", ICML 2020
  ☆14Updated 5 years ago
• huangleiBuaa / ONI
  PyTorch and Torch implementation for our accepted CVPR 2020 paper (Oral): Controllable Orthogonalization in Training DNNs
  ☆25Updated 4 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆77Updated 7 years ago
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆19Updated 5 years ago
• zj10 / PGA
  A TensorFlow implementation of perceptual generative autoencoder (PGA).
  ☆23Updated 4 years ago
• facebookresearch / GAN-optimization-landscape
  code to reproduce the empirical results in the research paper
  ☆36Updated 4 years ago
• klightz / Firefly
  Offical Repo for Firefly Neural Architecture Descent: a General Approach for Growing Neural Networks. Accepted by Neurips 2020.
  ☆34Updated 5 years ago
• mingzhang-yin / ARM-gradient
  Low-variance, efficient and unbiased gradient estimation for optimizing models with binary latent variables. (ICLR 2019)
  ☆27Updated 6 years ago