JingzhaoZhang / why-clipping-accelerates

Related projects ⓘ

Alternatives and complementary repositories for why-clipping-accelerates

• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆82Updated 4 years ago
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆28Updated 4 years ago
• christopher-beckham / amr
  Official adversarial mixup resynthesis repository
  ☆35Updated 4 years ago
• mingzhang-yin / ARM-gradient
  Low-variance, efficient and unbiased gradient estimation for optimizing models with binary latent variables. (ICLR 2019)
  ☆28Updated 5 years ago
• ColinQiyangLi / LConvNet
  Implementation of Methods Proposed in Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networks (NeurIPS 2019)
  ☆33Updated 4 years ago
• bamos / HowToTrainYourMAMLPytorch
  The original code for the paper "How to train your MAML" along with a replication of the original "Model Agnostic Meta Learning" (MAML) p…
  ☆40Updated 4 years ago
• mpezeshki / Gradient_Starvation
  Gradient Starvation: A Learning Proclivity in Neural Networks
  ☆60Updated 3 years ago
• asteroidhouse / self-tuning-networks
  Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088
  ☆53Updated 5 years ago
• k9k2 / qSGD
  SGD and Ordered SGD codes for deep learning, SVM, and logistic regression
  ☆34Updated 4 years ago
• j-min / Dropouts
  PyTorch Implementations of Dropout Variants
  ☆87Updated 6 years ago
• JiJingYu / delta_orthogonal_init_pytorch
  Delta Orthogonal Initialization for PyTorch
  ☆18Updated 6 years ago
• yaohungt / Adaptive-Regularization-Neural-Network
  [NeurIPS'19] [PyTorch] Adaptive Regularization in NN
  ☆67Updated 5 years ago
• shwinshaker / LipGrow
  An adaptive training algorithm for residual network
  ☆14Updated 4 years ago
• erogol / Net2Net
  Net2Net implementation on PyTorch for any possible vision layers.
  ☆38Updated 7 years ago
• moskomule / anatome
  Ἀνατομή is a PyTorch library to analyze representation of neural networks
  ☆62Updated 11 months ago
• chingyaoc / estimating-generalization
  ICML 2020, Estimating Generalization under Distribution Shifts via Domain-Invariant Representations
  ☆21Updated 4 years ago
• pclucas14 / adaptive-quantization-modules
  Code for "Online Learned Continual Compression with Adaptive Quantization Modules"
  ☆27Updated 3 years ago
• revbucket / geometric-certificates
  Geometric Certifications of Neural Nets
  ☆41Updated last year
• ermongroup / f-wgan
  Code for "Bridging the Gap between f-GANs and Wasserstein GANs", ICML 2020
  ☆14Updated 4 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆45Updated 4 years ago
• yaohungt / Pointwise_Dependency_Neural_Estimation
  ☆19Updated 4 years ago
• denisyarats / densenet_cifar10
  Meta-learning learning rates with higher
  ☆12Updated 5 years ago
• hongyanz / TRADES-smoothing
  [JMLR] TRADES + random smoothing for certifiable robustness
  ☆14Updated 4 years ago
• rehg-lab / CLRec
  Pytorch implementation for "The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstruction"
  ☆33Updated 2 years ago
• google-research / understanding-transfer-learning
  ☆42Updated 4 years ago
• ucla-vision / information-dropout
  Implementation of Information Dropout
  ☆39Updated 7 years ago
• SebFar / radial_bnn
  Code to accompany the paper Radial Bayesian Neural Networks: Beyond Discrete Support In Large-Scale Bayesian Deep Learning
  ☆33Updated 4 years ago
• briancheung / superposition
  ☆45Updated 5 years ago
• 962086838 / code-for-Asymmetric-Valley
  This repo contains the code used for NeurIPS 2019 paper "Asymmetric Valleys: Beyond Sharp and Flat Local Minima".
  ☆14Updated 5 years ago
• zhangjiong724 / spectral-RNN
  STABILIZING GRADIENTS FOR DEEP NEURAL NETWORKS VIA EFFICIENT SVD PARAMETERIZATION
  ☆16Updated 6 years ago