leiwu0 / sgd.stability

Related projects: ⓘ

• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆108Updated 4 years ago
• rgrosse / csc2541_examples
  ☆29Updated 3 years ago
• deep-lab / DeepnetHessian
  Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)
  ☆17Updated 5 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆45Updated 4 years ago
• damaru2 / ntk
  NTK reading group
  ☆84Updated 4 years ago
• umutsimsekli / sgd_tail_index
  The codebase for the paper "A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks"
  ☆21Updated 4 years ago
• xingchenwan / MLRG_DeepCurvature
  ☆14Updated 4 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆93Updated 4 years ago
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆139Updated last year
• lorraine2 / implicit-hyper-opt
  ☆35Updated this week
• modestyachts / neural_kernels_code
  ☆36Updated 3 years ago
• bneyshabur / path-sgd
  Path-SGD: Path-Normalized Optimization in Deep Neural Networks
  ☆17Updated 5 years ago
• bobby-he / Neural_Tangent_Kernel
  ☆65Updated 5 years ago
• AnonymousNIPS2019 / DeepnetHessian
  The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size
  ☆17Updated 5 years ago
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆125Updated 5 years ago
• ganguli-lab / deepchaos
  Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"
  ☆67Updated 8 years ago
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆34Updated 5 years ago
• plai-group / tvo
  Code for the Thermodynamic Variational Objective
  ☆26Updated 2 years ago
• stevenliuyi / information-bottleneck
  demonstration of the information bottleneck theory for deep learning
  ☆57Updated 6 years ago
• neural-tangents / neural-tangents
  Neural Tangents: Fast and Easy Infinite Neural Networks in Python
  ☆15Updated 4 years ago
• asteroidhouse / self-tuning-networks
  Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088
  ☆53Updated 5 years ago
• alexalemi / vib_demo
  ☆85Updated 2 years ago
• wouterkool / estimating-gradients-without-replacement
  Estimating Gradients for Discrete Random Variables by Sampling without Replacement
  ☆39Updated 4 years ago
• ucla-vision / entropy-sgd
  Lua implementation of Entropy-SGD
  ☆79Updated 6 years ago
• mingzhang-yin / SIVI
  A variational inference method with accurate uncertainty estimation. It uses a new semi-implicit variational family built on neural netwo…
  ☆52Updated 3 months ago
• fwcore / mean-field-theory-deep-learning
  paper lists and information on mean-field theory of deep learning
  ☆75Updated 5 years ago
• avirmaux / lipEstimation
  ☆56Updated last year
• KangchengHou / gntk
  Implementation of Graph Neural Tangent Kernel (NeurIPS 2019)
  ☆100Updated 4 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆82Updated 4 years ago
• gd-zhang / noisy-K-FAC
  Natural Gradient, Variational Inference
  ☆28Updated 4 years ago