gknilsen / pyhessian
pyhessian is a TensorFlow module which can be used to estimate Hessian matrices
☆23Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for pyhessian
- Geometric Certifications of Neural Nets☆41Updated 2 years ago
- Limitations of the Empirical Fisher Approximation☆45Updated 4 years ago
- paper lists and information on mean-field theory of deep learning☆75Updated 5 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 5 years ago
- Contains code for the NeurIPS 2020 paper by Pan et al., "Continual Deep Learning by FunctionalRegularisation of Memorable Past"☆44Updated 4 years ago
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆135Updated 5 years ago
- Monotone operator equilibrium networks☆51Updated 4 years ago
- Approximate Inference Turns Deep Networks into Gaussian Processes (dnn2gp)☆48Updated 4 years ago
- Code for "A Spectral Approach to Gradient Estimation for Implicit Distributions" (ICML'18)☆32Updated last year
- Sample code for running deterministic variational inference to train Bayesian neural networks☆100Updated 6 years ago
- Convolutional Neural Tangent Kernel☆107Updated 5 years ago
- Natural Gradient, Variational Inference☆29Updated 4 years ago
- Computing various norms/measures on over-parametrized neural networks☆49Updated 5 years ago
- Code for the paper Gaussian process behaviour in wide deep networks☆48Updated 6 years ago
- ☆67Updated 5 years ago
- ☆132Updated 7 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆47Updated 5 years ago
- PyTorch implementation of FIM and empirical FIM☆58Updated 6 years ago
- ☆119Updated 5 months ago
- Minimax Optimization, Stackelberg Games, Generative Adversarial Networks☆18Updated 4 years ago
- Scalable Training of Inference Networks for Gaussian-Process Models, ICML 2019☆41Updated last year
- Code for the paper Implicit Weight Uncertainty in Neural Networks☆65Updated 5 years ago
- A tensorflow implementation of the NIPS 2018 paper "Variational Inference with Tail-adaptive f-Divergence"☆20Updated 5 years ago
- Regularization, Neural Network Training Dynamics☆14Updated 4 years ago
- ☆159Updated 3 months ago
- Hypergradient descent☆138Updated 5 months ago
- NTK reading group☆86Updated 5 years ago
- Testing Nerual Tangent Kernel (NTK) on small UCI datasets☆82Updated 5 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆142Updated last year