fmeirinhos / pytorch-hessianfree
PyTorch implementation of Hessian Free optimisation
☆43Updated 5 years ago
Alternatives and similar repositories for pytorch-hessianfree:
Users that are interested in pytorch-hessianfree are comparing it to the libraries listed below
- Limitations of the Empirical Fisher Approximation☆46Updated 4 years ago
- Monotone operator equilibrium networks☆51Updated 4 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆142Updated last year
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆130Updated 5 years ago
- Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations☆20Updated last year
- paper lists and information on mean-field theory of deep learning☆75Updated 5 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆72Updated 5 months ago
- ☆67Updated 5 years ago
- Code for "'Hey, that's not an ODE:' Faster ODE Adjoints via Seminorms" (ICML 2021)☆86Updated 2 years ago
- repo for paper: Adaptive Checkpoint Adjoint (ACA) method for gradient estimation in neural ODE☆54Updated 3 years ago
- Adaptive gradient descent without descent☆47Updated 3 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆140Updated last year
- simple JAX-/NumPy-based implementations of NGD with exact/approximate Fisher Information Matrix both in parameter-space and function-spac…☆14Updated 4 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆102Updated 4 years ago
- A Pytorch implementation of an efficient unitary neural network (https://arxiv.org/abs/1612.05231)☆33Updated 4 years ago
- Approximate Inference Turns Deep Networks into Gaussian Processes (dnn2gp)☆48Updated 5 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆47Updated 5 years ago
- Convex potential flows☆81Updated 3 years ago
- Code for "A Spectral Approach to Gradient Estimation for Implicit Distributions" (ICML'18)☆32Updated last year
- Lipschitz Neural Networks described in "Sorting Out Lipschitz Function Approximation" (ICML 2019).☆54Updated 4 years ago
- Experiments with Neural ODEs and Adversarial Attacks☆44Updated 6 years ago
- ☆53Updated 5 months ago
- Natural Gradient, Variational Inference☆29Updated 5 years ago
- The code for the paper: https://arxiv.org/abs/1806.06317☆24Updated 5 years ago
- ☆36Updated 3 years ago
- Regularization, Neural Network Training Dynamics☆14Updated 5 years ago
- ☆31Updated 4 years ago
- Convolutional Neural Tangent Kernel☆108Updated 5 years ago
- Refining continuous-in-depth neural networks☆39Updated 3 years ago