thegregyang / GP4A
Code for NeurIPS 2019 paper: "Tensor Programs I: Wide Feedforward or Recurrent Neural Networks of Any Architecture are Gaussian Processes"
☆239Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for GP4A
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆97Updated 4 years ago
- Convolutional Neural Tangent Kernel☆107Updated 5 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆140Updated last year
- ☆159Updated 3 months ago
- Optimization with orthogonal constraints and on general manifolds☆126Updated 4 years ago
- [IJCAI'19, NeurIPS'19] Anode: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs☆104Updated 4 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆142Updated last year
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆179Updated 3 months ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆561Updated this week
- Hessian spectral density estimation in TF and Jax☆115Updated 4 years ago
- paper lists and information on mean-field theory of deep learning☆75Updated 5 years ago
- ☆97Updated 2 years ago
- ☆59Updated 5 years ago
- hessian in pytorch☆185Updated 4 years ago
- Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK☆166Updated 5 years ago
- ☆235Updated last year
- Experiment code for "Randomized Automatic Differentiation"☆67Updated 4 years ago
- Hypergradient descent☆138Updated 5 months ago
- ☆155Updated 4 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆128Updated 5 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆69Updated 3 months ago
- Understanding normalizing flows☆131Updated 4 years ago
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated 11 months ago
- Parameter-Free Optimizers for Pytorch☆109Updated 6 months ago
- Neural network verification in JAX☆142Updated last year
- ☆78Updated 3 years ago
- ☆213Updated 2 years ago
- Efficient PyTorch Hessian eigendecomposition tools!☆364Updated 8 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …☆127Updated last month
- A general-purpose, deep learning-first library for constrained optimization in PyTorch☆107Updated this week