james-simon / eigenlearning
codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"
☆49Updated last year
Alternatives and similar repositories for eigenlearning:
Users that are interested in eigenlearning are comparing it to the libraries listed below
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆47Updated 5 years ago
- ☆66Updated 6 years ago
- Monotone operator equilibrium networks☆51Updated 4 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago
- Official codebase for "Distribution-Free, Risk-Controlling Prediction Sets"☆87Updated last year
- paper lists and information on mean-field theory of deep learning☆75Updated 6 years ago
- A minimal implementation of a VAE with BinConcrete (relaxed Bernoulli) latent distribution in TensorFlow.☆21Updated 5 years ago
- ☆49Updated 4 years ago
- ☆53Updated 8 months ago
- repo for paper: Adaptive Checkpoint Adjoint (ACA) method for gradient estimation in neural ODE☆54Updated 4 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆106Updated 4 years ago
- ☆80Updated 3 years ago
- Official code for UnICORNN (ICML 2021)☆27Updated 3 years ago
- simple JAX-/NumPy-based implementations of NGD with exact/approximate Fisher Information Matrix both in parameter-space and function-spac…☆14Updated 4 years ago
- Codebase for Learning Invariances in Neural Networks☆94Updated 2 years ago
- Stochastic Gradient Langevin Dynamics for Bayesian learning☆31Updated 3 years ago
- ☆99Updated 3 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- Models and code for the ICLR 2020 workshop paper "Towards Understanding Normalization in Neural ODEs"☆16Updated 4 years ago
- ☆19Updated 3 years ago
- [NeurIPS'19] Deep Equilibrium Models Jax Implementation☆39Updated 4 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆51Updated 4 years ago
- Convolutional Neural Tangent Kernel☆110Updated 5 years ago
- PyTorch implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆36Updated 3 years ago
- Pytorch implementation of the Power Spherical distribution☆74Updated 8 months ago
- Approximate Inference Turns Deep Networks into Gaussian Processes (dnn2gp)☆48Updated 5 years ago
- Hessian spectral density estimation in TF and Jax☆122Updated 4 years ago
- Code for "'Hey, that's not an ODE:' Faster ODE Adjoints via Seminorms" (ICML 2021)☆87Updated 2 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated 3 weeks ago