locuslab / edge-of-stability
☆65Updated 3 months ago
Alternatives and similar repositories for edge-of-stability:
Users that are interested in edge-of-stability are comparing it to the libraries listed below
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Deep Learning & Information Bottleneck☆58Updated last year
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- ☆34Updated last year
- PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)☆34Updated 2 weeks ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆105Updated 4 years ago
- Simple CIFAR10 ResNet example with JAX.☆23Updated 3 years ago
- Neural Tangent Kernel Papers☆106Updated 2 months ago
- Efficient empirical NTKs in PyTorch☆18Updated 2 years ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆53Updated last week
- ☆67Updated 6 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆130Updated 5 years ago
- ☆29Updated last year
- ☆60Updated 3 years ago
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆47Updated 9 months ago
- Pytorch code for experiments on Linear Transformers☆20Updated last year
- [ICML'21] Improved Contrastive Divergence Training of Energy Based Models☆62Updated 2 years ago
- Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"☆22Updated last year
- [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features☆55Updated 2 years ago
- Code for "The Intrinsic Dimension of Images and Its Impact on Learning" - ICLR 2021 Spotlight https://openreview.net/forum?id=XJk19XzGq2J☆68Updated 11 months ago
- Visualization of mean field and neural tangent kernel regime☆21Updated 7 months ago
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆47Updated last year
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆23Updated 9 months ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆38Updated 5 years ago
- Omnigrok: Grokking Beyond Algorithmic Data☆53Updated 2 years ago
- ☆35Updated 2 years ago
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆97Updated 11 months ago
- Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')☆16Updated 2 years ago
- Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"☆20Updated last year