marcellodebernardi / loss-landscapes
Approximating neural network loss landscapes in low-dimensional parameter subspaces for PyTorch
☆321Updated last year
Alternatives and similar repositories for loss-landscapes:
Users that are interested in loss-landscapes are comparing it to the libraries listed below
- Create animations for the optimization trajectory of neural nets☆145Updated last year
- Mode Connectivity and Fast Geometric Ensembles in PyTorch☆267Updated 2 years ago
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆211Updated this week
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆720Updated 10 months ago
- Efficient PyTorch Hessian eigendecomposition tools!☆370Updated last year
- Compare neural networks by their feature similarity☆353Updated last year
- Code for the paper "Calibrating Deep Neural Networks using Focal Loss"☆160Updated last year
- Train ImageNet *fast* in 500 lines of code with FFCV☆139Updated 9 months ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆572Updated 2 months ago
- Neural Tangent Kernel Papers☆106Updated last month
- ☆187Updated 4 years ago
- Reproduce CKA: Similarity of Neural Network Representations Revisited☆297Updated 4 years ago
- ☆67Updated 5 years ago
- Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK☆172Updated 5 years ago
- ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning☆271Updated 2 years ago
- Code for Deterministic Neural Networks with Appropriate Inductive Biases Capture Epistemic and Aleatoric Uncertainty☆135Updated last year
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆130Updated 5 years ago
- PyTorch implementation of SimCLR: supports multi-GPU training and closely reproduces results☆202Updated 10 months ago
- Project site for "Your Classifier is Secretly an Energy-Based Model and You Should Treat it Like One"☆420Updated 2 years ago
- Benchmark your model on out-of-distribution datasets with carefully collected human comparison data (NeurIPS 2021 Oral)☆340Updated 6 months ago
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆182Updated last year
- Code for "Uncertainty Estimation Using a Single Deep Deterministic Neural Network"☆271Updated 2 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆141Updated last year
- Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning, ICLR 2020☆235Updated 2 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆141Updated 3 years ago
- ☆156Updated 2 years ago
- A pytorch implementation of our jacobian regularizer to encourage learning representations more robust to input perturbations.☆125Updated last year
- Code repo for "A Simple Baseline for Bayesian Uncertainty in Deep Learning"☆457Updated last year
- PyTorch repository for ICLR 2022 paper (GSAM) which improves generalization (e.g. +3.8% top-1 accuracy on ImageNet with ViT-B/32)☆139Updated 2 years ago
- Hessian spectral density estimation in TF and Jax☆121Updated 4 years ago