Approximating neural network loss landscapes in low-dimensional parameter subspaces for PyTorch
☆351Nov 30, 2023Updated 2 years ago
Alternatives and similar repositories for loss-landscapes
Users that are interested in loss-landscapes are comparing it to the libraries listed below
Sorting:
- Code for visualizing the loss landscape of neural nets☆3,157Apr 5, 2022Updated 3 years ago
- Create animations for the optimization trajectory of neural nets☆163Jan 30, 2024Updated 2 years ago
- Visualizing the the loss landscape of Fully-Connected Neural Networks☆46Jun 4, 2023Updated 2 years ago
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆778Jul 10, 2025Updated 8 months ago
- Respect to the input tensor instead of paramters of NN☆21Jul 18, 2022Updated 3 years ago
- ☆39Jan 24, 2020Updated 6 years ago
- ☆19Jul 15, 2020Updated 5 years ago
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆66Jul 29, 2020Updated 5 years ago
- Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)☆20Feb 16, 2024Updated 2 years ago
- Efficient Neural Network Loss Landscape Generation☆10Apr 26, 2019Updated 6 years ago
- SAM: Sharpness-Aware Minimization (PyTorch)☆1,965Feb 21, 2024Updated 2 years ago
- ☆11Dec 8, 2022Updated 3 years ago
- Code for the paper "Representational Continuity for Unsupervised Continual Learning" (ICLR 22)☆99Feb 26, 2023Updated 3 years ago
- Code for AAAI 2024 paper: CR-SAM: Curvature Regularized Sharpness-Aware Minimization☆12Nov 29, 2024Updated last year
- ICLR 2021: Noise against noise: stochastic label noise helps combat inherent label noise☆15May 1, 2021Updated 4 years ago
- Mode Connectivity and Fast Geometric Ensembles in PyTorch☆284Oct 24, 2022Updated 3 years ago
- RobustBench: a standardized adversarial robustness benchmark [NeurIPS 2021 Benchmarks and Datasets Track]☆772Mar 31, 2025Updated 11 months ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Sep 18, 2023Updated 2 years ago
- Efficient PyTorch Hessian eigendecomposition tools!☆386Feb 29, 2024Updated 2 years ago
- AFEC: Active Forgetting of Negative Transfer in Continual Learning (NeurIPS 2021)☆28Sep 26, 2023Updated 2 years ago
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆20Jan 7, 2022Updated 4 years ago
- Code relative to "Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks"☆743May 16, 2024Updated last year
- Code for the paper: Towards Better Understanding Attribution Methods. CVPR 2022.☆17Jun 13, 2022Updated 3 years ago
- ☆21Jan 23, 2024Updated 2 years ago
- Code for paper Almost-Orthogonal Layers for Efficient General-Purpose Lipschitz Networks☆12Aug 9, 2022Updated 3 years ago
- ☆57Feb 13, 2023Updated 3 years ago
- Code for paper "Orthogonal Convolutional Neural Networks".☆118Aug 3, 2021Updated 4 years ago
- The offical implementation of [NeurIPS2024] Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation https://ar…☆50Dec 13, 2024Updated last year
- Benchmarking Attention Mechanism in Vision Transformers.☆20Oct 10, 2022Updated 3 years ago
- Resnets in tensorflow 2.0.☆17Mar 15, 2025Updated last year
- [EMNLP22] Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models☆22Mar 27, 2023Updated 2 years ago
- Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning☆19Sep 20, 2022Updated 3 years ago
- [ICML'20] Multi Steepest Descent (MSD) for robustness against the union of multiple perturbation models.☆25Jul 25, 2024Updated last year
- codes for ICML2021 paper iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients☆10May 27, 2021Updated 4 years ago
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆52Jan 29, 2024Updated 2 years ago
- Out-of-distribution detection using the pNML regret. NeurIPS2021☆25Dec 20, 2024Updated last year
- CoSCL: Cooperation of Small Continual Learners is Stronger than a Big One (ECCV 2022)☆19Sep 26, 2023Updated 2 years ago
- A Benchmark for Failure Detection under Distribution Shifts in Image Classification☆35Oct 19, 2024Updated last year
- This is unofficial repository for Towards Efficient and Scalable Sharpness-Aware Minimization.☆37Apr 15, 2024Updated last year