Approximating neural network loss landscapes in low-dimensional parameter subspaces for PyTorch
☆354Nov 30, 2023Updated 2 years ago
Alternatives and similar repositories for loss-landscapes
Users that are interested in loss-landscapes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for visualizing the loss landscape of neural nets☆3,167Apr 5, 2022Updated 4 years ago
- Create animations for the optimization trajectory of neural nets☆163Jan 30, 2024Updated 2 years ago
- Visualizing the the loss landscape of Fully-Connected Neural Networks☆46Jun 4, 2023Updated 2 years ago
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆779Jul 10, 2025Updated 9 months ago
- ☆21Jun 2, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Respect to the input tensor instead of paramters of NN☆21Jul 18, 2022Updated 3 years ago
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆66Jul 29, 2020Updated 5 years ago
- Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)☆20Feb 16, 2024Updated 2 years ago
- Efficient Neural Network Loss Landscape Generation☆10Apr 26, 2019Updated 6 years ago
- SAM: Sharpness-Aware Minimization (PyTorch)☆1,969Feb 21, 2024Updated 2 years ago
- Code for AAAI 2024 paper: CR-SAM: Curvature Regularized Sharpness-Aware Minimization☆12Nov 29, 2024Updated last year
- ICLR 2021: Noise against noise: stochastic label noise helps combat inherent label noise☆15May 1, 2021Updated 4 years ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Sep 18, 2023Updated 2 years ago
- RobustBench: a standardized adversarial robustness benchmark [NeurIPS 2021 Benchmarks and Datasets Track]☆772Mar 31, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Mode Connectivity and Fast Geometric Ensembles in PyTorch☆285Oct 24, 2022Updated 3 years ago
- Efficient PyTorch Hessian eigendecomposition tools!☆385Feb 29, 2024Updated 2 years ago
- AFEC: Active Forgetting of Negative Transfer in Continual Learning (NeurIPS 2021)☆28Sep 26, 2023Updated 2 years ago
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆20Jan 7, 2022Updated 4 years ago
- Code relative to "Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks"☆741May 16, 2024Updated last year
- Code for the paper: Towards Better Understanding Attribution Methods. CVPR 2022.☆17Jun 13, 2022Updated 3 years ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆37Sep 19, 2022Updated 3 years ago
- Code for our ICLR 2023 paper Making Substitute Models More Bayesian Can Enhance Transferability of Adversarial Examples.☆18May 31, 2023Updated 2 years ago
- Code for paper Almost-Orthogonal Layers for Efficient General-Purpose Lipschitz Networks☆13Aug 9, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code for paper "Orthogonal Convolutional Neural Networks".☆118Aug 3, 2021Updated 4 years ago
- The offical implementation of [NeurIPS2024] Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation https://ar…☆50Dec 13, 2024Updated last year
- Benchmarking Attention Mechanism in Vision Transformers.☆20Oct 10, 2022Updated 3 years ago
- Resnets in tensorflow 2.0.☆17Mar 15, 2025Updated last year
- Hessian spectral density estimation in TF and Jax☆125Sep 6, 2020Updated 5 years ago
- Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthog…☆17Sep 21, 2019Updated 6 years ago
- Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning☆19Sep 20, 2022Updated 3 years ago
- [ICML'20] Multi Steepest Descent (MSD) for robustness against the union of multiple perturbation models.☆25Jul 25, 2024Updated last year
- codes for ICML2021 paper iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients☆10May 27, 2021Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- [CVPR 2024] Friendly Sharpness-Aware Minimization☆36Oct 29, 2024Updated last year
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆52Jan 29, 2024Updated 2 years ago
- Out-of-distribution detection using the pNML regret. NeurIPS2021☆25Dec 20, 2024Updated last year
- CoSCL: Cooperation of Small Continual Learners is Stronger than a Big One (ECCV 2022)☆20Sep 26, 2023Updated 2 years ago
- [NeurIPS 2022] Code for paper "Efficiently Computing Local Lipschitz Constants of Neural Networks via Bound Propagation"☆27Dec 10, 2023Updated 2 years ago
- This is unofficial repository for Towards Efficient and Scalable Sharpness-Aware Minimization.☆37Apr 15, 2024Updated last year
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆29Sep 22, 2023Updated 2 years ago