nblt / F-SAM
[CVPR 2024] Friendly Sharpness-Aware Minimization
☆28Updated 4 months ago
Alternatives and similar repositories for F-SAM:
Users that are interested in F-SAM are comparing it to the libraries listed below
- ☆35Updated 2 years ago
- The official repo for CVPR2023 highlight paper "Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization".☆82Updated last year
- [ICLR 2024] Improving Convergence and Generalization Using Parameter Symmetries☆29Updated 9 months ago
- Transformers trained on Tiny ImageNet☆54Updated 2 years ago
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆28Updated last year
- Fine-tuning Vision Transformers on various classification datasets☆106Updated 6 months ago
- ☆57Updated 2 years ago
- ☆11Updated 2 years ago
- ☆53Updated last month
- Decoupled Kullback-Leibler Divergence Loss (DKL), NeurIPS 2024 / Generalized Kullback-Leibler Divergence Loss (GKL)☆43Updated this week
- Code for 'Multi-level Logit Distillation' (CVPR2023)☆60Updated 6 months ago
- ☆25Updated last year
- ☆16Updated 2 years ago
- Switch EMA: A Free Lunch for Better Flatness and Sharpness☆26Updated last year
- LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters☆31Updated 3 weeks ago
- [ICCV23] Robust Mixture-of-Expert Training for Convolutional Neural Networks by Yihua Zhang, Ruisi Cai, Tianlong Chen, Guanhua Zhang, Hua…☆52Updated last year
- [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation☆12Updated last year
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆14Updated 8 months ago
- Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"☆37Updated 2 years ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆80Updated last year
- ☆19Updated last year
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆30Updated 4 months ago
- Variance Covariance Regularization☆14Updated last year
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆141Updated 3 years ago
- The offical implement of ImbSAM (Imbalanced-SAM)☆23Updated last year
- SparCL: Sparse Continual Learning on the Edge @ NeurIPS 22☆29Updated last year
- Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch☆75Updated 2 years ago
- ☆26Updated 2 years ago
- [ICML23] On Pitfalls of Test-Time Adaptation☆114Updated 11 months ago
- [NeurIPS 2022] Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach -- Official Implementation☆44Updated last year