xxgege / GAM
The official repo for CVPR2023 highlight paper "Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization".
☆82Updated last year
Alternatives and similar repositories for GAM:
Users that are interested in GAM are comparing it to the libraries listed below
- [CVPR 2024] Friendly Sharpness-Aware Minimization☆33Updated 5 months ago
- PyTorch repository for ICLR 2022 paper (GSAM) which improves generalization (e.g. +3.8% top-1 accuracy on ImageNet with ViT-B/32)☆143Updated 2 years ago
- Transformers trained on Tiny ImageNet☆54Updated 2 years ago
- The official codes of our CVPR-2023 paper: Sharpness-Aware Gradient Matching for Domain Generalization☆75Updated last year
- [NeurIPS 2022] Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach -- Official Implementation☆44Updated last year
- Implementation of HAT https://arxiv.org/pdf/2204.00993☆49Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆143Updated 2 years ago
- ☆57Updated 2 years ago
- ☆26Updated 2 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆141Updated 3 years ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆42Updated 3 years ago
- Denoising Masked Autoencoders Help Robust Classification.☆62Updated last year
- The offical implement of ImbSAM (Imbalanced-SAM)☆22Updated last year
- PyTorch implementation of paper "Dataset Distillation via Factorization" in NeurIPS 2022.☆65Updated 2 years ago
- (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better☆43Updated 3 years ago
- [ICCV 2021] Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain☆75Updated 2 years ago
- Paper List for Multi-Task Learning (focus on architectures and optimization for MTL)☆45Updated last year
- Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023☆82Updated last year
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆80Updated last year
- This is the official GitHub for paper: On the Versatile Uses of Partial Distance Correlation in Deep Learning, in ECCV 2022☆173Updated last year
- [ICLR 2024] Improving Convergence and Generalization Using Parameter Symmetries☆29Updated 10 months ago
- [NeurIPS 2022] A novel 1-Lipschitz network that can be efficiently trained to achieve certified L-infinity robustness for free!☆31Updated 2 years ago
- [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".☆93Updated 2 years ago
- ☆35Updated 2 years ago
- This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).☆77Updated last month
- Official PyTorch implementation of PS-KD☆85Updated 2 years ago
- [IJCAI-2021] Contrastive Model Inversion for Data-Free Knowledge Distillation☆72Updated 3 years ago
- Official Code for NeurIPS 2022 Paper: How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders☆58Updated last year
- Official PyTorch(MMCV) implementation of “Adversarial AutoMixup” (ICLR 2024 spotlight)☆67Updated 5 months ago
- 这里陈列了我编写的一些关于深度学习的画图工具，如果觉得有帮助可以给个star.☆39Updated 2 years ago