juntang-zhuang / GSAM
PyTorch repository for ICLR 2022 paper (GSAM) which improves generalization (e.g. +3.8% top-1 accuracy on ImageNet with ViT-B/32)
☆139Updated 2 years ago
Alternatives and similar repositories for GSAM:
Users that are interested in GSAM are comparing it to the libraries listed below
- ☆57Updated last year
- Train ImageNet *fast* in 500 lines of code with FFCV☆136Updated 8 months ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆140Updated 3 years ago
- [CVPR 2021] "The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models" Tianlong Chen, Jon…☆68Updated 2 years ago
- Whitening for Self-Supervised Representation Learning | Official repository☆129Updated last year
- ☆34Updated 2 years ago
- Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)☆103Updated 3 years ago
- Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)☆55Updated last year
- Official implementation of paper Gradient Matching for Domain Generalization☆117Updated 3 years ago
- [NeurIPS'20] GradAug: A New Regularization Method for Deep Neural Networks☆93Updated 4 years ago
- Official Pytorch's implementation of RotoGrad☆72Updated last year
- Learning recognition/segmentation models without end-to-end training. 40%-60% less GPU memory footprint. Same training time. Better perfo…☆90Updated 2 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 2 years ago
- [NeurIPS'21] "AugMax: Adversarial Composition of Random Augmentations for Robust Training" by Haotao Wang, Chaowei Xiao, Jean Kossaifi, Z…☆125Updated 3 years ago
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆25Updated last year
- Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"☆37Updated last year
- Code to reproduce experiments from 'Does Knowledge Distillation Really Work' a paper which appeared in the 2021 NeurIPS proceedings.☆33Updated last year
- ImageNet Testbed, associated with the paper "Measuring Robustness to Natural Distribution Shifts in Image Classification."☆117Updated last year
- ☆107Updated last year
- The official PyTorch implementation - Can Neural Nets Learn the Same Model Twice? Investigating Reproducibility and Double Descent from t…☆77Updated 2 years ago
- Training vision models with full-batch gradient descent and regularization☆37Updated last year
- ☆104Updated last year
- Official PyTorch implementation of the Fishr regularization for out-of-distribution generalization☆85Updated 2 years ago
- ImageNet-R(endition) and DeepAugment (ICCV 2021)☆259Updated 3 years ago
- Implementation of Barlow Twins paper☆99Updated 2 years ago
- Un-Mix: Rethinking Image Mixtures for Unsupervised Visual Representation Learning.☆150Updated 2 years ago
- (ICML 2022) Official PyTorch implementation of “Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Rob…☆78Updated 2 years ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆61Updated 4 years ago
- Weight-Averaged Sharpness-Aware Minimization (NeurIPS 2022)☆28Updated 2 years ago