Kedreamix / MAE-for-CIFAR
MAE for CIFAR，由于可用资源有限，我们仅在 cifar10 上测试模型。我们主要想重现这样的结果：使用 MAE 预训练 ViT 可以比直接使用标签进行监督学习训练获得更好的结果。这应该是自我监督学习比监督学习更有效的数据的证据。
☆66Updated last year
Alternatives and similar repositories for MAE-for-CIFAR:
Users that are interested in MAE-for-CIFAR are comparing it to the libraries listed below
- GroupMixAttention and GroupMixFormer☆115Updated last year
- [AAAI 2024] Prompt-based Distribution Alignment for Unsupervised Domain Adaptation☆60Updated 4 months ago
- CAM', 'ScoreCAM', 'SSCAM', 'ISCAM' 'GradCAM', 'GradCAMpp', 'SmoothGradCAMpp', 'XGradCAM', 'LayerCAM' using by PyTorch.☆72Updated 3 years ago
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆110Updated 10 months ago
- TransXNet: Learning Both Global and Local Dynamics with a Dual Dynamic Token Mixer for Visual Recognition☆170Updated last year
- ReViT - Residual Attention Vision Transformer☆29Updated 11 months ago
- Official PyTorch(MMCV) implementation of “Adversarial AutoMixup” (ICLR 2024 spotlight)☆65Updated 3 months ago
- ☆83Updated last year
- iFormer: Inception Transformer☆246Updated 2 years ago
- ☆117Updated last year
- (CVPR2024)RMT: Retentive Networks Meet Vision Transformer☆329Updated 6 months ago
- 可视化神经网络☆40Updated 2 years ago
- 🕹️SCConv: Spatial and Channel Reconstruction Convolution for Feature Redundancy☆297Updated 6 months ago
- Pytorch ViT for Image classification on the CIFAR10 dataset☆34Updated 3 years ago
- 这里陈列了我编写的一些关于深度学习的画图工具，如果觉得有帮助可以给个star.☆37Updated 2 years ago
- 'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)☆224Updated last year
- The official implementation for DomainDrop (ICCV 2023).☆48Updated last year
- A Simple but Effective Downsampling Module For Semantic Segmentation☆101Updated last year
- The official code of "Rethinking Local Perception in Lightweight Vision Transformer"☆85Updated last year
- [CVPR 2023] Official code release of our paper "BiFormer: Vision Transformer with Bi-Level Routing Attention"☆525Updated last year
- Official implement for ICML2023 paper: "A Closer Look at Self-Supervised Lightweight Vision Transformers"☆122Updated last year
- Official repository of ACmix (CVPR2022)☆404Updated 2 years ago
- Implementation Code for the ICCASSP 2023 paper " Efficient Multi-Scale Attention Module with Cross-Spatial Learning" and is available at:…☆216Updated 2 months ago
- visualization：filter、feature map、attention map、image-mask、grad-cam、human keypoint、guided-backpro☆109Updated last year
- [CVPR 2024] Rewrite the Stars☆352Updated 9 months ago
- ☆85Updated last year
- ☆33Updated last year
- ☆34Updated last year
- ☆138Updated 11 months ago
- The official repository implement of Res-VMamba: Fine-Grained Food Category Visual Classification Using Selective State Space Models with…☆61Updated 2 months ago