Kedreamix / MAE-for-CIFAR
MAE for CIFAR，由于可用资源有限，我们仅在 cifar10 上测试模型。我们主要想重现这样的结果：使用 MAE 预训练 ViT 可以比直接使用标签进行监督学习训练获得更好的结果。这应该是自我监督学习比监督学习更有效的数据的证据。
☆69Updated last year
Alternatives and similar repositories for MAE-for-CIFAR:
Users that are interested in MAE-for-CIFAR are comparing it to the libraries listed below
- GroupMixAttention and GroupMixFormer☆115Updated last year
- [TNNLS 2025] TransXNet: Learning Both Global and Local Dynamics with a Dual Dynamic Token Mixer for Visual Recognition☆172Updated 2 weeks ago
- ☆83Updated last year
- Official implement for ICML2023 paper: "A Closer Look at Self-Supervised Lightweight Vision Transformers"☆124Updated 3 weeks ago
- ReViT - Residual Attention Vision Transformer☆32Updated last year
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆114Updated 11 months ago
- CAM', 'ScoreCAM', 'SSCAM', 'ISCAM' 'GradCAM', 'GradCAMpp', 'SmoothGradCAMpp', 'XGradCAM', 'LayerCAM' using by PyTorch.☆72Updated 3 years ago
- 🕹️SCConv: Spatial and Channel Reconstruction Convolution for Feature Redundancy☆299Updated 7 months ago
- The official code of "Rethinking Local Perception in Lightweight Vision Transformer"☆85Updated last year
- ☆120Updated last year
- CMT Pytorch implementation of our CVPR 2022 paper CMT: Convolutional Neural Networks Meet Vision Transformers (https://arxiv.org/pdf/2107…☆97Updated 2 years ago
- ☆136Updated 9 months ago
- ☆143Updated last year
- Implementation Code for the ICCASSP 2023 paper " Efficient Multi-Scale Attention Module with Cross-Spatial Learning" and is available at:…☆222Updated 3 months ago
- [AAAI 2024] Prompt-based Distribution Alignment for Unsupervised Domain Adaptation☆63Updated 5 months ago
- Awesome Fine-grained Visual Classification☆226Updated last year
- 'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)☆225Updated last year
- A Simple but Effective Downsampling Module For Semantic Segmentation☆106Updated last year
- Official ImageNet Model repository☆246Updated last year
- Pytorch implementation for "A Novel Plug-in Module for Fine-Grained Visual Classification". fine-grained visual classification task.☆197Updated last year
- The official pytorch implementation of "SCSA: Exploring the Synergistic Effects Between Spatial and Channel Attention".☆68Updated last week
- visualization：filter、feature map、attention map、image-mask、grad-cam、human keypoint、guided-backpro☆114Updated 2 years ago
- (CVPR2024)RMT: Retentive Networks Meet Vision Transformer☆341Updated 7 months ago
- ☆85Updated last year
- 可视化神经网络☆39Updated 2 years ago
- 可视化特征图教程☆70Updated 2 years ago
- [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"☆166Updated 3 months ago
- [CVPR 2024] Rewrite the Stars☆360Updated 10 months ago
- [NeurIPS 2022] Implementation of "AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition"☆346Updated 2 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "Fast Vision Transformers with HiLo Attention"☆270Updated last year