VITA-Group / ViT-Anti-Oversmoothing
[ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang Wang
☆79Updated last year
Alternatives and similar repositories for ViT-Anti-Oversmoothing:
Users that are interested in ViT-Anti-Oversmoothing are comparing it to the libraries listed below
- PyTorch Implementation of "Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model"☆49Updated 2 years ago
- Denoising Masked Autoencoders Help Robust Classification.☆62Updated last year
- Implementation of HAT https://arxiv.org/pdf/2204.00993☆50Updated last year
- This is a offical PyTorch/GPU implementation of SupMAE.☆78Updated 2 years ago
- [ICDM 2023] Momentum is All You Need for Data-Driven Adaptive Optimization☆25Updated last year
- open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689☆51Updated 3 years ago
- ☆27Updated 2 years ago
- Log-Polar Space Convolution for Convolutional Neural Networks☆12Updated 2 years ago
- ☆54Updated last year
- [NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.☆60Updated last year
- [ECCV 2022] AMixer: Adaptive Weight Mixing for Self-attention Free Vision Transformers☆28Updated 2 years ago
- [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training☆75Updated 2 years ago
- [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆53Updated 6 months ago
- ☆60Updated 2 years ago
- (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better☆43Updated 3 years ago
- Robustness via Cross-Domain Ensembles, ICCV 2021 [Oral]☆39Updated 3 years ago
- Information Bottleneck Approach to Spatial Attention Learning, IJCAI2021☆15Updated 3 years ago
- Repository containing code for blockwise SSL training☆29Updated 6 months ago
- Decoupled Kullback-Leibler Divergence Loss (DKL), NeurIPS 2024 / Generalized Kullback-Leibler Divergence Loss (GKL)☆44Updated last month
- Official PyTorch implementation of "Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets" (ICLR 2023 notable top 25%)☆24Updated last year
- ResMLP: Feedforward networks for image classification with data-efficient training☆42Updated 3 years ago
- code for paper "Masked Frequency Modeling for Self-Supervised Visual Pre-Training" (https://arxiv.org/pdf/2206.07706.pdf)☆24Updated 2 years ago
- Official PyTorch implementation for the paper Minimizing Trajectory Curvature of ODE-based Generative Models, ICML 2023☆82Updated 2 months ago
- [NeurIPS 2023] Official Implementation: "Consistent Diffusion Models"☆56Updated 2 years ago
- Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)☆56Updated 2 years ago
- Code for the ICML 2021 and ICLR 2022 papers: Skew Orthogonal Convolutions, Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100☆18Updated 3 years ago
- An official code release of the paper RGB no more: Minimally Decoded JPEG Vision Transformers☆56Updated last year
- Code for "Optimal Transport-Guided Conditional Score-Based Diffusion Model (NeurIPS, 8,7,7,6)"☆58Updated last year
- Advanced Dropout: A Model-free Methodology for Bayesian Dropout Optimization (IEEE TPAMI 2021)☆17Updated 3 years ago
- Description: Frequency Augmented Variational Autoencoder for better Image Reconstruction☆38Updated last year