VITA-Group / ViT-Anti-Oversmoothing

[ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang Wang
80Updated last year

Alternatives and similar repositories for ViT-Anti-Oversmoothing:

Users that are interested in ViT-Anti-Oversmoothing are comparing it to the libraries listed below