Alternatives and similar repositories for ViT-Anti-Oversmoothing

Users that are interested in ViT-Anti-Oversmoothing are comparing it to the libraries listed below

• sndnyang / Diffusion_ViT
  PyTorch Implementation of "Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model"
  ☆49Updated 2 years ago
• quanlin-wu / dmae
  Denoising Masked Autoencoders Help Robust Classification.
  ☆67Updated 2 years ago
• IBM / RegionViT
  open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689
  ☆52Updated 3 years ago
• ziyuwwang / DynaMixer
  ☆27Updated 3 years ago
• enyac-group / supmae
  This is a offical PyTorch/GPU implementation of SupMAE.
  ☆78Updated 2 years ago
• karttikeya / minREV
  A simple minimal implementation of Reversible Vision Transformers
  ☆125Updated last year
• Jiahao000 / MFM
  [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training
  ☆77Updated 2 years ago
• rishikksh20 / ResMLP-pytorch
  ResMLP: Feedforward networks for image classification with data-efficient training
  ☆44Updated 4 years ago
• CownowAn / DaSS
  Official PyTorch implementation of "Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets" (ICLR 2023 notable top 25%)
  ☆24Updated last year
• BingSu12 / Log-Polar-Space-Convolution
  Log-Polar Space Convolution for Convolutional Neural Networks
  ☆12Updated 2 years ago
• zeke-xie / stable-weight-decay-regularization
  [NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.
  ☆60Updated last year
• okojoalg / raft-mlp
  ☆25Updated 3 years ago
• wyzjack / AdaM3
  [ICDM 2023] Momentum is All You Need for Data-Driven Adaptive Optimization
  ☆26Updated last year
• MinaGhadimiAtigh / HyperbolicImageSegmentation
  Hyperbolic Image Segmentation, CVPR 2022
  ☆88Updated 3 years ago
• zhangq327 / U-MAE
  Official Code for NeurIPS 2022 Paper: How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders
  ☆68Updated last year
• CoinCheung / MFM
  code for paper "Masked Frequency Modeling for Self-Supervised Visual Pre-Training" (https://arxiv.org/pdf/2206.07706.pdf)
  ☆24Updated 2 years ago
• VITA-Group / Sandwich-Batch-Normalization
  [WACV 2022] "Sandwich Batch Normalization: A Drop-In Replacement for Feature Distribution Heterogeneity" by Xinyu Gong, Wuyang Chen, Tian…
  ☆51Updated 3 years ago
• ziplab / LIT
  [AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"
  ☆97Updated 3 years ago
• roymiles / VkD
  [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections
  ☆55Updated 10 months ago
• ucasligang / SemMAE
  [NeurIPS 2022] code for the paper, SemMAE: Semantic-guided masking for learning masked autoencoders
  ☆38Updated 2 years ago
• singlasahil14 / SOC
  Code for the ICML 2021 and ICLR 2022 papers: Skew Orthogonal Convolutions, Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100
  ☆18Updated 3 years ago
• shlokk / HCL
  ☆49Updated 2 years ago
• Jack-Etheredge / early_convolutions_vit_pytorch
  (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better
  ☆43Updated 3 years ago
• VILA-Lab / i-mae
  i-mae Pytorch Repo
  ☆19Updated last year
• ashleylqx / AIB
  Information Bottleneck Approach to Spatial Attention Learning, IJCAI2021
  ☆15Updated 4 years ago
• jiawangbai / HAT
  Implementation of HAT https://arxiv.org/pdf/2204.00993
  ☆51Updated last year
• phibenz / robustness_comparison_vit_mlp-mixer_cnn
  ☆22Updated 3 years ago
• szq0214 / SReT
  Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"
  ☆65Updated 2 years ago
• PRIS-CV / AdvancedDropout
  Advanced Dropout: A Model-free Methodology for Bayesian Dropout Optimization (IEEE TPAMI 2021)
  ☆17Updated 4 years ago
• alihassanijr / TorchKMeans
  A torch-based implementation of K-Means and K-Means++
  ☆17Updated 4 years ago