VITA-Group / ViT-Anti-Oversmoothing

Related projects ⓘ

Alternatives and complementary repositories for ViT-Anti-Oversmoothing

• sndnyang / Diffusion_ViT
  PyTorch Implementation of "Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model"
  ☆48Updated last year
• IBM / RegionViT
  open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689
  ☆51Updated 2 years ago
• jiawangbai / HAT
  Implementation of HAT https://arxiv.org/pdf/2204.00993
  ☆47Updated 7 months ago
• quanlin-wu / dmae
  Denoising Masked Autoencoders Help Robust Classification.
  ☆60Updated last year
• Jiahao000 / MFM
  [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training
  ☆68Updated last year
• roymiles / VkD
  [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections
  ☆47Updated last month
• ziplab / EcoFormer
  [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"
  ☆66Updated 2 years ago
• shoaibahmed / blockwise_ssl
  Repository containing code for blockwise SSL training
  ☆27Updated last month
• ziyuwwang / DynaMixer
  ☆27Updated 2 years ago
• CoinCheung / MFM
  code for paper "Masked Frequency Modeling for Self-Supervised Visual Pre-Training" (https://arxiv.org/pdf/2206.07706.pdf)
  ☆24Updated last year
• enyac-group / supmae
  This is a offical PyTorch/GPU implementation of SupMAE.
  ☆77Updated 2 years ago
• princeton-vl / Oriented1D
  Official code for ICCV 2023 paper "Convolutional Networks with Oriented 1D Kernels"
  ☆46Updated 9 months ago
• CrossmodalGroup / MaskedVectorQuantization
  Official Pytorch Implementation of Our CVPR2023 Paper: "Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image…
  ☆52Updated last year
• OliverRensu / ARM
  This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision
  ☆64Updated 5 months ago
• raoyongming / AMixer
  [ECCV 2022] AMixer: Adaptive Weight Mixing for Self-attention Free Vision Transformers
  ☆28Updated 2 years ago
• ziplab / LIT
  [AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"
  ☆92Updated 2 years ago
• Jack-Etheredge / early_convolutions_vit_pytorch
  (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better
  ☆43Updated 3 years ago
• ashleylqx / AIB
  Information Bottleneck Approach to Spatial Attention Learning, IJCAI2021
  ☆14Updated 3 years ago
• ggjy / Hire-Wave-MLP.pytorch
  Implementation of Hire-MLP: Vision MLP via Hierarchical Rearrangement and An Image Patch is a Wave: Phase-Aware Vision MLP.
  ☆33Updated 2 years ago
• ofsoundof / LocalViT
  ☆112Updated 2 years ago
• okojoalg / raft-mlp
  ☆25Updated 2 years ago
• zhangq327 / U-MAE
  Official Code for NeurIPS 2022 Paper: How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders
  ☆55Updated last year
• wyzjack / AdaM3
  [ICDM 2023] Momentum is All You Need for Data-Driven Adaptive Optimization
  ☆23Updated 7 months ago
• MinaGhadimiAtigh / HyperbolicImageSegmentation
  Hyperbolic Image Segmentation, CVPR 2022
  ☆76Updated 2 years ago
• ChenMnZ / CF-ViT
  (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"
  ☆101Updated last year
• Haochen-Wang409 / HPM
  [CVPR'23] Hard Patches Mining for Masked Image Modeling
  ☆88Updated 10 months ago
• junchen14 / LoMaR
  LoMaR (Efficient Self-supervised Vision Pretraining with Local Masked Reconstruction)
  ☆61Updated 2 years ago
• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆99Updated last year
• liuxingbin / dbot
  [ICLR2024] Exploring Target Representations for Masked Autoencoders
  ☆51Updated 10 months ago
• oppo-us-research / FA-VAE
  Description： Frequency Augmented Variational Autoencoder for better Image Reconstruction
  ☆31Updated last year