Alternatives and similar repositories for ViT-Slim:

Users that are interested in ViT-Slim are comparing it to the libraries listed below

• sdc17 / UPop
  [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
  ☆101Updated 2 months ago
• OscarXZQ / weight-selection
  ☆179Updated 5 months ago
• dongzelian / SSF
  [NeurIPS'22] This is an official implementation for "Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning".
  ☆177Updated last year
• ylsung / Ladder-Side-Tuning
  PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"
  ☆234Updated 2 years ago
• OpenGVLab / DiffRate
  [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…
  ☆94Updated last year
• NVlabs / A-ViT
  Official PyTorch implementation of A-ViT: Adaptive Tokens for Efficient Vision Transformer (CVPR 2022)
  ☆153Updated 2 years ago
• ziplab / SN-Net
  [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".
  ☆249Updated last year
• fundamentalvision / Uni-Perceiver
  ☆272Updated 2 years ago
• ZhangYuanhan-AI / NOAH
  [TPAMI] Searching prompt modules for parameter-efficient transfer learning.
  ☆227Updated last year
• magic-research / Dataset_Quantization
  [ICCV2023] Dataset Quantization
  ☆258Updated last year
• amazon-science / prompt-pretraining
  Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"
  ☆257Updated 10 months ago
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆189Updated last year
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆123Updated 10 months ago
• VITA-Group / UVC
  [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…
  ☆52Updated last year
• LijieFan / LaCLIP
  [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"
  ☆271Updated last year
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆163Updated 9 months ago
• QingruZhang / AdaLoRA
  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
  ☆309Updated last year
• LeapLabTHU / Deep-Incubation
  Code release for Deep Incubation (https://arxiv.org/abs/2212.04129)
  ☆90Updated 2 years ago
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆243Updated last year
• kyegomez / NaViT
  My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
  ☆224Updated last month
• kyegomez / AttentionIsOFFByOne
  Implementation of "Attention Is Off By One" by Evan Miller
  ☆190Updated last year
• LightDXY / FT-CLIP
  CLIP Itself is a Strong Fine-tuner: Achieving 85.7% and 88.0% Top-1 Accuracy with ViT-B and ViT-L on ImageNet
  ☆213Updated 2 years ago
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆270Updated 11 months ago
• wutaiqiang / MoSLoRA
  ☆100Updated 8 months ago
• youweiliang / evit
  Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations
  ☆178Updated last year
• transformer-vq / transformer_vq
  ☆189Updated last year
• ziqipang / LM4VisualEncoding
  [ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"
  ☆232Updated last year
• haochengxi / Train_Transformers_with_INT4
  ☆145Updated last year
• sdc17 / CrossGET
  [ICML 2024] CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers.
  ☆32Updated 2 months ago
• WoosukKwon / retraining-free-pruning
  [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers
  ☆181Updated 2 years ago