Alternatives and similar repositories for ViT-Slim:

Users that are interested in ViT-Slim are comparing it to the libraries listed below

• sdc17 / UPop
  [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
  ☆101Updated 3 months ago
• magic-research / Dataset_Quantization
  [ICCV2023] Dataset Quantization
  ☆259Updated last year
• OscarXZQ / weight-selection
  ☆179Updated 6 months ago
• dongzelian / SSF
  [NeurIPS'22] This is an official implementation for "Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning".
  ☆180Updated last year
• ziplab / SN-Net
  [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".
  ☆248Updated 2 years ago
• NVlabs / A-ViT
  Official PyTorch implementation of A-ViT: Adaptive Tokens for Efficient Vision Transformer (CVPR 2022)
  ☆154Updated 2 years ago
• ylsung / Ladder-Side-Tuning
  PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"
  ☆235Updated 2 years ago
• NUS-HPC-AI-Lab / InfoBatch
  Lossless Training Speed Up by Unbiased Dynamic Data Pruning
  ☆333Updated 7 months ago
• fundamentalvision / Uni-Perceiver
  ☆274Updated 2 years ago
• BAAI-DCAI / Dataset-Pruning
  Dataset pruning for ImageNet and LAION-2B.
  ☆78Updated 9 months ago
• ZhangYuanhan-AI / NOAH
  [TPAMI] Searching prompt modules for parameter-efficient transfer learning.
  ☆228Updated last year
• amazon-science / prompt-pretraining
  Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"
  ☆258Updated 11 months ago
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆283Updated 3 weeks ago
• OpenGVLab / DiffRate
  [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…
  ☆94Updated last year
• UMass-Embodied-AGI / Mod-Squad
  ☆86Updated 2 years ago
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆190Updated last year
• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆105Updated last year
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆243Updated last year
• LAION-AI / scaling-laws-openclip
  Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)
  ☆164Updated last year
• LeapLabTHU / Deep-Incubation
  Code release for Deep Incubation (https://arxiv.org/abs/2212.04129)
  ☆90Updated 2 years ago
• haochengxi / Train_Transformers_with_INT4
  ☆147Updated last year
• LeapLabTHU / EfficientTrain
  1.5−3.0× lossless training or pre-training speedup. An off-the-shelf, easy-to-implement algorithm for the efficient training of foundatio…
  ☆221Updated 8 months ago
• kyegomez / AttentionIsOFFByOne
  Implementation of "Attention Is Off By One" by Evan Miller
  ☆190Updated last year
• ggjy / DeLVM
  ☆116Updated 10 months ago
• yzd-v / cls_KD
  'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)
  ☆228Updated last year
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆123Updated 11 months ago
• wutaiqiang / MoSLoRA
  ☆99Updated 9 months ago
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆163Updated 10 months ago
• LightDXY / FT-CLIP
  CLIP Itself is a Strong Fine-tuner: Achieving 85.7% and 88.0% Top-1 Accuracy with ViT-B and ViT-L on ImageNet
  ☆213Updated 2 years ago
• kyegomez / NaViT
  My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
  ☆228Updated 2 weeks ago