Alternatives and similar repositories for vit-finetune

Users that are interested in vit-finetune are comparing it to the libraries listed below

• MohammadrezaBanaei / LoRA-XS
  LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
  ☆45Updated 4 months ago
• lliai / Awesome-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆124Updated last year
• calpt / awesome-adapter-resources
  Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
  ☆201Updated last year
• gstoica27 / ZipIt
  A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…
  ☆308Updated last year
• jianghaojun / Awesome-Parameter-Efficient-Transfer-Learning
  A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.
  ☆409Updated last year
• eric-ai-lab / PEViT
  Official implementation of AAAI 2023 paper "Parameter-efficient Model Adaptation for Vision Transformers"
  ☆105Updated 2 years ago
• OPTML-Group / Robust-MoE-CNN
  [ICCV23] Robust Mixture-of-Expert Training for Convolutional Neural Networks by Yihua Zhang, Ruisi Cai, Tianlong Chen, Guanhua Zhang, Hua…
  ☆66Updated 2 years ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆94Updated last week
• TsinghuaC3I / SoRA
  [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆85Updated last year
• hananshafi / vits-for-small-scale-datasets
  [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"
  ☆166Updated 2 years ago
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆337Updated 8 months ago
• mlfoundations / model-soups
  Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
  ☆499Updated last year
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆138Updated 8 months ago
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆231Updated last month
• OscarXZQ / weight-selection
  ☆187Updated last year
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆72Updated 9 months ago
• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆81Updated 8 months ago
• aim-uofa / LoRAPrune
  ☆61Updated 11 months ago
• nblt / F-SAM
  [CVPR 2024] Friendly Sharpness-Aware Minimization
  ☆34Updated last year
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆97Updated last year
• neu-spiral / SparCL
  SparCL: Sparse Continual Learning on the Edge @ NeurIPS 22
  ☆30Updated 2 years ago
• QingruZhang / AdaLoRA
  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
  ☆363Updated 2 years ago
• sdc17 / UPop
  [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers
  ☆105Updated 11 months ago
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆235Updated last year
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆188Updated 2 years ago
• mlfoundations / task_vectors
  Editing Models with Task Arithmetic
  ☆518Updated last year
• gstoica27 / KnOTS
  Model Merging with SVD to Tie the KnOTS [ICLR 2025]
  ☆80Updated 8 months ago
• prateeky2806 / ties-merging
  ☆200Updated last year
• Baijiong-Lin / LoRA-Torch
  PyTorch Reimplementation of LoRA (featuring with supporting nn.MultiheadAttention in OpenCLIP)
  ☆73Updated 6 months ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆111Updated last week