Alternatives and similar repositories for RLD:

Users that are interested in RLD are comparing it to the libraries listed below

• OSVAI / NORM
  The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…
  ☆20Updated last year
• Hao840 / manifold-distillation
  Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.
  ☆32Updated 2 years ago
• scale-lab / MTLoRA
  The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)
  ☆45Updated last month
• Daner-Wang / VTC-LFC
  ☆26Updated 2 years ago
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆63Updated 6 months ago
• lliai / DisWOT-CVPR2023
  ☆26Updated last year
• OpenGVLab / LLMPrune-BESA
  BESA is a differentiable weight pruning technique for large language models.
  ☆16Updated last year
• Ackesnal / GTP-ViT
  This is the official code for paper: Token Summarisation for Efficient Vision Transformers via Graph-based Token Propagation
  ☆27Updated last year
• jiachenzhu / VCR
  Variance Covariance Regularization
  ☆14Updated last year
• chenyd7 / PEFD
  [NeurIPS'22] Projector Ensemble Feature Distillation
  ☆29Updated last year
• roymiles / VkD
  [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections
  ☆52Updated 5 months ago
• ismail31416 / LumiNet
  The official implementation of LumiNet: The Bright Side of Perceptual Knowledge Distillation https://arxiv.org/abs/2310.03669
  ☆19Updated last year
• GzyAftermath / CAT-KD
  CVPR 2023, Class Attention Transfer Based Knowledge Distillation
  ☆43Updated last year
• AtsuMiyai / GL-MCM
  [IJCV2025] https://arxiv.org/abs/2304.04521
  ☆14Updated 2 months ago
• runtsang / VFPT
  Official implementation of NeurIPS 2024 "Visual Fourier Prompt Tuning"
  ☆26Updated 3 months ago
• roymiles / ITRD
  [BMVC 2022] Information Theoretic Representation Distillation
  ☆18Updated last year
• leo-yangli / VB-LoRA
  This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).
  ☆37Updated 6 months ago
• fistyee / MixPro
  🔥MixPro: Data Augmentation with MaskMix and Progressive Attention Labeling for Vision Transformer [Official, ICLR 2023]
  ☆22Updated last year
• VITA-Group / Diverse-ViT
  [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…
  ☆25Updated 3 years ago
• IemProg / MiMi
  🔥 🔥 [WACV2024] Mini but Mighty: Finetuning ViTs with Mini Adapters
  ☆20Updated 9 months ago
• ziplab / SPT
  [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.
  ☆67Updated last year
• hikvision-research / SAViT
  ☆12Updated last year
• OSVAI / SSD-KD
  The official project website of "Small Scale Data-Free Knowledge Distillation" (SSD-KD for short, published in CVPR 2024).
  ☆17Updated 10 months ago
• Xingyu-Zheng / BinaryDM
  (ICLR 2025) BinaryDM: Accurate Weight Binarization for Efficient Diffusion Models
  ☆19Updated 6 months ago
• xjwu1024 / PPT
  The codebase for paper "PPT: Token Pruning and Pooling for Efficient Vision Transformer"
  ☆22Updated 5 months ago
• GATECH-EIC / Castling-ViT
  [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference
  ☆30Updated last year
• megvii-research / TPS-CVPR2023
  ☆44Updated last year
• zstarN70 / RLRR
  Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach, CVPR 2024
  ☆20Updated 8 months ago
• blackfeather-wang / Dynamic-Vision-Transformer-MindSpore
  ☆22Updated 3 years ago
• ylsung / ECoFLaP
  Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)
  ☆19Updated last year