Alternatives and similar repositories for RLD:

Users that are interested in RLD are comparing it to the libraries listed below

• OSVAI / NORM
  The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…
  ☆20Updated last year
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆60Updated 6 months ago
• Ackesnal / GTP-ViT
  This is the official code for paper: Token Summarisation for Efficient Vision Transformers via Graph-based Token Propagation
  ☆27Updated last year
• Hao840 / manifold-distillation
  Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.
  ☆32Updated 2 years ago
• scale-lab / MTLoRA
  The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)
  ☆44Updated 2 weeks ago
• xjwu1024 / PPT
  The codebase for paper "PPT: Token Pruning and Pooling for Efficient Vision Transformer"
  ☆21Updated 4 months ago
• chenyd7 / PEFD
  [NeurIPS'22] Projector Ensemble Feature Distillation
  ☆29Updated last year
• leo-yangli / VB-LoRA
  This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).
  ☆37Updated 5 months ago
• ziplab / SPT
  [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.
  ☆66Updated last year
• ismail31416 / LumiNet
  The official implementation of LumiNet: The Bright Side of Perceptual Knowledge Distillation https://arxiv.org/abs/2310.03669
  ☆19Updated last year
• Daner-Wang / VTC-LFC
  ☆26Updated 2 years ago
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆29Updated 5 months ago
• lliai / DisWOT-CVPR2023
  ☆25Updated last year
• OSVAI / SSD-KD
  The official project website of "Small Scale Data-Free Knowledge Distillation" (SSD-KD for short, published in CVPR 2024).
  ☆17Updated 9 months ago
• runtsang / VFPT
  Official implementation of NeurIPS 2024 "Visual Fourier Prompt Tuning"
  ☆27Updated 2 months ago
• OpenGVLab / LLMPrune-BESA
  BESA is a differentiable weight pruning technique for large language models.
  ☆14Updated last year
• GATECH-EIC / Castling-ViT
  [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference
  ☆29Updated last year
• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated 2 years ago
• roymiles / ITRD
  [BMVC 2022] Information Theoretic Representation Distillation
  ☆18Updated last year
• roymiles / VkD
  [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections
  ☆50Updated 5 months ago
• Xingyu-Zheng / BinaryDM
  (ICLR 2025) BinaryDM: Accurate Weight Binarization for Efficient Diffusion Models
  ☆18Updated 5 months ago
• megvii-research / TPS-CVPR2023
  ☆43Updated last year
• GzyAftermath / CAT-KD
  CVPR 2023, Class Attention Transfer Based Knowledge Distillation
  ☆41Updated last year
• AtsuMiyai / GL-MCM
  [IJCV2025] https://arxiv.org/abs/2304.04521
  ☆11Updated 2 months ago
• SLDGroup / GradientFilter-CVPR23
  ☆12Updated last year
• IemProg / MiMi
  🔥 🔥 [WACV2024] Mini but Mighty: Finetuning ViTs with Mini Adapters
  ☆18Updated 8 months ago
• shicaiwei123 / SDD-CVPR2024
  Official code for Scale Decoupled Distillation
  ☆40Updated 11 months ago
• LukasHedegaard / structured-pruning-adapters
  Structured Pruning Adapters in PyTorch
  ☆16Updated last year
• uzh-rpg / svit
  Official implementation of "SViT: Revisiting Token Pruning for Object Detection and Instance Segmentation"
  ☆29Updated last year
• fistyee / MixPro
  🔥MixPro: Data Augmentation with MaskMix and Progressive Attention Labeling for Vision Transformer [Official, ICLR 2023]
  ☆22Updated last year