Alternatives and similar repositories for Simple-Recipe-Distillation:

Users that are interested in Simple-Recipe-Distillation are comparing it to the libraries listed below

• WangYZ1608 / Knowledge-Distillation-via-ND
  The official implementation for paper: Improving Knowledge Distillation via Regularizing Feature Norm and Direction
  ☆14Updated last year
• hunto / DiffKD
  Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023
  ☆79Updated 11 months ago
• roymiles / VkD
  [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections
  ☆50Updated 2 months ago
• JieShibo / PETL-ViT
  [ICCV 2023 & AAAI 2023] Binary Adapters & FacT, [Tech report] Convpass
  ☆175Updated last year
• Haochen-Wang409 / DropPos
  [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions
  ☆59Updated 8 months ago
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆59Updated 3 months ago
• zhangxiaosong18 / hivit
  ☆58Updated last year
• ziplab / SPT
  [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.
  ☆65Updated last year
• GzyAftermath / CAT-KD
  CVPR 2023, Class Attention Transfer Based Knowledge Distillation
  ☆37Updated last year
• Zzzzz1 / CSKD
  Official code for Cumulative Spatial Knowledge Distillation for Vision Transformers (ICCV-2023) https://openaccess.thecvf.com/content/ICC…
  ☆15Updated last year
• JoakimHaurum / ATC
  Official PyTorch implementation of Agglomerative Token Clustering presented at ECCV 2024
  ☆13Updated 4 months ago
• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆103Updated last year
• YuqiYang213 / MLoRE
  Project Page for "Multi-Task Dense Prediction via Mixture of Low-Rank Experts"
  ☆60Updated 3 weeks ago
• JoakimHaurum / TokenReduction
  Official PyTorch implementation of Which Tokens to Use? Investigating Token Reduction in Vision Transformers presented at ICCV 2023 NIVT …
  ☆33Updated last year
• shicaiwei123 / SDD-CVPR2024
  Official code for Scale Decoupled Distillation
  ☆37Updated 9 months ago
• MengLcool / AdaViT
  [CVPR-22] This is the official implementation of the paper "Adavit: Adaptive vision transformers for efficient image recognition".
  ☆50Updated 2 years ago
• adaptivetokensampling / ATS
  Adaptive Token Sampling for Efficient Vision Transformers (ECCV 2022 Oral Presentation)
  ☆97Updated 8 months ago
• VainF / Isomorphic-Pruning
  [ECCV 2024] Isomorphic Pruning for Vision Models
  ☆61Updated 5 months ago
• wangf3014 / Mamba-Reg
  ☆54Updated 7 months ago
• THU-MIG / Consolidator
  Official implementation for ICLR 2023 paper Consolidator: Mergeable Adapter with Grouped Connections for Visual Adaptation
  ☆16Updated 11 months ago
• pengzhiliang / G2SD
  ☆83Updated last year
• YBZh / DMN
  CVPR2024: Dual Memory Networks: A Versatile Adaptation Approach for Vision-Language Models
  ☆68Updated 6 months ago
• ChenhongyiYang / PlainMamba
  [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition
  ☆71Updated 5 months ago
• zhengli97 / DM-KD
  Official PyTorch Code for "Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?" (https://arxiv.org/abs/2305.12954)
  ☆46Updated last year
• OliverRensu / ARM
  This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision
  ☆68Updated 7 months ago
• Jiahao000 / MFM
  [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training
  ☆68Updated last year
• visinf / adapter_plus
  [CVPR 2024] Official implementation of "Adapters Strike Back"
  ☆34Updated 5 months ago
• Hao840 / OFAKD
  PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444
  ☆108Updated 9 months ago
• rayleizhu / GLMix
  [NeurIPS 2024] official code release for our paper "Revisiting the Integration of Convolution and Attention for Vision Backbone".
  ☆31Updated last month