roymiles / Simple-Recipe-Distillation

Related projects: ⓘ

• hunto / DiffKD
  Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023
  ☆72Updated 7 months ago
• roymiles / vkd
  [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections
  ☆39Updated 2 weeks ago
• JieShibo / PETL-ViT
  [ICCV 2023] Binary Adapters, [AAAI 2023] FacT, [Tech report] Convpass
  ☆167Updated last year
• ziplab / SPT
  [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.
  ☆60Updated 11 months ago
• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆97Updated last year
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆49Updated last year
• MengLcool / AdaViT
  Official implementation of AdaViT
  ☆48Updated 2 years ago
• OpenGVLab / DiffRate
  [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…
  ☆85Updated last year
• adaptivetokensampling / ATS
  Adaptive Token Sampling for Efficient Vision Transformers (ECCV 2022 Oral Presentation)
  ☆90Updated 4 months ago
• shicaiwei123 / SDD-CVPR2024
  Official code for Scale Decoupled Distillation
  ☆29Updated 5 months ago
• Haochen-Wang409 / DropPos
  [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions
  ☆59Updated 4 months ago
• OliverRensu / ARM
  This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision
  ☆53Updated 3 months ago
• zhangxiaosong18 / hivit
  ☆55Updated last year
• Zzzzz1 / CSKD
  Official code for Cumulative Spatial Knowledge Distillation for Vision Transformers (ICCV-2023) https://openaccess.thecvf.com/content/ICC…
  ☆13Updated 10 months ago
• winycg / CLIP-KD
  [CVPR-2024] Official implementations of CLIP-KD: An Empirical Study of CLIP Model Distillation
  ☆57Updated 2 months ago
• scok30 / MAE-CIL
  Official implementation of the paper "Masked Autoencoders are Efficient Class Incremental Learners"
  ☆36Updated 3 months ago
• vimar-gu / MinimaxDiffusion
  [CVPR2024] Efficient Dataset Distillation via Minimax Diffusion
  ☆70Updated 5 months ago
• VainF / Isomorphic-Pruning
  [ECCV 2024] Isomorphic Pruning for Vision Models
  ☆46Updated last month
• DongSky / LPT
  ☆49Updated last year
• Jasonlee1995 / ImageNet-1K
  ImageNet-1K data download, processing for using as a dataset
  ☆55Updated last year
• WangYZ1608 / Knowledge-Distillation-via-ND
  The official implementation for paper: Improving Knowledge Distillation via Regularizing Feature Norm and Direction
  ☆3Updated last year
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆133Updated last year
• JoakimHaurum / TokenReduction
  Official PyTorch implementation of Which Tokens to Use? Investigating Token Reduction in Vision Transformers presented at ICCV 2023 NIVT …
  ☆29Updated last year
• guijiejie / AMT
  ☆22Updated last year
• YuqiYang213 / MLoRE
  Project Page for "Multi-Task Dense Prediction via Mixture of Low-Rank Experts"
  ☆48Updated 4 months ago
• JinXins / Adversarial-AutoMixup
  Official PyTorch(MMCV) implementation of “Adversarial AutoMixup” (ICLR 2024 spotlight)
  ☆54Updated 2 weeks ago
• GzyAftermath / CAT-KD
  CVPR 2023, Class Attention Transfer Based Knowledge Distillation
  ☆32Updated last year
• pengzhiliang / G2SD
  ☆79Updated last year
• GATECH-EIC / Castling-ViT
  [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference
  ☆25Updated 6 months ago
• Yangsenqiao / vida
  [ICLR 2024] ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptation
  ☆49Updated 4 months ago