Alternatives and similar repositories for Knowledge-Distillation-Paper

Users that are interested in Knowledge-Distillation-Paper are comparing it to the libraries listed below

• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆99Updated 3 years ago
• lgcnsai / PS-KD-Pytorch
  Official PyTorch implementation of PS-KD
  ☆88Updated 3 years ago
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆67Updated 10 months ago
• snu-mllab / Efficient-Dataset-Condensation
  Official PyTorch implementation of "Dataset Condensation via Efficient Synthetic-Data Parameterization" (ICML'22)
  ☆113Updated last year
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆148Updated 2 years ago
• clovaai / attention-feature-distillation
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆118Updated 4 years ago
• JinXins / Adversarial-AutoMixup
  Official PyTorch(MMCV) implementation of “Adversarial AutoMixup” (ICLR 2024 spotlight)
  ☆69Updated 9 months ago
• AngusDujw / FTD-distillation
  The code of the paper "Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation" (CVPR2023)
  ☆40Updated 2 years ago
• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆75Updated last year
• hunto / DiffKD
  Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023
  ☆88Updated last year
• Yanqing0327 / DREAM
  Efficient Dataset Distillation by Representative Matching
  ☆112Updated last year
• zju-vipa / CMI
  [IJCAI-2021] Contrastive Model Inversion for Data-Free Knowledge Distillation
  ☆72Updated 3 years ago
• Huage001 / DatasetFactorization
  PyTorch implementation of paper "Dataset Distillation via Factorization" in NeurIPS 2022.
  ☆66Updated 2 years ago
• changdaeoh / BlackVIP
  Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"
  ☆111Updated last year
• lliai / Awesome-Vision-Knowledge-Distillation
  Awesome Knowledge-Distillation for CV
  ☆88Updated last year
• zhengli97 / CTKD
  [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"
  ☆176Updated 8 months ago
• KaihuaTang / Generalized-Long-Tailed-Benchmarks.pytorch
  [ECCV 2022] A generalized long-tailed challenge that incorporates both the conventional class-wise imbalance and the overlooked attribute…
  ☆126Updated 11 months ago
• VILA-Lab / SRe2L
  (NeurIPS 2023 spotlight) Large-scale Dataset Distillation/Condensation, 50 IPC (Images Per Class) achieves the highest 60.8% on original …
  ☆129Updated 8 months ago
• MattWallingford / TAPS
  Pytorch Implementation of Task Adaptive Parameter Sharing for Multi-Task Learning (CVPR 2022)
  ☆26Updated 2 years ago
• Mi-Peng / Sparse-Sharpness-Aware-Minimization
  [NeurIPS 2022] Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach -- Official Implementation
  ☆45Updated 2 years ago
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆179Updated 3 years ago
• lliai / LoRA-Zoo
  Awesome-Low-Rank-Adaptation
  ☆115Updated 9 months ago
• mr-eggplant / SAR
  Code for ICLR 2023 paper (Oral) — Towards Stable Test-Time Adaptation in Dynamic Wild World
  ☆191Updated last year
• megvii-research / TPS-CVPR2023
  ☆47Updated last year
• eric-ai-lab / PEViT
  Official implementation of AAAI 2023 paper "Parameter-efficient Model Adaptation for Vision Transformers"
  ☆105Updated last year
• zju-vipa / Fast-Datafree
  [AAAI-2022] Up to 100x Faster Data-free Knowledge Distillation
  ☆72Updated 2 years ago
• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆107Updated 2 years ago
• mr-eggplant / EATA
  Code for ICML 2022 paper — Efficient Test-Time Model Adaptation without Forgetting
  ☆128Updated 2 years ago
• MingSun-Tse / Good-DA-in-KD
  [NeurIPS'22] What Makes a "Good" Data Augmentation in Knowledge Distillation -- A Statistical Perspective
  ☆37Updated 2 years ago
• scok30 / MAE-CIL
  Official implementation of the paper "Masked Autoencoders are Efficient Class Incremental Learners"
  ☆42Updated last year