sunshangquan / logit-standardization-KD
[CVPR 2024 Highlight] Logit Standardization in Knowledge Distillation
☆362Updated 5 months ago
Alternatives and similar repositories for logit-standardization-KD:
Users that are interested in logit-standardization-KD are comparing it to the libraries listed below
- Collection of awesome parameter-efficient fine-tuning resources.☆530Updated last week
- A Unified Parameter-Efficient Transfer Learning Benchmark for Computer Vision Tasks☆274Updated 7 months ago
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆230Updated 5 months ago
- A curated list of research based on CLIP.☆193Updated 4 months ago
- This repository is the official implementation of "DTL: Disentangled Transfer Learning for Visual Recognition", which is accepted by AAAI…☆105Updated last year
- Pytorch Implementation of "Sinkhorn Distance Minimization for Knowledge Distillation", COLING 2024 and TNNLS 2024☆120Updated 3 weeks ago
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆117Updated 11 months ago
- [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"☆167Updated 3 months ago
- [ECCV 2022] Patch Similarity Aware Data-Free Quantization for Vision Transformers☆122Updated 2 years ago
- Code for 'Multi-level Logit Distillation' (CVPR2023)☆60Updated 6 months ago
- 'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)☆225Updated last year
- [CVPR2023 Highlight] Consistent-Teacher: Towards Reducing Inconsistent Pseudo-targets in Semi-supervised Object Detection☆299Updated last year
- The official implementation of Achieving Cross Modal Generalization with Multimodal Unified Representation (NeurIPS '23)☆216Updated 3 months ago
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆141Updated 2 years ago
- ☆152Updated last year
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆197Updated 5 months ago
- ☆395Updated 8 months ago
- This is an official PyTorch implementation for "MuSc : Zero-Shot Industrial Anomaly Classification and Segmentation with Mutual Scoring o…☆372Updated 11 months ago
- [CVPR'24] Official implementation of paper "FreeKD: Knowledge Distillation via Semantic Frequency Prompt".☆41Updated 11 months ago
- CVPR 2023, Class Attention Transfer Based Knowledge Distillation☆41Updated last year
- [CVPR 2024] Official PyTorch Code for "PromptKD: Unsupervised Prompt Distillation for Vision-Language Models"☆284Updated last week
- Official code for TPAMI2024 paper: Pixel Distillation: Cost-flexible Distillation across Image Sizes and Heterogeneous Networks☆56Updated 4 months ago
- [CVPR'24] DuPL: Dual Student with Trustworthy Progressive Learning for Robust Weakly Supervised Semantic Segmentation.☆78Updated 9 months ago
- [CVPR2023 Highlight] GRES: Generalized Referring Expression Segmentation☆692Updated last year
- [ICCV 2023 & AAAI 2023] Binary Adapters & FacT, [Tech report] Convpass☆179Updated last year
- [CVPR-2024] Official implementations of CLIP-KD: An Empirical Study of CLIP Model Distillation☆104Updated 8 months ago
- Pytorch implementation for CVPR 2023 paper "Fine-Grianed Classification with Noisy Labels".☆30Updated 9 months ago
- [ECCV 2024] Histoformer: Restoring Images in Adverse Weather Conditions via Histogram Transformer☆174Updated 5 months ago
- [CVPR 2024] "MACE: Mass Concept Erasure in Diffusion Models" (Official Implementation)☆392Updated 2 weeks ago
- Official implement for ICML2023 paper: "A Closer Look at Self-Supervised Lightweight Vision Transformers"☆126Updated 3 weeks ago