sunshangquan / logit-standardization-KD
[CVPR 2024 Highlight] Logit Standardization in Knowledge Distillation
☆373Updated 7 months ago
Alternatives and similar repositories for logit-standardization-KD
Users that are interested in logit-standardization-KD are comparing it to the libraries listed below
Sorting:
- Collection of awesome parameter-efficient fine-tuning resources.☆550Updated last month
- MoH: Multi-Head Attention as Mixture-of-Head Attention☆240Updated 6 months ago
- A Unified Parameter-Efficient Transfer Learning Benchmark for Computer Vision Tasks☆274Updated 8 months ago
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆122Updated last year
- Pytorch Implementation of "Sinkhorn Distance Minimization for Knowledge Distillation", COLING 2024 and TNNLS 2024☆121Updated 3 weeks ago
- [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"☆173Updated 5 months ago
- This repository is the official implementation of "DTL: Disentangled Transfer Learning for Visual Recognition", which is accepted by AAAI…☆111Updated last year
- A curated list of research based on CLIP.☆217Updated 6 months ago
- [CVPR2023 Highlight] Consistent-Teacher: Towards Reducing Inconsistent Pseudo-targets in Semi-supervised Object Detection☆305Updated last year
- This is an official PyTorch implementation for "MuSc : Zero-Shot Industrial Anomaly Classification and Segmentation with Mutual Scoring o…☆377Updated last year
- Code for 'Multi-level Logit Distillation' (CVPR2023)☆63Updated 7 months ago
- CVPR 2023, Class Attention Transfer Based Knowledge Distillation☆44Updated last year
- 'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)☆228Updated last year
- [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts☆217Updated 7 months ago
- [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".☆94Updated 2 years ago
- ☆156Updated last year
- [CVPR'24] DuPL: Dual Student with Trustworthy Progressive Learning for Robust Weakly Supervised Semantic Segmentation.☆79Updated 11 months ago
- [ECCV 2022] Patch Similarity Aware Data-Free Quantization for Vision Transformers☆123Updated 2 years ago
- Pytorch implementation for CVPR 2023 paper "Fine-Grianed Classification with Noisy Labels".☆31Updated 11 months ago
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆148Updated 2 years ago
- Official code for TPAMI2024 paper: Pixel Distillation: Cost-flexible Distillation across Image Sizes and Heterogeneous Networks☆58Updated 3 weeks ago
- [CVPR-2024] Official implementations of CLIP-KD: An Empirical Study of CLIP Model Distillation☆111Updated 10 months ago
- [CVPR2023 Highlight] GRES: Generalized Referring Expression Segmentation☆695Updated last year
- ☆400Updated 9 months ago
- Knowledge Amalgamation, Multi-teacher KD, Ensemble KD☆10Updated 3 years ago
- PyTorch implementation of the paper : Exploring Regional Clues in CLIP for Zero-Shot Semantic Segmentation.☆49Updated 10 months ago
- The official implementation of Achieving Cross Modal Generalization with Multimodal Unified Representation (NeurIPS '23)☆217Updated 4 months ago
- The official implementation for paper: Improving Knowledge Distillation via Regularizing Feature Norm and Direction☆19Updated last year
- Official PyTorch implementation of "Multi-modal Queried Object Detection in the Wild" (accepted by NeurIPS 2023)☆335Updated last year
- [CVPR 2023 (Highlight)] Offical implementation of the paper "RepMode: Learning to Re-parameterize Diverse Experts for Subcellular Structu…☆169Updated last year