JiamingLv / WKDLinks
The offical implementation of [NeurIPS2024] Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation https://arxiv.org/abs/2412.08139
☆49Updated last year
Alternatives and similar repositories for WKD
Users that are interested in WKD are comparing it to the libraries listed below
Sorting:
- [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆57Updated last year
- Official code for Scale Decoupled Distillation☆43Updated last year
- Code for 'Multi-level Logit Distillation' (CVPR2023)☆71Updated last year
- Official PyTorch(MMCV) implementation of “Adversarial AutoMixup” (ICLR 2024 spotlight)☆71Updated last year
- The official implementation for ALOFT (CVPR 2023).☆57Updated 2 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆87Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆154Updated 3 years ago
- [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training☆80Updated 2 years ago
- The official codes of our CVPR-2023 paper: Sharpness-Aware Gradient Matching for Domain Generalization☆78Updated 2 years ago
- Pytorch implementation of Split to Merge: Unifying Separated Modalities for Unsupervised Domain Adaptation (CVPR'24)☆35Updated 3 months ago
- (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"☆106Updated 2 years ago
- Official implementation for "Knowledge Distillation with Refined Logits".☆21Updated last year
- Switchable Online Knowledge Distillation☆19Updated last year
- ☆35Updated last year
- Official code release of our paper "FViT: A Focal Vision Transformer with Gabor Filter"☆19Updated 5 months ago
- Convolutional Initialization for Data-Efficient Vision Transformers☆16Updated last month
- The offical implement of ImbSAM (Imbalanced-SAM)☆25Updated last year
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆135Updated last year
- Implementation of HAT https://arxiv.org/pdf/2204.00993☆51Updated last year
- This is an official implementation of our NeurIPS 2022 paper "Bridging the Gap Between Vision Transformers and Convolutional Neural Netwo…☆62Updated 5 months ago
- ☆27Updated 3 years ago
- Codes for ECCV2022 paper - contrastive deep supervision☆69Updated 3 years ago
- Official PyTorch implementation of PS-KD☆89Updated 3 years ago
- ☆28Updated 2 years ago
- [CVPR 2023 Highlight] Masked Image Modeling with Local Multi-Scale Reconstruction☆55Updated 2 years ago
- ☆48Updated 2 years ago
- ☆15Updated last year
- [AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"☆97Updated 3 years ago
- This is the official code for paper: Token Summarisation for Efficient Vision Transformers via Graph-based Token Propagation☆32Updated 2 years ago
- Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023☆94Updated 2 years ago