roymiles / ITRD
[BMVC 2022] Information Theoretic Representation Distillation
☆17Updated 11 months ago
Related projects: ⓘ
- [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…☆25Updated 2 years ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆19Updated last year
- Repo for the paper "Extrapolating from a Single Image to a Thousand Classes using Distillation"☆37Updated 2 months ago
- [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆39Updated 2 weeks ago
- Source code for the BMVC-2021 paper "SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation".☆17Updated 2 years ago
- ☆32Updated 2 years ago
- [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…☆40Updated last year
- [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.☆60Updated 11 months ago
- This repository contains the code for our CVPR 2022 paper on "Non-isotropy Regularization for Proxy-based Deep Metric Learning".☆14Updated last year
- [CVPR 2022] Official PyTorch implementation for Attributable Visual Similarity Learning☆33Updated last year
- ☆21Updated 2 years ago
- ISD: Self-Supervised Learning by Iterative Similarity Distillation☆35Updated 2 years ago
- Robustness via Cross-Domain Ensembles, ICCV 2021 [Oral]☆37Updated 2 years ago
- Official PyTorch Implementation of Self-Taught Metric Learning without Labels, CVPR 2022☆38Updated last year
- ☆34Updated last year
- SVL-Adapter: Self-Supervised Adapter for Vision-Language Pretrained Models☆20Updated 8 months ago
- [NeurIPS'22] What Makes a "Good" Data Augmentation in Knowledge Distillation -- A Statistical Perspective☆35Updated last year
- Official Pytorch Implementation of: "Semantic Diversity Learning for Zero-Shot Multi-label Classification"(ICCV, 2021) paper☆30Updated 2 years ago
- Pytorch Implementation of CLIP-Lite | Accepted at AISTATS 2023☆13Updated last year
- [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…☆23Updated last year
- Towards Unified and Effective Domain Generalization☆28Updated 9 months ago
- PyTorch implementation for our paper EvidentialMix: Learning with Combined Open-set and Closed-set Noisy Labels☆26Updated 3 years ago
- Code implementation for paper "On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals".☆16Updated 2 years ago
- Benchmarking Attention Mechanism in Vision Transformers.☆16Updated last year
- Official Code for NeurIPS 2022 Paper: How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders☆53Updated 10 months ago
- Repository containing code for blockwise SSL training☆27Updated last year
- This repo is the official megengine implementation of the ECCV2022 paper: Efficient One Pass Self-distillation with Zipf's Label Smoothin…☆25Updated last year
- [ECCV 2022] Tackling Long-Tailed Category Distribution Under Domain Shifts☆18Updated last year
- Self-Distillation with weighted ground-truth targets; ResNet and Kernel Ridge Regression☆17Updated 2 years ago
- [NeurIPS 2021] “Improving Contrastive Learning on Imbalanced Data via Open-World Sampling”, Ziyu Jiang, Tianlong Chen, Ting Chen, Zhangya…☆27Updated 2 years ago