zju-SWJ / RLD
Official implementation for "Knowledge Distillation with Refined Logits".
☆13Updated 8 months ago
Alternatives and similar repositories for RLD:
Users that are interested in RLD are comparing it to the libraries listed below
- Code for 'Multi-level Logit Distillation' (CVPR2023)☆63Updated 7 months ago
- Official code for Scale Decoupled Distillation☆41Updated last year
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Updated last year
- This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).☆37Updated 6 months ago
- [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference☆30Updated last year
- Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.☆32Updated 2 years ago
- This is the official code for paper: Token Summarisation for Efficient Vision Transformers via Graph-based Token Propagation☆27Updated last year
- ☆26Updated last year
- Official implementation of NeurIPS 2024 "Visual Fourier Prompt Tuning"☆26Updated 3 months ago
- BESA is a differentiable weight pruning technique for large language models.☆16Updated last year
- [NeurIPS2023]Lightweight Vision Transformer with Bidirectional Interaction☆23Updated last year
- ☆26Updated 2 years ago
- [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆53Updated 6 months ago
- The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)☆48Updated 2 months ago
- 🔥 🔥 [WACV2024] Mini but Mighty: Finetuning ViTs with Mini Adapters☆20Updated 10 months ago
- CVPR 2023, Class Attention Transfer Based Knowledge Distillation☆44Updated last year
- The codebase for paper "PPT: Token Pruning and Pooling for Efficient Vision Transformer"☆23Updated 5 months ago
- [BMVC 2022] Information Theoretic Representation Distillation☆18Updated last year
- [NeurIPS 2024] Search for Efficient LLMs☆13Updated 3 months ago
- [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models☆29Updated 7 months ago
- The official implementation of LumiNet: The Bright Side of Perceptual Knowledge Distillation https://arxiv.org/abs/2310.03669☆19Updated last year
- a training-free approach to accelerate ViTs and VLMs by pruning redundant tokens based on similarity☆19Updated last month
- Structured Pruning Adapters in PyTorch☆17Updated last year
- ☆36Updated 9 months ago
- Scaling Multi-modal Instruction Fine-tuning with Tens of Thousands Vision Task Types☆17Updated 3 weeks ago
- Official repository of our work "Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning" accepted at CVPR 20…☆22Updated 2 months ago
- Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach, CVPR 2024☆21Updated 9 months ago
- CAD - Memory Efficient Convolutional Adapter for Segment Anything☆12Updated 7 months ago
- A token pruning method that accelerates ViTs for various tasks while maintaining high performance.☆12Updated 4 months ago
- Official PyTorch implementation of Which Tokens to Use? Investigating Token Reduction in Vision Transformers presented at ICCV 2023 NIVT …☆35Updated last year