[AAAI 2024] Understanding the Role of the Projector in Knowledge Distillation
☆20Feb 13, 2024Updated 2 years ago
Alternatives and similar repositories for Simple-Recipe-Distillation
Users that are interested in Simple-Recipe-Distillation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections☆22Oct 15, 2024Updated last year
- [BMVC 2022] Information Theoretic Representation Distillation☆19Oct 6, 2023Updated 2 years ago
- The official implementation for paper: Improving Knowledge Distillation via Regularizing Feature Norm and Direction☆24Aug 3, 2023Updated 2 years ago
- Official Pytorch implementation for "IFORMER: INTEGRATING CONVNET AND TRANSFORMER FOR MOBILE APPLICATION" [ICLR 2025]☆65Mar 22, 2025Updated last year
- [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization☆41Sep 30, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [WACV'26] Attention as Geometric Transformation: Revisiting Feature Distillation for Semantic Segmentation☆43Jun 8, 2026Updated last month
- A Multi-scale Transformer-based Decoder for Semantic Segmentation☆21Aug 16, 2023Updated 2 years ago
- Official implementation of the paper "Function-Consistent Feature Distillation" (ICLR 2023)☆30Jul 5, 2023Updated 3 years ago
- PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781☆77Nov 21, 2023Updated 2 years ago
- Reproducing Raghu et al 2021 - Do Vision Transformers See Like Convolutional Neural Networks?☆17Aug 30, 2021Updated 4 years ago
- Benchopt benchmark for ResNet fitting on a classification task☆12Sep 19, 2023Updated 2 years ago
- PyTorch implementation of RRD: https://arxiv.org/abs/2407.12073☆15Dec 2, 2025Updated 7 months ago
- [NeurIPS'25] Towards Interpretability Without Sacrifice: Faithful Dense Layer Decomposition with Mixture of Decoders☆16May 28, 2025Updated last year
- [ECCV2024 - Oral] Adaptive Parametric Activation☆53Nov 18, 2025Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 一些实用的工具(比如压缩图片,格式转换,原型图工具)☆13Jun 17, 2020Updated 6 years ago
- Implementation of Spatial Transformer Networks in Pytorch.☆14May 13, 2023Updated 3 years ago
- ☆17Jun 10, 2025Updated last year
- In this project, we wish to identify psychiatric disorders through patient's speech☆12Jun 6, 2021Updated 5 years ago
- AI实战-practicalAI 中文版☆21Dec 17, 2022Updated 3 years ago
- Multi-Teacher Knowledge Distillation, code for my PhD dissertation. I used knowledge distillation as a decision-fusion and compressing m…☆28May 19, 2023Updated 3 years ago
- ☆44Jun 18, 2026Updated last month
- ☆11Nov 18, 2024Updated last year
- A python implementation to extract Shape DNA [1] of triangle surface meshes☆20Jan 23, 2018Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Official implementation of our paper "Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Opera…☆11Sep 20, 2024Updated last year
- ☆21May 1, 2026Updated 2 months ago
- [WACV 2025] DistillDIFT: Distillation of Diffusion Features for Semantic Correspondence☆38Jul 10, 2025Updated last year
- ☆13Jul 20, 2024Updated 2 years ago
- 🔥 [ICLR 2025] Official PyTorch Model "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"☆27Feb 9, 2025Updated last year
- Pytorch implementation of 'Improving Self-supervised Lightweight Model Learning via Hard-aware Metric Distillation. In ECCV 2022'☆11Mar 22, 2023Updated 3 years ago
- Code for the paper "No Train, all Gain: Self-Supervised Gradients Improve Deep Frozen Representations"☆11Oct 31, 2024Updated last year
- Original code base for On Pretraining Data Diversity for Self-Supervised Learning☆14Dec 30, 2024Updated last year
- Time series data contribution via influence functions☆17Jan 18, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A pytorch implementation of the ICCV2021 workshop paper SimDis: Simple Distillation Baselines for Improving Small Self-supervised Models☆14Jul 15, 2021Updated 5 years ago
- Implementation of "Weight Averaging Improves Knowledge Distillation under Domain Shift" (ICCV 2023 OOD-CV Workshop)☆19Oct 1, 2023Updated 2 years ago
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444