(CVPR2022) Official PyTorch Implementation of KDEP. Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferability
☆61Jul 21, 2022Updated 4 years ago
Alternatives and similar repositories for KDEP
Users that are interested in KDEP are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Is synthetic data from generative models ready for image recognition?☆187Feb 16, 2023Updated 3 years ago
- ☆17Jul 25, 2021Updated 5 years ago
- (CVPR-Oral 2021) PyTorch implementation of Knowledge Evolution approach and Split-Nets☆83Oct 9, 2021Updated 5 years ago
- ☆20Jul 25, 2022Updated 4 years ago
- (NeurIPS 2022) Self-Supervised Visual Representation Learning with Semantic Grouping☆97Mar 10, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- (ECCV 2022) DODA: Data-oriented Sim-to-Real Domain Adaptation for 3D Semantic Segmentation☆53Oct 20, 2022Updated 4 years ago
- (NeurIPS 2024) What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights☆27Oct 28, 2024Updated 2 years ago
- This is the official repo for the CVPR 2021 L2ID paper "Distill on the Go: Online knowledge distillation in self-supervised learning"☆12Nov 15, 2021Updated 5 years ago
- Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)☆104Apr 30, 2024Updated 2 years ago
- This is the project for DreamStone: TPAMI & ISS: ICLR 2023 spotlight☆45Sep 23, 2023Updated 3 years ago
- Can 3D Vision-Language Models Truly Understand Natural Language?☆20Mar 28, 2024Updated 2 years ago
- ☆28Feb 6, 2021Updated 5 years ago
- (NeurlPS 2022) Spatial Pruned Sparse Convolution for Efficient 3D Object Detection☆66Jan 6, 2023Updated 3 years ago
- ☆50Nov 10, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- (NeurlPS 2022) Prototypical VoteNet for Few-Shot 3D Point Cloud Object Detection☆60Jan 3, 2023Updated 3 years ago
- Official implementation for "Knowledge Distillation with Refined Logits".☆24Aug 26, 2024Updated 2 years ago
- Official repo for Directional Self-supervised Learning for Heavy Image Augmentations [CVPR2022]☆12Jun 29, 2022Updated 4 years ago
- Implementation of the paper: Selective_Backpropagation from paper Accelerating Deep Learning by Focusing on the Biggest Losers☆16Feb 2, 2020Updated 6 years ago
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆66Jul 29, 2020Updated 6 years ago
- A Simple Framwork for CV Pre-training Model (SOCO, VirTex, BEiT)☆15Oct 18, 2021Updated 5 years ago
- Masked Generative Distillation (ECCV 2022)☆243Nov 9, 2022Updated 4 years ago
- Deep Structured Instance Graph for Distilling Object Detectors (ICCV 2021)☆35Oct 17, 2021Updated 5 years ago
- This repo holds the research projects of our lab.☆11Jan 20, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Pytorch implementation of our paper accepted by NeurIPS 2021 -- Revisiting Discriminator in GAN Compression: A Generator-discriminator Co…☆34Dec 4, 2021Updated 4 years ago
- a pytorch impelementation of ssim to reproduce matlab results☆18Apr 2, 2021Updated 5 years ago
- ☆43Sep 4, 2023Updated 3 years ago
- 'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)☆254Oct 10, 2023Updated 3 years ago
- Representative Graph Neural Network☆35Aug 12, 2020Updated 6 years ago
- [ICML'21] Estimate the accuracy of the classifier in various environments through self-supervision☆26Sep 2, 2021Updated 5 years ago
- ☆32Jul 23, 2022Updated 4 years ago
- [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".☆102Jun 16, 2022Updated 4 years ago
- A Simplied Framework of GAN Inversion☆16Mar 18, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [ICIP 2021] PyTorch code for "The Mind's Eye: Visualizing Class-Agnostic Features of CNNs" for generation of kernel features.☆12Sep 12, 2021Updated 5 years ago
- Source Code for "Dual-Level Knowledge Distillation via Knowledge Alignment and Correlation", TNNLS, https://ieeexplore.ieee.org/abstract/…☆12Dec 21, 2022Updated 3 years ago
- Official implementation of "Top Batch DropBlock for Person Re-Identification" ICPR 2020☆27Mar 28, 2021Updated 5 years ago
- Pytorch implementation of our paper accepted by IEEE TMM, 2022 --Learning Efficient GANs for Image Translation via Differentiable Masks a…☆51Jul 6, 2023Updated 3 years ago
- ImageNet-CoG is a benchmark for concept generalization. It provides a full evaluation framework for pre-trained visual representations wh…☆26Oct 13, 2021Updated 5 years ago
- This is the implementaion of paper "Task-Oriented Feature Distillation"☆43Apr 25, 2022Updated 4 years ago
- The codes for RFNet: Recurrent Forward Network for Dense Point Cloud Completion☆20Jan 17, 2022Updated 4 years ago
Are these results useful?