Alternatives and similar repositories for LumiNet:

Users that are interested in LumiNet are comparing it to the libraries listed below

• Hao840 / vanillaKD
  PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781
  ☆75Updated last year
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆82Updated last year
• hunto / MasKD
  Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.
  ☆68Updated 2 years ago
• VainF / Isomorphic-Pruning
  [ECCV 2024] Isomorphic Pruning for Vision Models
  ☆68Updated 9 months ago
• WangYZ1608 / Knowledge-Distillation-via-ND
  The official implementation for paper: Improving Knowledge Distillation via Regularizing Feature Norm and Direction
  ☆18Updated last year
• Hao840 / OFAKD
  PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444
  ☆122Updated last year
• SteveTsui / Q-DETR
  ☆33Updated last year
• zju-SWJ / RLD
  Official implementation for "Knowledge Distillation with Refined Logits".
  ☆13Updated 8 months ago
• lliai / DisWOT-CVPR2023
  ☆26Updated last year
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆63Updated 7 months ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆146Updated 2 years ago
• yzd-v / cls_KD
  'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)
  ☆228Updated last year
• chengtao-lv / PTQ4SAM
  [CVPR 2024] PTQ4SAM: Post-Training Quantization for Segment Anything
  ☆71Updated 10 months ago
• zhengli97 / CTKD
  [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"
  ☆173Updated 5 months ago
• selkerdawy / FTWT
  Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction
  ☆11Updated 2 years ago
• TinyTigerPan / BCKD
  Official Implementation of Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection
  ☆49Updated last year
• ososos888 / prune-then-distill
  ☆47Updated 2 years ago
• Gumpest / FreeKD
  [CVPR'24] Official implementation of paper "FreeKD: Knowledge Distillation via Semantic Frequency Prompt".
  ☆43Updated last year
• zejiangh / Filter-GaP
  The official PyTorch implementation of CHEX: CHannel EXploration for CNN Model Compression (CVPR 2022). Paper is available at https://ope…
  ☆38Updated 2 years ago
• HuangOwen / Quantization-Variation
  [TMLR] Official PyTorch implementation of paper "Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precisio…
  ☆44Updated 7 months ago
• shicaiwei123 / SDD-CVPR2024
  Official code for Scale Decoupled Distillation
  ☆41Updated last year
• Hao840 / manifold-distillation
  Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.
  ☆32Updated 2 years ago
• OSVAI / NORM
  The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…
  ☆20Updated last year
• shawnricecake / search-llm
  [NeurIPS 2024] Search for Efficient LLMs
  ☆13Updated 3 months ago
• duzhixing / FRS
  Distilling Object Detectors with Feature Richness
  ☆44Updated 3 years ago
• Gumpest / MasKD
  Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.
  ☆9Updated 2 years ago
• YanjingLi0202 / Q-ViT
  The official implementation of the NeurIPS 2022 paper Q-ViT.
  ☆88Updated last year
• xinghaochen / SLAB
  [ICML 2024] Official PyTorch implementation of "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-paramete…
  ☆104Updated 8 months ago
• andyrull / width-and-Depth-pruning-for-Vision-Transformer
  ☆18Updated 3 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆94Updated 2 years ago