Alternatives and similar repositories for KD-LoRA:

Users that are interested in KD-LoRA are comparing it to the libraries listed below

• VITA-Group / Diverse-ViT
  [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…
  ☆25Updated 3 years ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆54Updated 4 months ago
• locuslab / llava-token-compression
  ☆41Updated 5 months ago
• zju-vipa / training_free_model_merging
  This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).
  ☆29Updated last year
• ArthurLeoM / peft-givens
  source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib
  ☆16Updated last month
• NUS-HPC-AI-Lab / DD-Ranking
  Data distillation benchmark
  ☆58Updated last week
• shaoshitong / EDC
  Elucidated Dataset Condensation (NeurIPS 2024)
  ☆21Updated 6 months ago
• rgeirhos / dataset-pruning-metrics
  Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)
  ☆56Updated 2 years ago
• wangf3014 / Adventurer
  ☆19Updated 2 months ago
• UCSC-VLAA / CLIPS
  An Enhanced CLIP Framework for Learning with Synthetic Captions
  ☆28Updated last week
• mchiquier / llm-mutate
  ☆13Updated 6 months ago
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆53Updated last year
• jusiro / CLAP
  [CVPR'24] Validation-free few-shot adaptation of CLIP, using a well-initialized Linear Probe (ZSLP) and class-adaptive constraints (CLAP)…
  ☆71Updated 2 weeks ago
• boyazeng / understand_bias
  Code release for "Understanding Bias in Large-Scale Visual Datasets"
  ☆20Updated 4 months ago
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆21Updated 7 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆53Updated 8 months ago
• jiachenzhu / VCR
  Variance Covariance Regularization
  ☆14Updated last year
• shawnricecake / search-llm
  [NeurIPS 2024] Search for Efficient LLMs
  ☆13Updated 3 months ago
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆31Updated 6 months ago
• NUS-HPC-AI-Lab / Dynamic-Tuning
  The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"
  ☆44Updated 3 months ago
• james-oldfield / muMoE
  [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization
  ☆30Updated 6 months ago
• EnnengYang / An-Efficient-Dataset-Condensation-Plugin
  An Efficient Dataset Condensation Plugin and Its Application to Continual Learning. NeurIPS, 2023.
  ☆11Updated last year
• yfzhang114 / LLaVA-Align
  This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…
  ☆78Updated 2 months ago
• invictus717 / UniDG
  Towards Unified and Effective Domain Generalization
  ☆31Updated last year
• iancovert / locality-alignment
  ☆45Updated 3 months ago
• tanganke / opcm
  ☆10Updated 2 months ago
• fredzzhang / atlas
  Official PyTorch implementation for NeurIPS'24 paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"
  ☆19Updated 2 months ago
• shoaibahmed / blockwise_ssl
  Repository containing code for blockwise SSL training
  ☆29Updated 6 months ago