Alternatives and similar repositories for PrefixKV

Users that are interested in PrefixKV are comparing it to the libraries listed below

• Chongjie-Si / Subspace-Tuning
  A generalized framework for subspace tuning methods in parameter efficient fine-tuning.
  ☆163Updated 5 months ago
• Osilly / dynamic_llava
  [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…
  ☆66Updated 3 months ago
• lzhxmu / VTW
  Code release for VTW (AAAI 2025 Oral)
  ☆65Updated last month
• wutaiqiang / MoSLoRA
  ☆124Updated last year
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆46Updated last year
• NUS-HPC-AI-Lab / DATM
  ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching
  ☆105Updated last year
• JinXins / Awesome-Token-Merge-for-MLLMs
  A paper list about Token Merge, Reduce, Resample, Drop for MLLMs.
  ☆77Updated last month
• NUS-HPC-AI-Lab / Dynamic-Tuning
  The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"
  ☆51Updated 11 months ago
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆150Updated 5 months ago
• WillDreamer / Aurora
  [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model
  ☆88Updated 2 years ago
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆67Updated 8 months ago
• TerryPei / CSP
  Cross-Self KV Cache Pruning for Efficient Vision-Language Inference
  ☆10Updated last year
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆138Updated 8 months ago
• iboing / CorDA
  CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)
  ☆53Updated 11 months ago
• zitian-gao / one-shot-em
  One-shot Entropy Minimization
  ☆187Updated 6 months ago
• CASIA-LMC-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆63Updated last year
• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…
  ☆104Updated last year
• lliai / D2MoE
  D^2-MoE: Delta Decompression for MoE-based LLMs Compression
  ☆72Updated 8 months ago
• lliai / Awesome-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆124Updated last year
• liuting20 / MustDrop
  Multi-Stage Vision Token Dropping: Towards Efficient Multimodal Large Language Model
  ☆36Updated 11 months ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆149Updated 2 months ago
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆235Updated last year
• ywh187 / FitPrune
  ☆62Updated 7 months ago
• 42Shawn / LLaVA-PruMerge
  LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models
  ☆157Updated 2 months ago
• mengcaopku / Continual-LLaVA
  ☆16Updated last year
• sdc17 / UPop
  [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers
  ☆105Updated 11 months ago
• scale-lab / MTLoRA
  The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)
  ☆68Updated 5 months ago
• yolky / RCIG
  ☆14Updated 2 years ago
• pixeli99 / OWS
  Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei …
  ☆35Updated 6 months ago
• RUCKBReasoning / LLM-Streamline
  Official implementation of the ICLR paper "Streamlining Redundant Layers to Compress Large Language Models"
  ☆35Updated 7 months ago