pixeli99 / OwLore

Related projects ⓘ

Alternatives and complementary repositories for OwLore

• sdc17 / UPop
  [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
  ☆99Updated last year
• lliai / Awesome-LoRA-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆38Updated last month
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆31Updated 3 weeks ago
• aim-uofa / LoRAPrune
  ☆36Updated 3 months ago
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆28Updated 5 months ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆36Updated 7 months ago
• ylsung / ECoFLaP
  Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)
  ☆17Updated 9 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆53Updated 3 weeks ago
• lzhxmu / VTW
  ☆23Updated 3 months ago
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆69Updated 8 months ago
• sdc17 / CrossGET
  [ICML 2024] CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers.
  ☆26Updated last year
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆123Updated 8 months ago
• NUS-HPC-AI-Lab / DATM
  ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching
  ☆94Updated 5 months ago
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆59Updated 7 months ago
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆37Updated 10 months ago
• BAAI-DCAI / Dataset-Pruning
  Dataset pruning for ImageNet and LAION-2B.
  ☆69Updated 4 months ago
• luuyin / OWL
  Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"
  ☆51Updated 4 months ago
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆74Updated this week
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆49Updated 3 weeks ago
• ArminAzizi98 / LaMDA
  ☆11Updated 2 weeks ago
• wutaiqiang / MoSLoRA
  ☆76Updated 4 months ago
• yxli2123 / LoSparse
  ☆46Updated last year
• OpenGVLab / LLMPrune-BESA
  BESA is a differentiable weight pruning technique for large language models.
  ☆14Updated 8 months ago
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆123Updated 6 months ago
• NUS-HPC-AI-Lab / Dynamic-Tuning
  The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"
  ☆36Updated last month
• TianjinYellow / EdgeDeviceLLMCompetition-Starting-Kit
  ☆39Updated 3 weeks ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆71Updated this week
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆83Updated 2 months ago
• UNITES-Lab / MC-SMoE
  [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"
  ☆64Updated 5 months ago
• r-three / smear
  ☆27Updated last year