Alternatives and similar repositories for Ferret:

Users that are interested in Ferret are comparing it to the libraries listed below

• IST-DASLab / RoSA
  Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)
  ☆39Updated last year
• Infini-AI-Lab / S2FT
  ☆16Updated 2 months ago
• SalesforceAIResearch / GemFilter
  ☆76Updated 2 months ago
• Lucky-Lance / Expert_Sparsity
  [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
  ☆86Updated 10 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆44Updated 8 months ago
• pprp / Pruner-Zero
  Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆80Updated 4 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆91Updated 6 months ago
• JarvisPei / CMoE
  Implementation for the paper: CMoE: Fast Carving of Mixture-of-Experts for Efficient LLM Inference
  ☆17Updated 3 weeks ago
• hetailang / SqueezeAttention
  ☆37Updated 5 months ago
• UNITES-Lab / moe-quantization
  Official code for the paper "Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark"
  ☆13Updated 9 months ago
• hdong920 / GRIFFIN
  ☆36Updated 7 months ago
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆55Updated 11 months ago
• MrGGLS / BlockPruner
  A block pruning framework for LLMs.
  ☆19Updated 9 months ago
• shawnricecake / Heima
  Code for Heima
  ☆37Updated last month
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆24Updated 4 months ago
• yxli2123 / LoSparse
  ☆50Updated last year
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆26Updated last month
• linkedin / ControlLLM
  Control LLM
  ☆13Updated this week
• shoaibahmed / llm_depth_pruning
  Official implementation of the paper: "A deeper look at depth pruning of LLMs"
  ☆14Updated 8 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆33Updated 6 months ago
• zjunlp / ModelKinship
  Exploring Model Kinship for Merging Large Language Models
  ☆23Updated last month
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆22Updated 9 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆56Updated last month
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆33Updated 9 months ago
• tanganke / weight-ensembling_MoE
  Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"
  ☆22Updated 9 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆53Updated 7 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆72Updated 5 months ago
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆123Updated 11 months ago
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆19Updated 3 months ago
• zjunlp / unlearn
  Knowledge Unlearning for Large Language Models
  ☆22Updated 3 weeks ago