Alternatives and similar repositories for Ferret:

Users that are interested in Ferret are comparing it to the libraries listed below

• tanganke / weight-ensembling_MoE
  Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"
  ☆19Updated 8 months ago
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆50Updated 2 months ago
• hetailang / SqueezeAttention
  ☆37Updated 4 months ago
• UNITES-Lab / moe-quantization
  Official code for the paper "Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark"
  ☆11Updated 8 months ago
• Lucky-Lance / Expert_Sparsity
  [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
  ☆84Updated 9 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆43Updated 7 months ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆24Updated 3 months ago
• IST-DASLab / RoSA
  Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)
  ☆39Updated last year
• SalesforceAIResearch / GemFilter
  ☆75Updated last month
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆27Updated 10 months ago
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆56Updated this week
• UNITES-Lab / MC-SMoE
  [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"
  ☆73Updated 8 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆25Updated last week
• gstoica27 / KnOTS
  Model Merging with SVD to Tie the KnOTS [ICLR 2025]
  ☆44Updated last month
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆67Updated 4 months ago
• Infini-AI-Lab / S2FT
  ☆13Updated last month
• pprp / Pruner-Zero
  Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆79Updated 3 months ago
• zjunlp / ModelKinship
  Exploring Model Kinship for Merging Large Language Models
  ☆23Updated this week
• sramshetty / mixture-of-depths
  An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆35Updated 8 months ago
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Demystifying the Compression of Mixture-of-Experts Through a Unified Framework".
  ☆59Updated 4 months ago
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆53Updated 10 months ago
• WangWenhao0716 / PDF-Embedding
  [NeurIPS 2024] The official implementation of "Image Copy Detection for Diffusion Models"
  ☆16Updated 5 months ago
• katiekang1998 / reasoning_generalization
  ☆28Updated last month
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆34Updated 8 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆33Updated 5 months ago
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆21Updated 8 months ago
• zyxxmu / cam
  Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference
  ☆33Updated 8 months ago
• GeniusHTX / TALE
  ☆67Updated last week