Alternatives and similar repositories for Ferret

Users that are interested in Ferret are comparing it to the libraries listed below

• houcharlie / PrE-Text
  Implementation for PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs
  ☆24Updated last year
• ziyaow1010 / FederatedLLM
  ☆105Updated last year
• Lucky-Lance / Expert_Sparsity
  [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
  ☆113Updated last year
• guobbin / PFL-MoE
  Federated Learning - PyTorch
  ☆15Updated 4 years ago
• hanruiqian / Awesome-Federated-LLM-Related-Works
  ☆18Updated 2 years ago
• YuanheZ / LoRA-One
  LoRA-One: One-Step Full Gradient Could Suffice for Fine-Tuning Large Language Models, Provably and Efficiently (ICML2025 Oral)
  ☆28Updated 2 months ago
• ZO-Bench / ZO-LLM
  [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆122Updated 6 months ago
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆46Updated last year
• UtkarshSaxena1 / EigenAttn
  ☆19Updated last year
• llm-eff / FedPepTAO
  ☆31Updated last year
• ydyhello / TailorKV
  Official implementation of "TailorKV: A Hybrid Framework for Long-Context Inference via Tailored KV Cache Optimization" (Findings of ACL …
  ☆20Updated 5 months ago
• pan-x-c / EE-LLM
  EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).
  ☆73Updated last year
• microsoft / best-route-llm
  Efficient LLM query routing via multi-sampling. BEST-Route selects both model and number of responses based on query difficulty, cutting …
  ☆38Updated 5 months ago
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".
  ☆88Updated 9 months ago
• pixeli99 / OWS
  Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei …
  ☆35Updated 7 months ago
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆142Updated 9 months ago
• longtanle / awesome-federated-LLM-learning
  This is a collection of research papers for Federated Learning for Large Language Models (FedLLM). And the repository will be continuousl…
  ☆102Updated 5 months ago
• hetailang / SqueezeAttention
  ☆38Updated last year
• pprp / Pruner-Zero
  [ICML24] Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆98Updated last year
• wizard1203 / FuseFL
  FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusion (NeurIPS 2024 Spotlight)
  ☆13Updated 9 months ago
• k1l1 / CoCoFL
  CoCoFL: Communication- and Computation-Aware Federated Learning via Partial NN Freezing and Quantization
  ☆13Updated last year
• TsingZ0 / GPFL
  ICCV 2023 accepted paper, GPFL: Simultaneously Learning Global and Personalized Feature Information for Personalized Federated Learning
  ☆25Updated last year
• hdong920 / GRIFFIN
  ☆39Updated last year
• ArminAzizi98 / LaMDA
  ☆15Updated last year
• UbiquitousLearning / FedAdapter
  "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.
  ☆34Updated 2 years ago
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆83Updated last year
• wutaiqiang / MoSLoRA
  ☆125Updated last year
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆67Updated 9 months ago
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆67Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆94Updated last month