Alternatives and similar repositories for MOELoRA-peft:

Users that are interested in MOELoRA-peft are comparing it to the libraries listed below

• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆154Updated 8 months ago
• ChasonShi / MELoRA
  code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"
  ☆19Updated last month
• GCYZSL / MoLA
  ☆131Updated 8 months ago
• Yiwei98 / TDG
  ☆24Updated last year
• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆33Updated 2 months ago
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆34Updated 11 months ago
• DeepLearnXMU / QGC
  Code for "Retaining Key Information under High Compression Rates: Query-Guided Compressor for LLMs" (ACL 2024)
  ☆17Updated 9 months ago
• VT-NLP / MixLoRA
  Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)
  ☆15Updated 7 months ago
• YJiangcm / LTE
  [ACL 2024] Learning to Edit: Aligning LLMs with Knowledge Editing
  ☆35Updated 7 months ago
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆115Updated 4 months ago
• alenai97 / PEFT-MLLM
  Official Code and data for ACL 2024 finding, "An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Models"
  ☆16Updated 4 months ago
• Yuheng2000 / Awesome-LoRA
  Awesome Low-Rank Adaptation
  ☆34Updated 6 months ago
• brucewsy / AD-KD
  Source code of ACL 2023 accepted paper "AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression"
  ☆11Updated last year
• ruz048 / AutoLoRA
  ☆10Updated 11 months ago
• au-revoir / model-editing-ft
  ☆12Updated 6 months ago
• Haskely / gsm8k-rft-llama7b-u13b_evaluation
   测试 https://huggingface.co/OFA-Sys/gsm8k-rft-llama7b-u13b 的 GSM8K 分数
  ☆15Updated last year
• cmnfriend / O-LoRA
  ☆170Updated 8 months ago
• liyongqi2002 / Awesome-Personalized-Alignment
  A curated list of personalized alignment resources (continually updated).
  ☆12Updated this week
• zzz47zzz / spurious-forgetting
  [ICLR 2025] Released code for paper "Spurious Forgetting in Continual Learning of Language Models"
  ☆29Updated last month
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆72Updated last year
• scale-lab / MTLoRA
  The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)
  ☆43Updated 3 weeks ago
• chenyuxin1999 / S-DPO
  [NeurIPS 2024] The implementation of paper "On Softmax Direct Preference Optimization for Recommendation"
  ☆65Updated 4 months ago
• zhengzhi-1997 / LLM-TRSR
  ☆12Updated 9 months ago
• Bumble666 / Hyper_MoE
  ☆25Updated 2 months ago
• Alsace08 / Chain-of-Embedding
  [ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"
  ☆41Updated 3 months ago
• wutaiqiang / MoSLoRA
  ☆99Updated 8 months ago
• liyongqi67 / GRACE
  ☆16Updated 7 months ago
• swj0419 / REPLUG
  ☆69Updated last year
• TUDB-Labs / MixLoRA
  State-of-the-art Parameter-Efficient MoE Fine-tuning Method
  ☆152Updated 7 months ago
• Hongcheng-Gao / Awesome-Long2short-on-LRMs
  Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…
  ☆171Updated this week