Alternatives and similar repositories for MOELoRA-peft:

Users that are interested in MOELoRA-peft are comparing it to the libraries listed below

• GCYZSL / MoLA
  ☆124Updated 7 months ago
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆114Updated 4 months ago
• pldlgb / nuggets
  ☆80Updated last year
• cmnfriend / O-LoRA
  ☆165Updated 7 months ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆78Updated last year
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆143Updated 5 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆153Updated 8 months ago
• lancopku / label-words-are-anchors
  Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
  ☆161Updated last year
• Ablustrund / LoRAMoE
  LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment
  ☆290Updated 10 months ago
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆157Updated 8 months ago
• maidacundo / MoE-LoRA
  Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.
  ☆25Updated 4 months ago
• nick7nlp / Counting-Stars
  Counting-Stars (★)
  ☆79Updated 6 months ago
• OpenMatch / Augmentation-Adapted-Retriever
  [ACL 2023] This is the code repo for our ACL'23 paper "Augmentation-Adapted Retriever Improves Generalization of Language Models as Gener…
  ☆60Updated 7 months ago
• sail-sg / regmix
  [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)
  ☆109Updated 2 weeks ago
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆68Updated last month
• OFA-Sys / InsTag
  InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning
  ☆242Updated last year
• pillowsofwind / Knowledge-Conflicts-Survey
  [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆105Updated 5 months ago
• yuleiqin / fantastic-data-engineering
  Fantastic Data Engineering for Large Language Models
  ☆75Updated 2 months ago
• songmzhang / DSKD
  Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…
  ☆41Updated 3 months ago
• dongguanting / DPA-RAG
  The code and data of DPA-RAG
  ☆57Updated last month
• Spico197 / Humback
  🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.
  ☆137Updated 8 months ago
• TUDB-Labs / MixLoRA
  State-of-the-art Parameter-Efficient MoE Fine-tuning Method
  ☆133Updated 6 months ago
• sanowl / OmegaPRM
  this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…
  ☆23Updated 2 months ago
• Magnetic2014 / llm-alignment-survey
  A curated reading list for large language model (LLM) alignment. Take a look at our new survey "Large Language Model Alignment: A Survey"…
  ☆75Updated last year
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆54Updated 2 months ago
• OpenMOSS / HalluQA
  Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"
  ☆119Updated 8 months ago
• TsinghuaC3I / Intuitive-Fine-Tuning
  Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process
  ☆25Updated 7 months ago
• CASIA-LM / MoDS
  ☆132Updated 10 months ago
• yegcjs / mixinglaws
  ☆96Updated 5 months ago