liuqidong07 / MOELoRA-peft

Related projects: ⓘ

• GCYZSL / MoLA
  ☆110Updated last month
• Ablustrund / LoRAMoE
  LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment
  ☆191Updated 4 months ago
• pldlgb / nuggets
  ☆71Updated 8 months ago
• cmnfriend / O-LoRA
  ☆139Updated 2 months ago
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆134Updated 2 months ago
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆72Updated 6 months ago
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆101Updated last week
• Spico197 / Humback
  🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.
  ☆128Updated 2 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆133Updated 3 months ago
• CASIA-LM / MoDS
  ☆109Updated 5 months ago
• lancopku / label-words-are-anchors
  Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
  ☆144Updated 7 months ago
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆81Updated this week
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆62Updated 7 months ago
• sail-sg / regmix
  🧬 RegMix: Data Mixture as Regression for Language Model Pre-training
  ☆79Updated this week
• THUDM / LongAlign
  LongAlign: A Recipe for Long Context Alignment Encompassing Data, Training, and Evaluation
  ☆194Updated 4 months ago
• OFA-Sys / InsTag
  InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning
  ☆196Updated last year
• IAAR-Shanghai / CTGSurvey
  Controllable Text Generation for Large Language Models: A Survey
  ☆89Updated 3 weeks ago
• IronBeliever / CaR
  Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
  ☆61Updated 4 months ago
• SparkJiao / llama-pipeline-parallel
  A prototype repo for hybrid training of pipeline parallel and distributed data parallel with comments on core code snippets. Feel free to…
  ☆45Updated last year
• Bolin97 / awesome-instruction-selector
  Paper list and datasets for the paper: A Survey on Data Selection for LLM Instruction Tuning
  ☆27Updated 7 months ago
• Magnetic2014 / llm-alignment-survey
  A curated reading list for large language model (LLM) alignment. Take a look at our new survey "Large Language Model Alignment: A Survey"…
  ☆65Updated 11 months ago
• nuochenpku / Awesome-Role-Play-Papers
  Awesome papers for role-playing with language models
  ☆88Updated last month
• OFA-Sys / gsm8k-ScRel
  Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models
  ☆208Updated last week
• tianyi-lab / Cherry_LLM
  [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…
  ☆281Updated last week
• OpenMOSS / HalluQA
  Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"
  ☆105Updated 3 months ago
• MozerWang / Loong
  [arxiv:2406.17419]Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
  ☆62Updated last month
• Junjie-Ye / ToolEyes
  ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆63Updated 5 months ago
• yegcjs / mixinglaws
  ☆87Updated 4 months ago
• Aligner2024 / aligner
  Achieving Efficient Alignment through Learned Correction
  ☆103Updated 3 months ago
• pillowsofwind / Knowledge-Conflicts-Survey
  The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆62Updated 3 weeks ago