Alternatives and similar repositories for LibMoE

Users that are interested in LibMoE are comparing it to the libraries listed below

• pphuc25 / distil-cd
  Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
  ☆35Updated last year
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 6 months ago
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆36Updated 11 months ago
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆58Updated 7 months ago
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆67Updated 2 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆54Updated 8 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆73Updated 6 months ago
• FSoft-AI4Code / CodeMMLU
  [ICLR 2025] 🚀 CodeMMLU Evaluator: A framework for evaluating LM models on CodeMMLU MCQs benchmark.
  ☆23Updated 3 weeks ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆58Updated 2 months ago
• r-three / smear
  ☆29Updated last year
• shawnricecake / Heima
  Code for Heima
  ☆42Updated 3 weeks ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆51Updated 3 months ago
• MingLiiii / Layer_Gradient
  What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆63Updated 2 months ago
• Pbihao / SLM
  ☆27Updated last year
• arazd / ResidualPrompts
  Residual Prompt Tuning: a method for faster and better prompt tuning.
  ☆54Updated 2 years ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆97Updated 2 months ago
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated last year
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆72Updated 6 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆78Updated 6 months ago
• ruocwang / mixture-of-prompts
  [ICML 2024] One Prompt is Not Enough: Automated Construction of a Mixture-of-Expert Prompts - TurningPoint AI
  ☆23Updated 7 months ago
• prateeky2806 / ties-merging
  ☆177Updated last year
• locuslab / llava-token-compression
  ☆41Updated 6 months ago
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆29Updated 9 months ago
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆76Updated 8 months ago
• tanganke / weight-ensembling_MoE
  Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"
  ☆24Updated 11 months ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆38Updated last year
• apple / ml-rpm-bench
  ☆41Updated 9 months ago
• VinAIResearch / RecGPT
  RecGPT: Generative Pre-training for Text-based Recommendation (ACL 2024)
  ☆32Updated 7 months ago
• Infini-AI-Lab / S2FT
  ☆17Updated 4 months ago
• MikeWangWZHL / dymu
  ☆10Updated 3 weeks ago