Alternatives and similar repositories for LibMoE

Users that are interested in LibMoE are comparing it to the libraries listed below

• pphuc25 / distil-cd
  Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
  ☆35Updated last year
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆56Updated 10 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆38Updated 8 months ago
• VinAIResearch / RecGPT
  RecGPT: Generative Pre-training for Text-based Recommendation (ACL 2024)
  ☆33Updated 9 months ago
• Pbihao / SLM
  ☆28Updated last year
• kpup1710 / CAMEx
  [ICLR 2025] CAMEx: Curvature-Aware Merging of Experts
  ☆20Updated 3 months ago
• Chengsong-Huang / Self-Calibration
  codes for Efficient Test-Time Scaling via Self-Calibration
  ☆14Updated 3 months ago
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆120Updated 10 months ago
• FSoft-AI4Code / CodeMMLU
  [ICLR 2025] 🚀 CodeMMLU Evaluator: A framework for evaluating LM models on CodeMMLU MCQs benchmark.
  ☆23Updated 2 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆40Updated 8 months ago
• tanganke / weight-ensembling_MoE
  Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"
  ☆24Updated last year
• baochi0212 / LaVy
  Pioneering in Vietnamese Multimodal Large Language Model
  ☆47Updated 5 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆59Updated 3 months ago
• prateeky2806 / ties-merging
  ☆183Updated last year
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆57Updated 6 months ago
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆77Updated 3 weeks ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆52Updated 4 months ago
• tianyi-lab / C3PO
  Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆15Updated 2 months ago
• DavidFanzz / SCMoE
  ☆26Updated last year
• VILA-Lab / GBLM-Pruner
  Are gradient information useful for pruning of LLMs?
  ☆46Updated last year
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆60Updated 8 months ago
• ZaloAI-Jaist / VMLU
  ☆70Updated last year
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 8 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆83Updated 8 months ago
• nghiangh / OpenViVQA
  This is an open-source repository for constructing and researching fusion-style deep learning methods combined with pretrained vision mod…
  ☆14Updated 5 months ago
• MingLiiii / Layer_Gradient
  [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆65Updated this week
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆38Updated last year
• locuslab / llava-token-compression
  ☆42Updated 7 months ago
• p1nksnow / MoICE
  Official implementation for "Mixture of In-Context Experts Enhance LLMs’ Awareness of Long Contexts" (Accepted by Neurips2024)
  ☆12Updated 5 months ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆109Updated 3 months ago