Alternatives and similar repositories for LibMoE:

Users that are interested in LibMoE are comparing it to the libraries listed below

• pphuc25 / distil-cd
  Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
  ☆35Updated last year
• FSoft-AI4Code / CodeMMLU
  [ICLR 2025] 🚀 CodeMMLU Evaluator: A framework for evaluating LM models on CodeMMLU MCQs benchmark.
  ☆22Updated 4 months ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆89Updated this week
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆49Updated 2 months ago
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆57Updated 6 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 5 months ago
• tianyi-lab / MoE-Embedding
  Code for "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆61Updated 6 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆37Updated 6 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆53Updated 7 months ago
• prateeky2806 / ties-merging
  ☆173Updated last year
• zjunlp / Deco
  [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation
  ☆54Updated 4 months ago
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆89Updated last month
• VinAIResearch / RecGPT
  RecGPT: Generative Pre-training for Text-based Recommendation (ACL 2024)
  ☆31Updated 6 months ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆126Updated 2 months ago
• lyan62 / FoodieQA
  Official Repo for FoodieQA paper (EMNLP 2024)
  ☆16Updated 4 months ago
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆36Updated 10 months ago
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆111Updated 7 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆77Updated 5 months ago
• open-compass / ProSA
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
  ☆24Updated 5 months ago
• Lillianwei-h / MMIE
  [ICLR'25 Oral] MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
  ☆31Updated 5 months ago
• nverma1 / merging-text-transformers
  Code for "Merging Text Transformers from Different Initializations"
  ☆20Updated 2 months ago
• locuslab / llava-token-compression
  ☆40Updated 5 months ago
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆42Updated 8 months ago
• baochi0212 / LaVy
  Pioneering in Vietnamese Multimodal Large Language Model
  ☆46Updated 2 months ago
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆75Updated 7 months ago
• Nardien / KARD
  Official Code Repository for the paper "Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-intensive Tasks…
  ☆37Updated 4 months ago
• Pbihao / SLM
  ☆27Updated last year
• IntelLabs / lvlm-interpret
  ☆73Updated 3 weeks ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆56Updated last month
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆65Updated 2 months ago