Alternatives and similar repositories for LibMoE

Users that are interested in LibMoE are comparing it to the libraries listed below

• ExplainableML / sae-for-vlm
  [NeurIPS 2025] Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models
  ☆61Updated 2 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆52Updated last year
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆57Updated last year
• prateeky2806 / ties-merging
  ☆208Updated 2 years ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆61Updated last year
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆76Updated 11 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆99Updated last year
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆114Updated last week
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆143Updated 10 months ago
• ByungKwanLee / Phantom
  [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …
  ☆63Updated last year
• VijayLingam95 / SVFT
  ☆35Updated 11 months ago
• Yuheng2000 / Awesome-LoRA
  Awesome Low-Rank Adaptation
  ☆59Updated 6 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆69Updated last year
• TsinghuaC3I / SoRA
  [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆84Updated last year
• Chaos96 / fourierft
  ☆152Updated last year
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆85Updated last year
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆142Updated 10 months ago
• calpt / awesome-adapter-resources
  Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
  ☆201Updated last year
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆195Updated last year
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆90Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆96Updated 2 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆122Updated last year
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆60Updated last year
• nickjiang2378 / vlm-hallucinations
  [ICLR '25] Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"
  ☆95Updated 2 months ago
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆79Updated 8 months ago
• yfzhang114 / LLaVA-Align
  [ACM Multimedia 2025] This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual…
  ☆82Updated 11 months ago
• pphuc25 / distil-cd
  Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
  ☆35Updated last year
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆116Updated last year
• arazd / ResidualPrompts
  Residual Prompt Tuning: a method for faster and better prompt tuning.
  ☆57Updated 2 years ago
• EvolvingLMMs-Lab / multimodal-sae
  [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆175Updated 4 months ago