Alternatives and similar repositories for RMoE

Users that are interested in RMoE are comparing it to the libraries listed below

• tianyi-lab / C3PO
  Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆18Updated 5 months ago
• locuslab / llava-token-compression
  ☆43Updated 10 months ago
• mbzuai-oryx / Agent-X
  Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks
  ☆30Updated last month
• tianyi-lab / R2-T2
  [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆16Updated 6 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆30Updated 4 months ago
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆61Updated 6 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆14Updated last year
• top-yun / SPARK
  A benchmark dataset and simple code examples for measuring the perception and reasoning of multi-sensor Vision Language models.
  ☆19Updated 8 months ago
• callsys / GMPO
  Geometric-Mean Policy Optimization
  ☆79Updated last month
• assafbk / DeciMamba
  DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)
  ☆31Updated 5 months ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated last year
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆47Updated 4 months ago
• UMass-Embodied-AGI / FlexAttention
  [ECCV 2024] FlexAttention for Efficient High-Resolution Vision-Language Models
  ☆43Updated 8 months ago
• Hao840 / ADEM-VL
  PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"
  ☆20Updated 10 months ago
• MarkXCloud / CSpD
  The official repo of continuous speculative decoding
  ☆27Updated 5 months ago
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆78Updated 3 months ago
• waltonfuture / MM-UPT
  Unsupervised GRPO
  ☆47Updated 3 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆56Updated last year
• ByungKwanLee / Phantom
  [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …
  ☆61Updated 11 months ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆33Updated last year
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆58Updated 9 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆39Updated 11 months ago
• MambaMixer / M2
  ☆47Updated last year
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆105Updated last week
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆26Updated last month
• Hon-Wong / ByteVideoLLM
  [ICCV 2025] Dynamic-VLM
  ☆25Updated 9 months ago
• caojiaolong / Awesome-Mamba
  Collect papers about Mamba (a selective state space model).
  ☆14Updated last year
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆33Updated 11 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆211Updated 8 months ago
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆92Updated 3 weeks ago