Alternatives and similar repositories for RMoE

Users that are interested in RMoE are comparing it to the libraries listed below

• locuslab / llava-token-compression
  ☆46Updated last year
• tianyi-lab / R2-T2
  [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆17Updated 10 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆57Updated last year
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 8 months ago
• tianyi-lab / C3PO
  [COLM 2025] "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆19Updated 9 months ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆35Updated last year
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆29Updated 6 months ago
• callsys / GMPO
  [ICLR 2026] Geometric-Mean Policy Optimization
  ☆98Updated this week
• Hon-Wong / ByteVideoLLM
  [ICCV 2025] Dynamic-VLM
  ☆28Updated last year
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆15Updated last year
• waltonfuture / MM-UPT
  [NeurIPS 2025] Unsupervised Post-Training for Multi-Modal LLM Reasoning via GRPO
  ☆74Updated 3 months ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆113Updated this week
• OpenSparseLLMs / Linearization
  ☆63Updated 6 months ago
• ByungKwanLee / Phantom
  [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …
  ☆63Updated last year
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆212Updated last year
• Hao840 / ADEM-VL
  PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"
  ☆21Updated last year
• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆48Updated 11 months ago
• assafbk / DeciMamba
  DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)
  ☆32Updated 9 months ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated last year
• UMass-Embodied-AGI / FlexAttention
  [ECCV 2024] FlexAttention for Efficient High-Resolution Vision-Language Models
  ☆46Updated last year
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆36Updated last year
• mbzuai-oryx / Agent-X
  Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks
  ☆35Updated 2 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆40Updated last year
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆50Updated 8 months ago
• jiwonsong-dev / ReasoningPathCompression
  [NeurIPS 2025] Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"
  ☆29Updated 3 months ago
• Infini-AI-Lab / GRESO
  ☆73Updated 7 months ago
• MarkXCloud / CSpD
  The official repo of continuous speculative decoding
  ☆31Updated 10 months ago
• euclid-multimodal / Euclid
  ☆17Updated last year
• iancovert / locality-alignment
  ☆54Updated last year
• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆59Updated 10 months ago