Alternatives and similar repositories for UMOE-Scaling-Unified-Multimodal-LLMs

Users that are interested in UMOE-Scaling-Unified-Multimodal-LLMs are comparing it to the libraries listed below

• HJYao00 / Mulberry
  [NIPS'25 Spotlight] Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS
  ☆1,215Updated 2 weeks ago
• ShareGPT4Omni / ShareGPT4Video
  [NeurIPS 2024] An official implementation of "ShareGPT4Video: Improving Video Understanding and Generation with Better Captions"
  ☆1,077Updated 11 months ago
• PKU-YuanGroup / Machine-Mindset
  An MBTI Exploration of Large Language Models
  ☆501Updated last year
• Yuliang-Liu / Monkey
  Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models (CVPR 2024 Highlight)
  ☆1,923Updated 2 months ago
• Ola-Omni / Ola
  Ola: Pushing the Frontiers of Omni-Modal Language Model
  ☆370Updated 3 months ago
• om-ai-lab / OmAgent
  Build multimodal language agents for fast prototype and production
  ☆2,556Updated 6 months ago
• PKU-Alignment / align-anything
  Align Anything: Training All-modality Model with Feedback
  ☆4,557Updated last month
• Alpha-Innovator / DocGenome
  DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models
  ☆145Updated 8 months ago
• gordonhu608 / MQT-LLaVA
  [NeurIPS 2024] Matryoshka Query Transformer for Large Vision-Language Models
  ☆117Updated last year
• AlaaLab / InstructCV
  [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"
  ☆462Updated last year
• yfzhang114 / r1_reward
  ✨✨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning
  ☆261Updated 5 months ago
• EvolvingLMMs-Lab / lmms-eval
  One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
  ☆3,138Updated this week
• pat-jj / DeepRetrieval
  [COLM’25] DeepRetrieval — 🔥 The First Search Agent Trained by On-Policy Reinforcement Learning
  ☆642Updated 3 months ago
• HKUDS / SepLLM
  [ICML 2025] "SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator"
  ☆551Updated 2 months ago
• om-ai-lab / OmDet
  Real-time and accurate open-vocabulary end-to-end object detection
  ☆1,341Updated 9 months ago
• showlab / Show-1
  [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation
  ☆1,133Updated 3 weeks ago
• OpenGVLab / ScaleCUA
  ScaleCUA is the open-sourced computer use agents that can operate on corss-platform environments (Windows, macOS, Ubuntu, Android).
  ☆464Updated this week
• mragbench / MRAG-Bench
  [ICLR 2025] Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models
  ☆58Updated 8 months ago
• microsoft / DeepVideoDiscovery
  **Deep Video Discovery (DVD)** is a deep-research style question answering agent designed for understanding extra-long videos.
  ☆281Updated 2 weeks ago
• mlpc-ucsd / BLIVA
  (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions
  ☆258Updated last year
• pat-jj / s3
  [EMNLP'25] s3 - ⚡ Efficient & Effective Search Agent Training via RL for RAG (Verifier-Powered RLVR for Search with Minimal Data)
  ☆721Updated last week
• uclaml / SPPO
  The official implementation of Self-Play Preference Optimization (SPPO)
  ☆583Updated 8 months ago
• Qihoo360 / 360-LLaMA-Factory
  adds Sequence Parallelism into LLaMA-Factory
  ☆567Updated last week
• yuanze-lin / Olympus
  [CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"
  ☆427Updated 4 months ago
• Alpha-Innovator / Chimera
  (ICCV-2025 Official Code)) Improving Generalist Model with Domain-Specific Experts
  ☆85Updated 3 months ago
• InternLM / InternBootcamp
  ☆318Updated last month
• AQ-MedAI / Diver
  Complex Reasoning Rag System
  ☆185Updated last week
• Zefan-Cai / R-KV
  R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
  ☆1,123Updated last month
• dvlab-research / Lyra
  [ICCV 2025] Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"
  ☆296Updated 8 months ago
• Zefan-Cai / KVCache-Factory
  Unified KV Cache Compression Methods for Auto-Regressive Models
  ☆1,252Updated 9 months ago