HITsz-TMG / UMOE-Scaling-Unified-Multimodal-LLMsLinks
The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"
☆759Updated last month
Alternatives and similar repositories for UMOE-Scaling-Unified-Multimodal-LLMs
Users that are interested in UMOE-Scaling-Unified-Multimodal-LLMs are comparing it to the libraries listed below
Sorting:
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,213Updated 5 months ago
- An MBTI Exploration of Large Language Models☆499Updated last year
- [NeurIPS 2024] An official implementation of "ShareGPT4Video: Improving Video Understanding and Generation with Better Captions"☆1,075Updated 11 months ago
- [COLM'25] DeepRetrieval - 🔥 Training Search Agent with Retrieval Outcomes via Reinforcement Learning☆632Updated 2 months ago
- ✨✨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆257Updated 4 months ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆365Updated 3 months ago
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆144Updated 8 months ago
- Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models (CVPR 2024 Highlight)☆1,915Updated 2 months ago
- [NeurIPS 2024] Matryoshka Query Transformer for Large Vision-Language Models☆116Updated last year
- Explain Before You Answer: A Survey on Compositional Visual Reasoning☆124Updated last week
- Align Anything: Training All-modality Model with Feedback☆4,544Updated 3 weeks ago
- [ICLR 2025] Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models☆58Updated 7 months ago
- adds Sequence Parallelism into LLaMA-Factory☆556Updated 2 weeks ago
- [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"☆463Updated last year
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆261Updated last year
- [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation☆1,131Updated this week
- 【ICML 2025 Spotlight】 Official Repo for Paper ‘’HealthGPT : A Medical Large Vision-Language Model for Unifying Comprehension and Generati…☆1,500Updated 4 months ago
- R-KV: Redundancy-aware KV Cache Compression for Reasoning Models☆1,114Updated 2 weeks ago
- [ICML 2025] "SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator"☆546Updated last month
- When Agent Becomes the Scientist – Building Closed-Loop System from Hypothesis to Verification☆503Updated last month
- The official implementation of Self-Play Preference Optimization (SPPO)☆580Updated 7 months ago
- [CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"☆425Updated 3 months ago
- (ICCV-2025 Official Code)) Improving Generalist Model with Domain-Specific Experts☆85Updated 2 months ago
- ☆65Updated 6 months ago
- SDAR (Synergy of Diffusion and AutoRegression), a large diffusion language model（1.7B, 4B, 8B, 30B）☆204Updated last week
- Real-time and accurate open-vocabulary end-to-end object detection☆1,335Updated 8 months ago
- Build multimodal language agents for fast prototype and production☆2,548Updated 5 months ago
- One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks☆3,060Updated this week
- [EMNLP'25] s3 - ⚡ Efficient & Effective Search Agent Training via RL for RAG (Verifier-Powered RLVR for Search)☆671Updated last month
- Unified KV Cache Compression Methods for Auto-Regressive Models☆1,237Updated 8 months ago