HITsz-TMG / UMOE-Scaling-Unified-Multimodal-LLMsLinks
The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"
☆733Updated last month
Alternatives and similar repositories for UMOE-Scaling-Unified-Multimodal-LLMs
Users that are interested in UMOE-Scaling-Unified-Multimodal-LLMs are comparing it to the libraries listed below
Sorting:
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,193Updated 2 months ago
- One for All Modalities Evaluation Toolkit - including text, image, video, audio tasks.☆2,659Updated this week
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆260Updated last year
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆344Updated 2 weeks ago
- Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models (CVPR 2024 Highlight)☆1,859Updated 2 weeks ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,064Updated 8 months ago
- [NeurIPS 2024] Matryoshka Query Transformer for Large Vision-Language Models☆109Updated 11 months ago
- DeepRetrieval - 🔥 Training Search Agent with Retrieval Outcomes via Reinforcement Learning☆569Updated last week
- Align Anything: Training All-modality Model with Feedback☆4,026Updated 3 weeks ago
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆136Updated 5 months ago
- [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"☆461Updated last year
- The official implementation of Self-Play Preference Optimization (SPPO)☆566Updated 5 months ago
- adds Sequence Parallelism into LLaMA-Factory☆518Updated last week
- Skywork-R1V2:Multimodal Hybrid Reinforcement Learning for Reasoning☆2,634Updated 2 weeks ago
- Unified KV Cache Compression Methods for Auto-Regressive Models☆1,147Updated 5 months ago
- ☆1,378Updated 8 months ago
- Build multimodal language agents for fast prototype and production☆2,512Updated 3 months ago
- [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation☆1,131Updated 7 months ago
- Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"☆286Updated 5 months ago
- Real-time and accurate open-vocabulary end-to-end object detection☆1,324Updated 6 months ago
- [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception☆570Updated last year
- An open-source implementation for training LLaVA-NeXT.☆399Updated 8 months ago
- When Agent Becomes the Scientist – Building Closed-Loop System from Hypothesis to Verification☆349Updated 2 weeks ago
- [CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"☆428Updated 3 weeks ago
- Intervening Anchor Token: Decoding Strategy in Alleviating Hallucinations for MLLMs☆157Updated 3 months ago
- Official Repository of OmniCaptioner☆147Updated 2 months ago
- [ICLR 2025] Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models☆48Updated 5 months ago
- Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models☆913Updated 3 months ago
- OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]☆1,303Updated 3 weeks ago
- An MBTI Exploration of Large Language Models☆485Updated last year