HITsz-TMG / UMOE-Scaling-Unified-Multimodal-LLMs
The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"
☆703Updated last month
Alternatives and similar repositories for UMOE-Scaling-Unified-Multimodal-LLMs:
Users that are interested in UMOE-Scaling-Unified-Multimodal-LLMs are comparing it to the libraries listed below
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,007Updated this week
- Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.☆2,242Updated this week
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,049Updated 5 months ago
- Align Anything: Training All-modality Model with Feedback☆2,967Updated this week
- 【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models☆1,730Updated this week
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆319Updated 3 weeks ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆255Updated 11 months ago
- adds Sequence Parallelism into LLaMA-Factory☆432Updated this week
- Official repository of MMGenBench☆119Updated 2 weeks ago
- Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models☆908Updated last week
- [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation☆1,053Updated 4 months ago
- [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"☆460Updated 10 months ago
- Official Repo for Paper ‘’HealthGPT : A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous K…☆674Updated this week
- Real-time and accurate open-vocabulary end-to-end object detection☆1,299Updated 3 months ago
- [NeurIPS 2024] Matryoshka Query Transformer for Large Vision-Language Models☆100Updated 8 months ago
- An MBTI Exploration of Large Language Models☆466Updated last year
- Build multimodal language agents for fast prototype and production☆2,414Updated last week
- Video generation from text&image, 1st-gen☆828Updated last month
- The official implementation of Self-Play Preference Optimization (SPPO)☆508Updated 2 months ago
- ☆1,381Updated 5 months ago
- Pioneering Multimodal Reasoning with CoT☆897Updated this week
- OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]☆1,259Updated 3 months ago
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆128Updated 2 months ago
- DeepRetrieval - Hacking 🔥Real Search Engines and Text/Data Retrievers with LLM + RL☆196Updated this week
- 🔥 🔥 🔥 [NeurIPS 2024] Hawk: Learning to Understand Open-World Video Anomalies☆189Updated 2 weeks ago
- [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception☆555Updated 10 months ago
- Improving Generalist Model with Domain-Specific Experts☆85Updated 2 months ago
- Intervening Anchor Token: Decoding Strategy in Alleviating Hallucinations for MLLMs☆152Updated 2 weeks ago
- PyTorch Implementation of AudioLCM (ACM-MM'24): a efficient and high-quality text-to-audio generation with latent consistency model.☆951Updated 3 months ago
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆282Updated 2 months ago