Yuliang-Liu / Monkey
【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models
☆1,749Updated last week
Alternatives and similar repositories for Monkey:
Users that are interested in Monkey are comparing it to the libraries listed below
- Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.☆2,390Updated this week
- Align Anything: Training All-modality Model with Feedback☆3,448Updated this week
- [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception☆563Updated 11 months ago
- OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]☆1,276Updated 4 months ago
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆716Updated 2 weeks ago
- [ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.☆1,825Updated 3 months ago
- Real-time and accurate open-vocabulary end-to-end object detection☆1,313Updated 4 months ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,053Updated 6 months ago
- [ECCV 2024] The official code of paper "Open-Vocabulary SAM".☆958Updated 8 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆562Updated 10 months ago
- A family of lightweight multimodal models.☆1,014Updated 5 months ago
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,171Updated 3 weeks ago
- An MBTI Exploration of Large Language Models☆473Updated last year
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆133Updated 3 months ago
- Pioneering Multimodal Reasoning with CoT☆2,159Updated this week
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,350Updated 3 weeks ago
- Large-Scale Visual Representation Model☆661Updated this week
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆257Updated last year
- [CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale☆1,119Updated 6 months ago
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆440Updated last month
- 🔥 Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos☆1,060Updated last week
- [ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列☆1,057Updated 10 months ago
- A tutorial based on MetaGPT to quickly help you understand the concept of agent and muti-agent and get started with coding development. 基…☆1,206Updated 11 months ago
- A Semantic Controllable Self-Supervised Learning Framework to learn general human representations from massive unlabeled human images, wh…☆1,447Updated last year
- On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)☆598Updated 2 months ago
- [CVPR'23] Universal Instance Perception as Object Discovery and Retrieval☆1,269Updated last year
- minimal-cost for training 0.5B R1-Zero☆706Updated this week
- Build multimodal language agents for fast prototype and production☆2,472Updated last month
- adds Sequence Parallelism into LLaMA-Factory☆464Updated last week
- Official Repo for Paper ‘’HealthGPT : A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous K…☆1,152Updated 3 weeks ago