Yuliang-Liu / Monkey
【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models
☆1,756Updated 3 weeks ago
Alternatives and similar repositories for Monkey
Users that are interested in Monkey are comparing it to the libraries listed below
Sorting:
- Align Anything: Training All-modality Model with Feedback☆3,650Updated 2 weeks ago
- Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.☆2,483Updated this week
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆720Updated this week
- [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception☆565Updated last year
- OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]☆1,291Updated 5 months ago
- A family of lightweight multimodal models.☆1,016Updated 5 months ago
- Real-time and accurate open-vocabulary end-to-end object detection☆1,318Updated 4 months ago
- [ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.☆1,830Updated 4 months ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,057Updated 7 months ago
- [ECCV 2024] The official code of paper "Open-Vocabulary SAM".☆962Updated 9 months ago
- Build multimodal language agents for fast prototype and production☆2,479Updated last month
- [ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列☆1,056Updated 11 months ago
- Skywork-R1V2:Multimodal Hybrid Reinforcement Learning for Reasoning (Best open-source multimodal reasoning m…☆2,519Updated last week
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆257Updated last year
- 🔥 Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos☆1,083Updated 2 weeks ago
- [CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"☆817Updated 2 weeks ago
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,173Updated last month
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆132Updated 4 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆563Updated 11 months ago
- A Semantic Controllable Self-Supervised Learning Framework to learn general human representations from massive unlabeled human images, wh…☆1,449Updated last year
- Large-Scale Visual Representation Model☆668Updated 2 weeks ago
- Collection of AWESOME vision-language models for vision tasks☆2,720Updated this week
- [CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale☆1,123Updated 6 months ago
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,396Updated 2 weeks ago
- An MBTI Exploration of Large Language Models☆478Updated last year
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆448Updated 2 months ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆335Updated 2 months ago
- [CVPR'23] Universal Instance Perception as Object Discovery and Retrieval☆1,270Updated last year
- Official repository of ’Visual-RFT: Visual Reinforcement Fine-Tuning’☆1,656Updated 3 weeks ago
- DeepRetrieval - Hacking 🔥Real Search Engines and Retrievers with LLM via RL☆491Updated last week