mynameischaos / Lion
Lion: Kindling Vision Intelligence within Large Language Models
☆52Updated last year
Alternatives and similar repositories for Lion:
Users that are interested in Lion are comparing it to the libraries listed below
- ☆133Updated last year
- SVIT: Scaling up Visual Instruction Tuning☆164Updated 9 months ago
- A collection of visual instruction tuning datasets.☆76Updated last year
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆136Updated 3 months ago
- ☆86Updated 8 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆156Updated 5 months ago
- Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs☆90Updated 2 months ago
- [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale☆204Updated last year
- ☆111Updated 7 months ago
- ☆91Updated last year
- Official repository of MMDU dataset☆86Updated 5 months ago
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆44Updated 9 months ago
- ☆61Updated last year
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆57Updated 5 months ago
- [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning☆68Updated last month
- ☆35Updated 8 months ago
- VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation☆85Updated 6 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆113Updated 3 months ago
- A lightweight flexible Video-MLLM developed by TencentQQ Multimedia Research Team.☆68Updated 5 months ago
- Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".☆58Updated last year
- [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge☆132Updated 8 months ago
- The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Ins…☆19Updated last year
- ☆95Updated last year
- [ICCV 2023] ALIP: Adaptive Language-Image Pre-training with Synthetic Caption☆97Updated last year
- Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models☆37Updated last year
- ☆69Updated 3 months ago
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆47Updated 4 months ago
- ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆96Updated 2 weeks ago
- Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learning☆17Updated last month
- A huge dataset for Document Visual Question Answering☆15Updated 7 months ago