mlpc-ucsd / BLIVA
(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions
☆253Updated 10 months ago
Alternatives and similar repositories for BLIVA:
Users that are interested in BLIVA are comparing it to the libraries listed below
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆541Updated 8 months ago
- An open-source implementation for training LLaVA-NeXT.☆378Updated 3 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆153Updated 4 months ago
- [NeurIPS 2024] Matryoshka Query Transformer for Large Vision-Language Models☆96Updated 7 months ago
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆127Updated last month
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆170Updated 3 months ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆152Updated last month
- [ICLR 2025] Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆122Updated 2 months ago
- u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model☆129Updated 7 months ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆113Updated 10 months ago
- [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"☆460Updated 9 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆236Updated last month
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.☆102Updated last week
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆289Updated this week
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆90Updated 10 months ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,039Updated 4 months ago
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆618Updated this week
- [NeurIPS 2022] Official Code for REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering☆99Updated 5 months ago
- ☆372Updated 2 months ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆104Updated 4 months ago
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆388Updated 6 months ago
- [NeurIPS 2024] AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation☆92Updated 4 months ago
- 【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?☆231Updated 2 months ago
- [MM'24 Oral] Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval☆121Updated 5 months ago
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆276Updated last month
- GPT4Vis: What Can GPT-4 Do for Zero-shot Visual Recognition?☆186Updated 9 months ago
- Official Repository of ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning☆209Updated 4 months ago
- [NAACL 2025] From redundancy to relevance: Enhancing explainability in multimodal large language models☆82Updated last week
- The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆145Updated this week