mlpc-ucsd / BLIVA
(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions
☆257Updated last year
Alternatives and similar repositories for BLIVA:
Users that are interested in BLIVA are comparing it to the libraries listed below
- [NeurIPS 2024] Matryoshka Query Transformer for Large Vision-Language Models☆105Updated 10 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆563Updated 11 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆160Updated last week
- An open-source implementation for training LLaVA-NeXT.☆393Updated 6 months ago
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆133Updated 3 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆174Updated 6 months ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆155Updated 4 months ago
- [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"☆461Updated last year
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,173Updated last month
- [ICLR 2025] Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models☆43Updated 3 months ago
- [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception☆565Updated last year
- [ICML 2025 Spotlight]An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆139Updated 2 weeks ago
- ☆138Updated 2 weeks ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆113Updated last year
- [NeurIPS 2022] Official code for REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering☆101Updated last month
- Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"☆283Updated 3 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆246Updated 4 months ago
- [ICLR 2025] Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆139Updated 5 months ago
- u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model☆131Updated 3 weeks ago
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆394Updated 8 months ago
- 🔥 🔥 🔥 [NeurIPS 2024] Hawk: Learning to Understand Open-World Video Anomalies☆196Updated 3 weeks ago
- R1-like Computer-use Agent☆67Updated last month
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆94Updated last year
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆303Updated 2 months ago
- A post-training method to enhance CLIP's fine-grained visual representations with generative models.☆48Updated last month
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.☆106Updated 3 weeks ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,055Updated 6 months ago
- [SIGIR'2024 Best Paper Honorable Mention] Official repository for "LDRE: LLM-based Divergent Reasoning and Ensemble for Zero-Shot Compose…☆53Updated last month
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆107Updated last month
- ☆382Updated 4 months ago