OPPOMKLab / u-LLaVA
u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model
☆138Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for u-LLaVA
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆108Updated last month
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆85Updated 8 months ago
- GPT4Vis: What Can GPT-4 Do for Zero-shot Visual Recognition?☆207Updated 6 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆131Updated 2 weeks ago
- Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆109Updated 3 months ago
- [ICLR'24] Democratizing Fine-grained Visual Recognition with Large Language Models☆220Updated 4 months ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆108Updated 7 months ago
- [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cache☆46Updated 3 months ago
- WorldGPT: Empowering LLM as Multimodal World Model☆123Updated 3 months ago
- Official implementation of "Towards Efficient Visual Adaption via Structural Re-parameterization".☆199Updated 7 months ago
- The official code for "BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities"☆153Updated 3 weeks ago
- [CVPR'24 Highlight] SHiNe: Semantic Hierarchy Nexus for Open-vocabulary Object Detection☆72Updated 3 months ago
- [ICCV 2023] Spectrum-guided Multi-granularity Referring Video Object Segmentation.☆81Updated last month
- ☆166Updated last year
- [NeurIPS'24] Leveraging Hallucinations to Reduce Manual Prompt Dependency in Promptable Segmentation☆66Updated last week
- [MM'24 Oral] Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval☆138Updated 3 months ago
- 🚀 [NeurIPS24] Make Vision Matter in Visual-Question-Answering (VQA)! Introducing NaturalBench, a vision-centric VQA benchmark (NeurIPS'2…☆66Updated 2 weeks ago
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.☆104Updated 2 weeks ago
- ☆67Updated this week
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆149Updated 2 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆270Updated 7 months ago
- Domain-Controlled Prompt Learning （AAAI2024）☆114Updated last week
- (NeurIPS 2024) Learning to Visual Question Answering, Asking and Assessment☆64Updated 2 weeks ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆215Updated last month
- Official implementation of ECCV2022 paper End-to-End Weakly Supervised Object Detection with Sparse Proposal Evolution☆124Updated last year
- MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆291Updated last week
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆184Updated 3 weeks ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆566Updated 5 months ago
- Code for AAAl 2024 paper: Relax Image-Specific Prompt Requirement in SAM: A Single Generic Prompt for Segmenting Camouflaged Objects☆139Updated last month
- 【AAAI'2023 & IJCV】Transferring Vision-Language Models for Visual Recognition: A Classifier Perspective☆205Updated 5 months ago