zhuyiche / llava-phi
☆365Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for llava-phi
- An open-source implementation for training LLaVA-NeXT.☆386Updated 2 weeks ago
- MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆286Updated this week
- EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders☆535Updated last month
- ☆356Updated 5 months ago
- LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images☆318Updated last month
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆148Updated last month
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆294Updated 3 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆268Updated 6 months ago
- Long Context Transfer from Language to Vision☆327Updated 2 weeks ago
- a family of highly capabale yet efficient large multimodal models☆161Updated 2 months ago
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆270Updated 2 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆209Updated 2 weeks ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆175Updated 3 weeks ago
- Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding☆211Updated 2 months ago
- (2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding☆240Updated 3 months ago
- When do we not need larger vision models?☆333Updated 2 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆703Updated 9 months ago
- ☆152Updated 4 months ago
- [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of …☆456Updated 3 months ago
- (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.☆317Updated 3 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆244Updated 4 months ago
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆170Updated 2 weeks ago
- Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference☆255Updated 2 months ago
- LLaVA-Interactive-Demo☆352Updated 3 months ago
- [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models☆223Updated last month
- RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness☆230Updated this week
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)☆263Updated this week
- Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆109Updated 3 months ago
- OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆270Updated 2 weeks ago
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer☆197Updated 7 months ago