mbzuai-oryx / LLaVA-pp
🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
☆794Updated 2 months ago
Related projects: ⓘ
- Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding☆535Updated last month
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs☆719Updated this week
- Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation☆644Updated last month
- Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.☆1,904Updated this week
- Official repository for the paper PLLaVA☆551Updated last month
- ☆2,395Updated this week
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆692Updated 7 months ago
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)☆688Updated last month
- SEED-Story: Multimodal Long Story Generation with Large Language Model☆692Updated last month
- A family of lightweight multimodal models.☆877Updated 2 weeks ago
- Mixture-of-Experts for Large Vision-Language Models☆1,911Updated 4 months ago
- GPT4V-level open-source multi-modal model based on Llama3-8B☆1,976Updated 2 weeks ago
- ☆544Updated this week
- DeepSeek-VL: Towards Real-World Vision-Language Understanding☆2,007Updated 4 months ago
- MobiLlama : Small Language Model tailored for edge devices☆583Updated 6 months ago
- Multimodal Models in Real World☆372Updated 2 months ago
- HPT - Open Multimodal LLMs from HyperGAI☆309Updated 3 months ago
- InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output☆2,449Updated 2 weeks ago
- ✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM☆751Updated this week
- mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding☆1,318Updated last week
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆842Updated 6 months ago
- Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks☆1,018Updated this week
- Pandora: Towards General World Model with Natural Language Actions and Video States☆460Updated this week
- VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and…☆1,786Updated last week
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,069Updated last month
- [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model☆283Updated last month
- Strong and Open Vision Language Assistant for Mobile Devices☆971Updated 5 months ago
- Latte: Latent Diffusion Transformer for Video Generation.☆1,637Updated last week
- Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)☆587Updated 2 weeks ago
- BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs☆497Updated last year