yunlong10 / Awesome-LLMs-for-Video-Understanding
🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.
☆1,502Updated last month
Related projects ⓘ
Alternatives and complementary repositories for Awesome-LLMs-for-Video-Understanding
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs☆847Updated this week
- 【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment☆717Updated 7 months ago
- Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks☆1,294Updated this week
- ☆2,815Updated 3 weeks ago
- Recent LLM-based CV and related works. Welcome to comment/contribute!☆837Updated 5 months ago
- [ECCV2024] Video Foundation Models & Data for Multimodal Understanding☆1,402Updated last month
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆703Updated 9 months ago
- Mixture-of-Experts for Large Vision-Language Models☆1,971Updated 5 months ago
- Next-Token Prediction is All You Need☆1,786Updated 2 weeks ago
- Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding☆552Updated last month
- [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding☆524Updated last week
- A family of lightweight multimodal models.☆928Updated 2 weeks ago
- A Framework of Small-scale Large Multimodal Models☆635Updated 3 weeks ago
- 【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection☆2,966Updated last month
- [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the cap…☆1,206Updated 2 months ago
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)☆728Updated 3 months ago
- [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding☆2,790Updated 5 months ago
- ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆402Updated 4 months ago
- Official repository for the paper PLLaVA☆581Updated 3 months ago
- VisionLLM Series☆900Updated 3 weeks ago
- A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''☆1,186Updated 7 months ago
- ✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM☆947Updated 2 weeks ago
- Famous Vision Language Models and Their Architectures☆401Updated 2 months ago
- InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output☆2,509Updated 3 weeks ago
- Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,011Updated this week
- Cambrian-1 is a family of multimodal LLMs with a vision-centric design.☆1,749Updated last week
- ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs.☆611Updated 4 months ago
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆583Updated 2 weeks ago
- VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and…☆1,968Updated last week
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,297Updated 2 months ago