yunlong10 / Awesome-LLMs-for-Video-UnderstandingLinks
π₯π₯π₯Latest Papers, Codes and Datasets on Vid-LLMs.
β2,553Updated this week
Alternatives and similar repositories for Awesome-LLMs-for-Video-Understanding
Users that are interested in Awesome-LLMs-for-Video-Understanding are comparing it to the libraries listed below
Sorting:
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMsβ1,201Updated 6 months ago
- β4,059Updated last month
- Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarksβ2,797Updated this week
- [ECCV2024] Video Foundation Models & Data for Multimodal Understandingβ1,984Updated last month
- γICLR 2024π₯γ Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentβ819Updated last year
- γEMNLP 2024π₯γVideo-LLaVA: Learning United Visual Representation by Alignment Before Projectionβ3,320Updated 7 months ago
- [ICCV 2025] LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoningβ2,037Updated last week
- [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingβ3,045Updated last year
- [ACL 2024 π₯] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capβ¦β1,406Updated 4 months ago
- γTMM 2025π₯γ Mixture-of-Experts for Large Vision-Language Modelsβ2,198Updated 2 weeks ago
- An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.β1,007Updated last week
- Frontier Multimodal Foundation Models for Image and Video Understandingβ911Updated 2 months ago
- Famous Vision Language Models and Their Architecturesβ955Updated 5 months ago
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionsβ2,874Updated 2 months ago
- A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''β1,321Updated last year
- Next-Token Prediction is All You Needβ2,173Updated 4 months ago
- A Framework of Small-scale Large Multimodal Modelsβ863Updated 3 months ago
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)β824Updated last year
- Cambrian-1 is a family of multimodal LLMs with a vision-centric design.β1,932Updated 9 months ago
- [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understandingβ635Updated 6 months ago
- VisionLLM Seriesβ1,094Updated 5 months ago
- Recent LLM-based CV and related works. Welcome to comment/contribute!β869Updated 4 months ago
- A family of lightweight multimodal models.β1,023Updated 8 months ago
- VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and clouβ¦β3,450Updated last week
- Emu Series: Generative Multimodal Models from BAAIβ1,737Updated 10 months ago
- Witness the aha moment of VLM with less than $3.β3,873Updated 2 months ago
- Strong and Open Vision Language Assistant for Mobile Devicesβ1,244Updated last year
- Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understandingβ626Updated 7 months ago
- β¨β¨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysisβ611Updated 2 months ago
- A fork to add multimodal model training to open-r1β1,346Updated 5 months ago