The official repository of "Video assistant towards large language model makes everything easy"
β232Dec 24, 2024Updated last year
Alternatives and similar repositories for Valley
Users that are interested in Valley are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- β32Jul 29, 2024Updated 2 years ago
- [ACL 2024 π₯] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capβ¦β1,514Sep 5, 2026Updated last month
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)β863Jul 29, 2024Updated 2 years ago
- [CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingβ428May 8, 2025Updated last year
- [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingβ3,139Jun 4, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.β3,365Jul 17, 2026Updated 3 months ago
- β81Nov 24, 2024Updated last year
- A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!β141Dec 31, 2023Updated 2 years ago
- β159Oct 31, 2024Updated 2 years ago
- [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".β294Jun 13, 2024Updated 2 years ago
- A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilityβ110Nov 28, 2024Updated last year
- [CVPR 2024 Highlightπ₯] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingβ945Oct 16, 2024Updated 2 years ago
- Official repository for the paper PLLaVAβ669Jul 28, 2024Updated 2 years ago
- γEMNLP 2024π₯γVideo-LLaVA: Learning United Visual Representation by Alignment Before Projectionβ3,508Dec 3, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- β134Dec 22, 2023Updated 2 years ago
- [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understandingβ708Jan 29, 2025Updated last year
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Contentβ606Oct 6, 2024Updated 2 years ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Modelβ282Jun 25, 2024Updated 2 years ago
- γICLR 2024π₯γ Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentβ887Mar 25, 2024Updated 2 years ago
- Long Context Transfer from Language to Visionβ413Mar 18, 2025Updated last year
- mPLUG-Owl: The Powerful Multi-modal Large Language Model Familyβ2,539Apr 2, 2025Updated last year
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.β181Jan 30, 2025Updated last year
- PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Modelsβ263Sep 5, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ECCV2024] Video Foundation Models & Data for Multimodal Understandingβ2,414Jul 2, 2026Updated 3 months ago
- SVIT: Scaling up Visual Instruction Tuningβ168Jun 20, 2024Updated 2 years ago
- [ECCV 2024π₯] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"β156Sep 10, 2024Updated 2 years ago
- FreeVA: Offline MLLM as Training-Free Video Assistantβ70Jun 9, 2024Updated 2 years ago
- β4,730Jun 15, 2026Updated 4 months ago
- β195Oct 14, 2024Updated 2 years ago
- official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Inputβ67Aug 30, 2024Updated 2 years ago
- FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, β¦β104Dec 25, 2025Updated 10 months ago
- Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, video, and audio data.β297Sep 14, 2026Updated last month
- Simple, predictable pricing with DigitalOcean hosting β’ AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, β¦β132Apr 4, 2025Updated last year
- LLMBind: A Unified Modality-Task Integration Frameworkβ19Jun 16, 2024Updated 2 years ago
- This repository contains the dataset, codebase, and benchmarks for our paper: <CNVid-3.5M: Build, Filter, and Pre-train the Large-scale Pβ¦β26Nov 28, 2023Updated 2 years ago
- [ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Modelsβ346May 27, 2024Updated 2 years ago
- β107Dec 23, 2022Updated 3 years ago
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMsβ1,307Jan 23, 2025Updated last year
- [CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachersβ711Oct 25, 2024Updated 2 years ago