Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks
☆313Jan 8, 2024Updated 2 years ago
Alternatives and similar repositories for Youku-mPLUG
Users that are interested in Youku-mPLUG are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections. (EMNLP 2022)☆97May 8, 2023Updated 3 years ago
- mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)☆228Jul 21, 2023Updated 3 years ago
- mPLUG-Owl: The Powerful Multi-modal Large Language Model Family☆2,540Apr 2, 2025Updated last year
- A Chinese Open-Domain Dialogue System☆323Aug 16, 2023Updated 3 years ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆99Jan 29, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding☆3,138Jun 4, 2024Updated 2 years ago
- Multimodal chatbot with computer vision capabilities integrated, our 1st-gen LMM☆102May 17, 2024Updated 2 years ago
- [TPAMI2024] Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆311Dec 25, 2024Updated last year
- This repository contains the dataset, codebase, and benchmarks for our paper: <CNVid-3.5M: Build, Filter, and Pre-train the Large-scale P…☆26Nov 28, 2023Updated 2 years ago
- Large-scale text-video dataset. 10 million captioned short videos.☆689Aug 14, 2024Updated 2 years ago
- Emu Series: Generative Multimodal Models from BAAI☆1,776Jan 12, 2026Updated 9 months ago
- [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.☆3,363Jul 17, 2026Updated 3 months ago
- Bridging Vision and Language Model☆287Mar 27, 2023Updated 3 years ago
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆1,034Apr 12, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the cap…☆1,516Sep 5, 2026Updated 2 months ago
- X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages☆316Jul 14, 2026Updated 3 months ago
- SVIT: Scaling up Visual Instruction Tuning☆168Jun 20, 2024Updated 2 years ago
- [ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models☆346May 27, 2024Updated 2 years ago
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,928May 26, 2025Updated last year
- Touchstone: Evaluating Vision-Language Models by Language Models☆84Jan 18, 2024Updated 2 years ago
- 【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment☆888Mar 25, 2024Updated 2 years ago
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆606Oct 6, 2024Updated 2 years ago
- Multi-modality pre-training☆511Aug 28, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Chinese CLIP models with SOTA performance.☆62Aug 28, 2023Updated 3 years ago
- Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.☆6,042Mar 31, 2026Updated 7 months ago
- [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding☆711Jan 29, 2025Updated last year
- 【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection☆3,510Dec 3, 2024Updated last year
- [ECCV2024] Video Foundation Models & Data for Multimodal Understanding☆2,416Jul 2, 2026Updated 4 months ago
- EVA Series: Visual Representation Fantasies from BAAI☆2,698Aug 1, 2024Updated 2 years ago
- The official repository of "Video assistant towards large language model makes everything easy"☆232Dec 24, 2024Updated last year
- [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning☆297Mar 13, 2024Updated 2 years ago
- 🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing imp…☆3,442Mar 5, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [CVPR2023] All in One: Exploring Unified Video-Language Pre-training☆281Mar 25, 2023Updated 3 years ago
- Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration☆1,592Jan 1, 2025Updated last year
- ☆134Dec 22, 2023Updated 2 years ago
- [CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers☆710Oct 25, 2024Updated 2 years ago
- ☆814Jul 8, 2024Updated 2 years ago
- Align and Prompt: Video-and-Language Pre-training with Entity Prompts☆189May 1, 2025Updated last year
- ☆163Jan 16, 2025Updated last year
Are these results useful?