gpt4video / GPT4Video
Offical Code for GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation
☆138Updated 5 months ago
Alternatives and similar repositories for GPT4Video:
Users that are interested in GPT4Video are comparing it to the libraries listed below
- ☆183Updated 9 months ago
- ☆175Updated 9 months ago
- Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)☆162Updated 8 months ago
- Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines☆122Updated 5 months ago
- ☆142Updated 3 months ago
- Official repo for StableLLAVA☆95Updated last year
- [NeurIPS 2024] VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models☆143Updated 6 months ago
- ☆73Updated last year
- Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models☆51Updated 3 weeks ago
- [IJCV'24] AutoStory: Generating Diverse Storytelling Images with Minimal Human Effort☆150Updated 4 months ago
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.☆129Updated 2 months ago
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆131Updated 5 months ago
- [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models☆278Updated last year
- ☆133Updated last year
- Explore the Limits of Omni-modal Pretraining at Scale☆97Updated 7 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆110Updated 2 weeks ago
- Long Context Transfer from Language to Vision☆372Updated last month
- Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"☆145Updated 2 weeks ago
- ☆17Updated last year
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆42Updated 9 months ago
- Touchstone: Evaluating Vision-Language Models by Language Models☆82Updated last year
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer☆222Updated last year
- Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs☆78Updated 5 months ago
- ☆82Updated 11 months ago
- ☆40Updated 9 months ago
- [IJCV 2025] Paragraph-to-Image Generation with Information-Enriched Diffusion Model☆103Updated 3 weeks ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆52Updated last week
- ☆169Updated 9 months ago
- FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …☆100Updated 4 months ago
- MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)☆135Updated 2 months ago