gpt4video / GPT4Video
Offical Code for GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation
☆137Updated 3 months ago
Alternatives and similar repositories for GPT4Video:
Users that are interested in GPT4Video are comparing it to the libraries listed below
- ☆173Updated 7 months ago
- ☆174Updated 7 months ago
- Long Context Transfer from Language to Vision☆360Updated 3 months ago
- Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs☆74Updated 3 months ago
- Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)☆155Updated 6 months ago
- Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines☆114Updated 3 months ago
- [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models☆272Updated 10 months ago
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆127Updated 3 months ago
- SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models☆202Updated 5 months ago
- ☆134Updated last month
- Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"☆124Updated 3 months ago
- ☆160Updated 7 months ago
- This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"☆163Updated last month
- Official repository of MMDU dataset☆83Updated 4 months ago
- Official repo for StableLLAVA☆94Updated last year
- ☆78Updated 9 months ago
- [NeurIPS 2024] VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models☆133Updated 4 months ago
- 🔥🔥First-ever hour scale video understanding models☆234Updated last month
- MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)☆131Updated 3 weeks ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆40Updated 7 months ago
- SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2☆113Updated 3 months ago
- ☆73Updated 11 months ago
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer☆210Updated 10 months ago
- ☆132Updated last year
- Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models☆131Updated 2 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆101Updated 2 weeks ago
- Multimodal Models in Real World☆437Updated 3 months ago
- Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundi…☆47Updated last year
- LVBench: An Extreme Long Video Understanding Benchmark☆80Updated 5 months ago
- Explore the Limits of Omni-modal Pretraining at Scale☆96Updated 5 months ago