Alternatives and similar repositories for GPT4Video

Users that are interested in GPT4Video are comparing it to the libraries listed below

• Deaddawn / DreamFrame-code
  ☆181Updated this week
• sterzhang / image-textualization
  Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)
  ☆164Updated last year
• md-mohaiminul / VideoRecap
  ☆187Updated last year
• cnzzx / VSA
  Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  ☆125Updated 8 months ago
• aim-uofa / AutoStory
  [IJCV'24] AutoStory: Generating Diverse Storytelling Images with Minimal Human Effort
  ☆152Updated 8 months ago
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆44Updated last year
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆278Updated last year
• FudanNLPLAB / MouSi
  ☆73Updated last year
• mulanai / MuLan
  MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)
  ☆137Updated 6 months ago
• hlchen23 / ADPN-MM
  Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundi…
  ☆50Updated last year
• WangWenhao0716 / VidProM
  [NeurIPS 2024] VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models
  ☆158Updated 10 months ago
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆230Updated last year
• hyc2026 / StoryTeller
  ☆75Updated 4 months ago
• will-singularity / Skywork-MM
  Empirical Study Towards Building An Effective Multi-Modal Large Language Model
  ☆22Updated last year
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• mutonix / Vript
  ☆154Updated 6 months ago
• bytedance / vidi
  The official repo for "Vidi: Large Multimodal Models for Video Understanding and Editing"
  ☆126Updated last month
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆86Updated 9 months ago
• OpenGVLab / ControlLLM
  ControlLLM: Augment Language Models with Tools by Searching on Graphs
  ☆193Updated last year
• invictus717 / InteractiveVideo
  InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions
  ☆128Updated last year
• zhenyuw16 / GenArtist
  Code release for our NeurIPS 2024 Spotlight paper "GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing"
  ☆142Updated 9 months ago
• vaew / SkyScript-100M
  SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2
  ☆125Updated 8 months ago
• bytedance / Valley
  Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.
  ☆245Updated 5 months ago
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆147Updated 6 months ago
• farewellthree / PPLLaVA
  Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"
  ☆130Updated 8 months ago
• mshukor / UnIVAL
  [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.
  ☆228Updated last year
• ggg0919 / cantor
  ☆86Updated last year
• IVGSZ / Flash-VStream
  This is the official implementation of ICCV 2025 "Flash-VStream: Efficient Real-Time Understanding for Long Video Streams"
  ☆216Updated 3 weeks ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆388Updated 4 months ago
• WePOINTS / WePOINTS
  ☆173Updated 5 months ago