Alternatives and similar repositories for GPT4Video

Users that are interested in GPT4Video are comparing it to the libraries listed below

• Deaddawn / DreamFrame-code
  ☆185Updated 5 months ago
• sterzhang / image-textualization
  Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)
  ☆171Updated last year
• md-mohaiminul / VideoRecap
  ☆201Updated last year
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆280Updated last year
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated 2 years ago
• will-singularity / Skywork-MM
  Empirical Study Towards Building An Effective Multi-Modal Large Language Model
  ☆22Updated 2 years ago
• aim-uofa / AutoStory
  [IJCV'24] AutoStory: Generating Diverse Storytelling Images with Minimal Human Effort
  ☆150Updated last year
• hyc2026 / StoryTeller
  ☆81Updated 9 months ago
• FudanNLPLAB / MouSi
  ☆75Updated last year
• mulanai / MuLan
  MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)
  ☆144Updated 11 months ago
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆164Updated 11 months ago
• cnzzx / VSA
  Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  ☆128Updated last year
• hlchen23 / ADPN-MM
  Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundi…
  ☆52Updated 2 years ago
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆43Updated last year
• WangWenhao0716 / VidProM
  [NeurIPS 2024] VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models
  ☆170Updated last year
• vaew / SkyScript-100M
  SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2
  ☆133Updated last year
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆98Updated last year
• farewellthree / PPLLaVA
  Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"
  ☆130Updated last year
• mutonix / Vript
  ☆158Updated 11 months ago
• DLYuanGod / ArtGPT-4
  Artistic Vision-Language Understanding with Adapter-enhanced MiniGPT-4
  ☆28Updated 2 years ago
• invictus717 / InteractiveVideo
  InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions
  ☆132Updated last year
• mshukor / UnIVAL
  [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.
  ☆232Updated 2 years ago
• bytedance / Portrait-Mode-Video
  Video dataset dedicated to portrait-mode video recognition.
  ☆55Updated 2 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆146Updated this week
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆398Updated 9 months ago
• showlab / MovieBench
  [CVPR 2025] A Hierarchical Movie Level Dataset for Long Video Generation
  ☆77Updated 9 months ago
• OpenGVLab / ControlLLM
  ControlLLM: Augment Language Models with Tools by Searching on Graphs
  ☆194Updated last year
• modelscope / lite-sora
  An initiative to replicate Sora
  ☆104Updated last year
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆48Updated last year
• Alpha-VLLM / WeMix-LLM
  ☆17Updated 2 years ago