Alternatives and similar repositories for GPT4Video

Users that are interested in GPT4Video are comparing it to the libraries listed below

• Deaddawn / DreamFrame-code
  ☆183Updated last month
• sterzhang / image-textualization
  Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)
  ☆166Updated last year
• md-mohaiminul / VideoRecap
  ☆191Updated last year
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆278Updated last year
• aim-uofa / AutoStory
  [IJCV'24] AutoStory: Generating Diverse Storytelling Images with Minimal Human Effort
  ☆152Updated 9 months ago
• cnzzx / VSA
  Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  ☆126Updated 10 months ago
• mulanai / MuLan
  MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)
  ☆141Updated 7 months ago
• WangWenhao0716 / VidProM
  [NeurIPS 2024] VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models
  ☆163Updated 11 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆155Updated 7 months ago
• FudanNLPLAB / MouSi
  ☆74Updated last year
• mshukor / UnIVAL
  [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.
  ☆229Updated last year
• vaew / SkyScript-100M
  SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2
  ☆126Updated 10 months ago
• invictus717 / InteractiveVideo
  InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions
  ☆129Updated last year
• OpenGVLab / ControlLLM
  ControlLLM: Augment Language Models with Tools by Searching on Graphs
  ☆193Updated last year
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆392Updated 5 months ago
• mutonix / Vript
  ☆155Updated 7 months ago
• hyc2026 / StoryTeller
  ☆78Updated 6 months ago
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆240Updated last year
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆43Updated last year
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆90Updated 10 months ago
• hlchen23 / ADPN-MM
  Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundi…
  ☆51Updated last year
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR 2024]
  ☆227Updated 5 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated last week
• SHI-Labs / CuMo
  CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
  ☆153Updated last year
• farewellthree / PPLLaVA
  Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"
  ☆129Updated 9 months ago
• zhenyuw16 / GenArtist
  Code release for our NeurIPS 2024 Spotlight paper "GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing"
  ☆147Updated 10 months ago
• invictus717 / MiCo
  [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale
  ☆115Updated last year
• modelscope / lite-sora
  An initiative to replicate Sora
  ☆103Updated last year
• DLYuanGod / ArtGPT-4
  Artistic Vision-Language Understanding with Adapter-enhanced MiniGPT-4
  ☆27Updated 2 years ago