Alternatives and similar repositories for GPT4Video

Users that are interested in GPT4Video are comparing it to the libraries listed below

• sterzhang / image-textualization
  Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)
  ☆166Updated last year
• Deaddawn / DreamFrame-code
  ☆183Updated 2 months ago
• md-mohaiminul / VideoRecap
  ☆192Updated last year
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆277Updated last year
• cnzzx / VSA
  Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  ☆126Updated 11 months ago
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆43Updated last year
• will-singularity / Skywork-MM
  Empirical Study Towards Building An Effective Multi-Modal Large Language Model
  ☆22Updated last year
• mulanai / MuLan
  MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)
  ☆141Updated 8 months ago
• OpenGVLab / ControlLLM
  ControlLLM: Augment Language Models with Tools by Searching on Graphs
  ☆193Updated last year
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• aim-uofa / AutoStory
  [IJCV'24] AutoStory: Generating Diverse Storytelling Images with Minimal Human Effort
  ☆152Updated 10 months ago
• WangWenhao0716 / VidProM
  [NeurIPS 2024] VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models
  ☆164Updated last year
• mutonix / Vript
  ☆156Updated 8 months ago
• mshukor / UnIVAL
  [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.
  ☆229Updated last year
• FudanNLPLAB / MouSi
  ☆74Updated last year
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆241Updated last year
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆393Updated 6 months ago
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆155Updated 8 months ago
• vaew / SkyScript-100M
  SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2
  ☆126Updated 10 months ago
• hlchen23 / ADPN-MM
  Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundi…
  ☆51Updated last year
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR 2024]
  ☆227Updated 6 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated 3 weeks ago
• bytedance / Valley
  Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.
  ☆251Updated last month
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆90Updated 11 months ago
• ggg0919 / cantor
  ☆90Updated last year
• invictus717 / InteractiveVideo
  InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions
  ☆130Updated last year
• WePOINTS / WePOINTS
  ☆185Updated 8 months ago
• AILab-CVC / SEED-X
  Multimodal Models in Real World
  ☆543Updated 7 months ago
• DLYuanGod / ArtGPT-4
  Artistic Vision-Language Understanding with Adapter-enhanced MiniGPT-4
  ☆27Updated 2 years ago
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆162Updated 9 months ago