Alternatives and similar repositories for GPT4Video

Users that are interested in GPT4Video are comparing it to the libraries listed below

• Deaddawn / DreamFrame-code
  ☆183Updated 2 months ago
• sterzhang / image-textualization
  Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)
  ☆167Updated last year
• aim-uofa / AutoStory
  [IJCV'24] AutoStory: Generating Diverse Storytelling Images with Minimal Human Effort
  ☆151Updated 11 months ago
• md-mohaiminul / VideoRecap
  ☆194Updated last year
• WangWenhao0716 / VidProM
  [NeurIPS 2024] VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models
  ☆163Updated last year
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆277Updated last year
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆157Updated 8 months ago
• hyc2026 / StoryTeller
  ☆78Updated 7 months ago
• mulanai / MuLan
  MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)
  ☆140Updated 9 months ago
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆43Updated last year
• vaew / SkyScript-100M
  SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2
  ☆127Updated 11 months ago
• cnzzx / VSA
  Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  ☆126Updated 11 months ago
• invictus717 / InteractiveVideo
  InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions
  ☆129Updated last year
• bytedance / Valley
  Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.
  ☆253Updated 2 months ago
• mutonix / Vript
  ☆155Updated 9 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• will-singularity / Skywork-MM
  Empirical Study Towards Building An Effective Multi-Modal Large Language Model
  ☆22Updated 2 years ago
• FudanNLPLAB / MouSi
  ☆74Updated last year
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆395Updated 7 months ago
• hlchen23 / ADPN-MM
  Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundi…
  ☆51Updated last year
• DLYuanGod / ArtGPT-4
  Artistic Vision-Language Understanding with Adapter-enhanced MiniGPT-4
  ☆28Updated 2 years ago
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆91Updated last year
• mshukor / UnIVAL
  [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.
  ☆231Updated last year
• zhenyuw16 / GenArtist
  Code release for our NeurIPS 2024 Spotlight paper "GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing"
  ☆153Updated last year
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆243Updated last year
• farewellthree / PPLLaVA
  Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"
  ☆130Updated 11 months ago
• mengcye / LAION-SG
  ☆56Updated 6 months ago
• JourneyDB / JourneyDB
  ☆178Updated 2 years ago
• bytedance / vidi
  The official repo for "Vidi: Large Multimodal Models for Video Understanding and Editing"
  ☆141Updated last month
• WePOINTS / WePOINTS
  ☆186Updated 8 months ago