Alternatives and similar repositories for AskVideos-VideoCLIP

Users that are interested in AskVideos-VideoCLIP are comparing it to the libraries listed below

• huggingface / fineVideo
  ☆88Updated last year
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆155Updated 8 months ago
• yukw777 / VideoBLIP
  Supercharged BLIP-2 that can handle videos
  ☆121Updated last year
• NVlabs / LITA
  ☆185Updated 11 months ago
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆82Updated 2 months ago
• gpt4video / GPT4Video
  Offical Code for GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation
  ☆142Updated 11 months ago
• google / imageinwords
  Data release for the ImageInWords (IIW) paper.
  ☆220Updated 10 months ago
• hyc2026 / StoryTeller
  ☆78Updated 7 months ago
• WeihuangLin / INF-LLaVA
  INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model
  ☆42Updated last year
• Neleac / SpaceTimeGPT
  video description generation vision-language model
  ☆19Updated 8 months ago
• Gengzigang / TokenSet
  Official PyTorch implementation of TokenSet.
  ☆125Updated 6 months ago
• yukw777 / EILEV
  EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties
  ☆131Updated 11 months ago
• UCSC-VLAA / Recap-DataComp-1B
  [ICML 2025] This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆142Updated last year
• invictus717 / InteractiveVideo
  InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions
  ☆129Updated last year
• mshukor / UnIVAL
  [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.
  ☆228Updated last year
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆191Updated last year
• mfarre / Video-LLaVA-7B-hf-CinePile
  Video-LlaVA fine-tune for CinePile evaluation
  ☆51Updated last year
• md-mohaiminul / VideoRecap
  ☆192Updated last year
• salesforce / GlueGen
  ☆64Updated 3 months ago
• SHI-Labs / VisPer-LM
  [NeurIPS 2025] Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆62Updated 3 weeks ago
• KastanDay / video-pretrained-transformer
  Multi-model video-to-text by combining embeddings from Flan-T5 + CLIP + Whisper + SceneGraph. The 'backbone LLM' is pre-trained from scra…
  ☆52Updated 2 years ago
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆277Updated last year
• merveenoyan / siglip
  Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration 🤗
  ☆277Updated 7 months ago
• kyegomez / Sora
  Implementation of the premier Text to Video model from OpenAI
  ☆55Updated 11 months ago
• Hritikbansal / videocon
  ☆57Updated last year
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated last week
• HL-hanlin / VideoDirectorGPT
  official implementation of VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planning (COLM 2024)
  ☆173Updated last year
• McGill-NLP / AURORA
  Code and data for the paper: Learning Action and Reasoning-Centric Image Editing from Videos and Simulation
  ☆29Updated 3 months ago
• InfiMM / mllm-hd
  Official code for infimm-hd
  ☆16Updated last year
• CERC-AAI / Robin
  ☆63Updated last year