Alternatives and similar repositories for SpaceTimeGPT

Users that are interested in SpaceTimeGPT are comparing it to the libraries listed below

• NVlabs / LITA
  ☆192Updated last year
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆84Updated 6 months ago
• yukw777 / EILEV
  EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties
  ☆131Updated last year
• LAION-AI / General-GPT
  ☆65Updated 2 years ago
• kkahatapitiya / LangRepo
  Code for our ACL 2025 paper "Language Repository for Long Video Understanding"
  ☆34Updated last year
• yukw777 / VideoBLIP
  Supercharged BLIP-2 that can handle videos
  ☆123Updated 2 years ago
• mbzuai-oryx / Video-LLaVA
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
  ☆261Updated 6 months ago
• sanjayss34 / codevqa
  ☆83Updated 2 years ago
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated 2 years ago
• cg1177 / VideoLLM
  VideoLLM: Modeling Video Sequence with Large Language Models
  ☆158Updated 2 years ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated 2 years ago
• mfarre / Video-LLaVA-7B-hf-CinePile
  Video-LlaVA fine-tune for CinePile evaluation
  ☆51Updated last year
• facebookresearch / HierVL
  [CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings
  ☆46Updated 2 years ago
• gregor-ge / mBLIP
  ☆87Updated 2 years ago
• ilkerkesen / ViLMA
  ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models (ICLR 2024, Official Implementation)
  ☆16Updated 2 years ago
• antoyang / VidChapters
  [NeurIPS 2023 D&B] VidChapters-7M: Video Chapters at Scale
  ☆203Updated 2 years ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆69Updated 9 months ago
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• CeeZh / LLoVi
  Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"
  ☆106Updated last year
• Understanding-Visual-Datasets / VisDiff
  Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)
  ☆129Updated 3 months ago
• KastanDay / video-pretrained-transformer
  Multi-model video-to-text by combining embeddings from Flan-T5 + CLIP + Whisper + SceneGraph. The 'backbone LLM' is pre-trained from scra…
  ☆54Updated 2 years ago
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆164Updated last year
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆105Updated 2 years ago
• aimagelab / LLaVA-MORE
  [ICCVW 25] LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning
  ☆158Updated 6 months ago
• jylins / videoxum
  [TMM 2023] VideoXum: Cross-modal Visual and Textural Summarization of Videos
  ☆53Updated last year
• amazon-science / QA-ViT
  ☆71Updated last year
• kahnchana / mvu
  🤖 [ICLR'25] Multimodal Video Understanding Framework (MVU)
  ☆54Updated last year
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆122Updated last year
• AskYoutubeAI / AskVideos-VideoCLIP
  ☆92Updated last year
• Hritikbansal / videocon
  ☆58Updated last year