Alternatives and similar repositories for SpaceTimeGPT

Users that are interested in SpaceTimeGPT are comparing it to the libraries listed below

• NVlabs / LITA
  ☆182Updated 10 months ago
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆83Updated 3 weeks ago
• yukw777 / EILEV
  EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties
  ☆130Updated 9 months ago
• facebookresearch / HierVL
  [CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings
  ☆46Updated 2 years ago
• mfarre / Video-LLaVA-7B-hf-CinePile
  Video-LlaVA fine-tune for CinePile evaluation
  ☆51Updated last year
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆32Updated last year
• ilkerkesen / ViLMA
  ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models (ICLR 2024, Official Implementation)
  ☆16Updated last year
• LAION-AI / General-GPT
  ☆65Updated last year
• yukw777 / VideoBLIP
  Supercharged BLIP-2 that can handle videos
  ☆120Updated last year
• amazon-science / QA-ViT
  ☆69Updated last year
• antoyang / VidChapters
  [NeurIPS 2023 D&B] VidChapters-7M: Video Chapters at Scale
  ☆194Updated last year
• KastanDay / video-pretrained-transformer
  Multi-model video-to-text by combining embeddings from Flan-T5 + CLIP + Whisper + SceneGraph. The 'backbone LLM' is pre-trained from scra…
  ☆52Updated 2 years ago
• AskYoutubeAI / AskVideos-VideoCLIP
  ☆80Updated 11 months ago
• Hritikbansal / videocon
  ☆58Updated last year
• twelvelabs-io / video-embeddings-evaluation-framework
  Pytorch implementation of Twelve Labs' Video Foundation Model evaluation framework & open embeddings
  ☆29Updated last year
• sanjayss34 / codevqa
  ☆84Updated 2 years ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆65Updated 4 months ago
• mbzuai-oryx / Video-LLaVA
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
  ☆257Updated 3 weeks ago
• huggingface / fineVideo
  ☆84Updated 11 months ago
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆104Updated last year
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆162Updated 8 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆49Updated 2 months ago
• UCSC-VLAA / Recap-DataComp-1B
  [ICML 2025] This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆138Updated last year
• jylins / videoxum
  [TMM 2023] VideoXum: Cross-modal Visual and Textural Summarization of Videos
  ☆47Updated last year
• ByungKwanLee / TroL
  [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…
  ☆97Updated last year
• ByungKwanLee / Meteor
  [NeurIPS 2024] Official PyTorch implementation code for realizing the technical part of Mamba-based traversal of rationale (Meteor) to im…
  ☆115Updated last year
• IntelLabs / GraVi-T
  Graph learning framework for long-term video understanding
  ☆66Updated last month
• Understanding-Visual-Datasets / VisDiff
  Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)
  ☆120Updated last year
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆69Updated last year
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆113Updated 7 months ago