Alternatives and similar repositories for SpaceTimeGPT:

Users that are interested in SpaceTimeGPT are comparing it to the libraries listed below

• kahnchana / mvu
  🤖 [ICLR'25] Multimodal Video Understanding Framework (MVU)
  ☆27Updated 2 weeks ago
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆40Updated last month
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆82Updated this week
• LAION-AI / General-GPT
  ☆64Updated last year
• OpenGVLab / vinci
  Vinci: A Real-time Embodied Smart Assistant based on Egocentric Vision-Language Model
  ☆41Updated last month
• yukw777 / EILEV
  EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties
  ☆118Updated 3 months ago
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆52Updated 9 months ago
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆49Updated 3 weeks ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆40Updated 3 weeks ago
• showlab / videogui
  [NeurIPS2024] VideoGUI: A Benchmark for GUI Automation from Instructional Videos
  ☆29Updated 2 months ago
• KastanDay / video-pretrained-transformer
  Multi-model video-to-text by combining embeddings from Flan-T5 + CLIP + Whisper + SceneGraph. The 'backbone LLM' is pre-trained from scra…
  ☆53Updated last year
• facebookresearch / EgoT2
  Code release for the paper "Egocentric Video Task Translation" (CVPR 2023 Highlight)
  ☆32Updated last year
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆59Updated 5 months ago
• WeihuangLin / INF-LLaVA
  INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model
  ☆41Updated 6 months ago
• Hritikbansal / videocon
  ☆56Updated 9 months ago
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆31Updated 8 months ago
• NVlabs / LITA
  ☆159Updated 4 months ago
• eric-ai-lab / ComCLIP
  Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"
  ☆35Updated 6 months ago
• showlab / cosmo
  ☆72Updated 9 months ago
• Hao840 / ADEM-VL
  PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"
  ☆18Updated 3 months ago
• TXH-mercury / COSA
  [ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
  ☆41Updated last month
• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆99Updated last year
• mfarre / Video-LLaVA-7B-hf-CinePile
  Video-LlaVA fine-tune for CinePile evaluation
  ☆46Updated 6 months ago
• bpiyush / TestOfTime
  Official code for our CVPR 2023 paper: Test of Time: Instilling Video-Language Models with a Sense of Time
  ☆45Updated 8 months ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆47Updated 6 months ago
• aimagelab / LLaVA-MORE
  LLaVA-MORE: Enhancing Visual Instruction Tuning with LLaMA 3.1
  ☆100Updated last week
• Shahzadnit / EZ-CLIP
  ☆18Updated 10 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆99Updated last week
• WangWenhao0716 / TIP-I2V
  TIP-I2V: A Million-Scale Real Text and Image Prompt Dataset for Image-to-Video Generation
  ☆29Updated 2 months ago