Alternatives and similar repositories for video-pretrained-transformer:

Users that are interested in video-pretrained-transformer are comparing it to the libraries listed below

• TXH-mercury / COSA
  [ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
  ☆41Updated last month
• showlab / cosmo
  ☆72Updated 8 months ago
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆31Updated 7 months ago
• facebookresearch / ProcedureVRL
  [CVPR 2023] Official code for "Learning Procedure-aware Video Representation from Instructional Videos and Their Narrations"
  ☆52Updated last year
• kahnchana / mvu
  Multimodal Video Understanding Framework (MVU)
  ☆27Updated 8 months ago
• facebookresearch / EgoObjects
  [ICCV2023] EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understanding
  ☆75Updated last year
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆97Updated 2 months ago
• Ziyang412 / VideoTree
  Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"
  ☆92Updated 5 months ago
• Shahzadnit / EZ-CLIP
  ☆17Updated 9 months ago
• facebookresearch / HierVL
  [CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings
  ☆45Updated last year
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆89Updated 6 months ago
• MCR-PEFT / Ex-MCR
  ☆41Updated last year
• cg1177 / VideoLLM
  VideoLLM: Modeling Video Sequence with Large Language Models
  ☆154Updated last year
• kyegomez / PALI
  Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
  ☆88Updated 10 months ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆47Updated 5 months ago
• NVlabs / LITA
  ☆156Updated 3 months ago
• yukw777 / VideoBLIP
  Supercharged BLIP-2 that can handle videos
  ☆117Updated last year
• facebookresearch / EgoVLPv2
  Code release for "EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone" [ICCV, 2023]
  ☆93Updated 6 months ago
• imagegridworth / IG-VLM
  ☆130Updated 4 months ago
• callsys / TextVR
  [PR 2024] A large Cross-Modal Video Retrieval Dataset with Reading Comprehension
  ☆24Updated last year
• GenjiB / ECLIPSE
  ☆31Updated last year
• j-min / HiREST
  Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)
  ☆96Updated last week
• showlab / videogui
  [NeurIPS2024] VideoGUI: A Benchmark for GUI Automation from Instructional Videos
  ☆27Updated last month
• facebookresearch / EgoT2
  Code release for the paper "Egocentric Video Task Translation" (CVPR 2023 Highlight)
  ☆32Updated last year
• isekai-portal / Link-Context-Learning
  ☆92Updated 8 months ago
• yukw777 / EILEV
  EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties
  ☆118Updated 2 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆39Updated last week
• kyegomez / MC-ViT
  Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"
  ☆19Updated this week
• OpenGVLab / EgoVideo
  [CVPR 2024 Champions] Solutions for EgoVis Chanllenges in CVPR 2024
  ☆114Updated 6 months ago
• liveseongho / Awesome-Video-Language-Understanding
  A Survey on video and language understanding.
  ☆48Updated last year