Alternatives and similar repositories for ST-LLM:

Users that are interested in ST-LLM are comparing it to the libraries listed below

• imagegridworth / IG-VLM
  ☆132Updated 4 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆98Updated last week
• Ziyang412 / VideoTree
  Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"
  ☆92Updated 6 months ago
• huangb23 / VTimeLLM
  [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".
  ☆248Updated 8 months ago
• hshjerry / VideoEspresso
  VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆49Updated last month
• TimeMarker-LLM / TimeMarker
  A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability
  ☆87Updated 2 months ago
• scofield7419 / Video-of-Thought
  Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"
  ☆87Updated 2 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆156Updated 4 months ago
• WHB139426 / Grounded-Video-LLM
  Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
  ☆81Updated 2 months ago
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆49Updated 3 weeks ago
• RifleZhang / LLaVA-Hound-DPO
  ☆137Updated 3 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆59Updated 5 months ago
• longvideobench / LongVideoBench
  [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆85Updated 6 months ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆89Updated 7 months ago
• wxh1996 / VideoAgent
  ☆67Updated 2 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆125Updated last year
• DCDmllm / Momentor
  ☆65Updated 2 months ago
• KangarooGroup / Kangaroo
  official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input
  ☆63Updated 5 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆37Updated 3 months ago
• egoschema / EgoSchema
  ☆84Updated last month
• yongliang-wu / NumPro
  [Preprint] Number it: Temporal Grounding Videos like Flipping Manga
  ☆54Updated 2 months ago
• keshik6 / HourVideo
  [NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understanding
  ☆62Updated last month
• bigai-nlco / VideoLLaMB
  Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
  ☆61Updated 4 months ago
• Yxxxb / VoCo-LLaMA
  VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆95Updated 7 months ago
• mbzuai-oryx / Video-LLaVA
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
  ☆250Updated last year
• IVGSZ / Flash-VStream
  This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"
  ☆159Updated last month
• X2FD / LVIS-INSTRUCT4V
  ☆132Updated last year
• CeeZh / LLoVi
  Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"
  ☆92Updated 3 months ago
• dongyh20 / Insight-V
  Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆128Updated last month