Alternatives and similar repositories for TimeChat:

Users that are interested in TimeChat are comparing it to the libraries listed below

• huangb23 / VTimeLLM
  [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".
  ☆250Updated 8 months ago
• OpenGVLab / VideoChat-Flash
  VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling
  ☆310Updated this week
• boheumd / MA-LMM
  (2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
  ☆274Updated 7 months ago
• rese1f / MovieChat
  [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
  ☆588Updated 3 weeks ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆360Updated 3 months ago
• mbzuai-oryx / VideoGPT-plus
  Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
  ☆258Updated 6 months ago
• mbzuai-oryx / Video-LLaVA
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
  ☆250Updated last year
• ttengwang / Awesome_Long_Form_Video_Understanding
  Awesome papers & datasets specifically focused on long-term videos.
  ☆246Updated 3 months ago
• OpenGVLab / unmasked_teacher
  [ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models
  ☆316Updated 8 months ago
• tsb0601 / MMVP
  ☆308Updated last year
• YueFan1014 / VideoAgent
  This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)
  ☆170Updated 2 months ago
• BradyFU / Video-MME
  ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
  ☆461Updated 2 months ago
• IVGSZ / Flash-VStream
  This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"
  ☆163Updated last month
• TXH-mercury / VAST
  [NIPS2023] Code and Model for VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
  ☆265Updated 11 months ago
• WisconsinAIVision / ViP-LLaVA
  [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  ☆313Updated 7 months ago
• magic-research / PLLaVA
  Official repository for the paper PLLaVA
  ☆638Updated 6 months ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆328Updated last month
• X-PLUG / mPLUG-2
  mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)
  ☆223Updated last year
• TencentARC / ST-LLM
  [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"
  ☆140Updated 5 months ago
• lzw-lzw / GroundingGPT
  [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model
  ☆318Updated 3 months ago
• MaverickRen / PixelLM
  PixelLM is an effective and efficient LMM for pixel-level reasoning and understanding. PixelLM is accepted by CVPR 2024.
  ☆206Updated last week
• apple / ml-slowfast-llava
  SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models
  ☆202Updated 5 months ago
• PKU-YuanGroup / LanguageBind
  【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  ☆784Updated 10 months ago
• OpenGVLab / LAMM
  [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
  ☆306Updated 10 months ago
• showlab / Awesome-Unified-Multimodal-Models
  📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.
  ☆374Updated last month
• dvlab-research / LLaMA-VID
  LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)
  ☆768Updated 6 months ago
• NExT-ChatV / NExT-Chat
  The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".
  ☆232Updated last year
• imagegridworth / IG-VLM
  ☆132Updated 4 months ago
• ShareGPT4Omni / ShareGPT4V
  [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
  ☆197Updated 7 months ago
• muzairkhattak / ViFi-CLIP
  [CVPR 2023] Official repository of paper titled "Fine-tuned CLIP models are efficient video learners".
  ☆264Updated 10 months ago