RenShuhuai-Andy / TimeChat

Related projects: ⓘ

• huangb23 / VTimeLLM
  [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".
  ☆205Updated 3 months ago
• mbzuai-oryx / Video-LLaVA
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
  ☆235Updated 8 months ago
• OpenGVLab / InternVideo2
  ☆198Updated 5 months ago
• mbzuai-oryx / VideoGPT-plus
  Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
  ☆185Updated last month
• ttengwang / Awesome_Long_Form_Video_Understanding
  Awesome papers & datasets specifically focused on long-term videos.
  ☆154Updated 2 months ago
• boheumd / MA-LMM
  (2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
  ☆211Updated 2 months ago
• tsb0601 / MMVP
  ☆277Updated 7 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆293Updated 3 weeks ago
• WisconsinAIVision / ViP-LLaVA
  [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  ☆273Updated 2 months ago
• OpenGVLab / unmasked_teacher
  [ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models
  ☆282Updated 3 months ago
• rese1f / MovieChat
  [CVPR 2024] 🎬💭 chat with over 10K frames of video!
  ☆488Updated last week
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆303Updated 2 months ago
• BradyFU / Video-MME
  ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
  ☆365Updated 3 months ago
• magic-research / PLLaVA
  Official repository for the paper PLLaVA
  ☆551Updated last month
• baaivision / EVE
  EVE: Encoder-Free Vision-Language Models
  ☆206Updated last month
• showlab / videollm-online
  VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)
  ☆173Updated last month
• TXH-mercury / VAST
  Code and Model for VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
  ☆231Updated 6 months ago
• X-PLUG / mPLUG-2
  mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)
  ☆215Updated last year
• OpenGVLab / video-mamba-suite
  The suite of modeling video with Mamba
  ☆216Updated 4 months ago
• YuchenLiu98 / COMM
  Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models
  ☆181Updated 8 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆114Updated 8 months ago
• luogen1996 / LLaVA-HR
  LLaVA-HR: High-Resolution Large Language-Vision Assistant
  ☆202Updated last month
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆114Updated 2 months ago
• YueFan1014 / VideoAgent
  This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)
  ☆98Updated last week
• jy0205 / LaVIT
  LaVIT: Empower the Large Language Model to Understand and Generate Visual Content
  ☆496Updated 2 months ago
• OpenGVLab / OmniCorpus
  OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
  ☆246Updated 3 weeks ago
• baaivision / DIVA
  Diffusion Feedback Helps CLIP See Better
  ☆200Updated 3 weeks ago
• MaverickRen / PixelLM
  PixelLM is an effective and efficient LMM for pixel-level reasoning and understanding. PixelLM is accepted by CVPR 2024.
  ☆174Updated 3 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆237Updated 2 months ago
• OpenGVLab / all-seeing
  [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of …
  ☆444Updated last month