Alternatives and similar repositories for LongVU:

Users that are interested in LongVU are comparing it to the libraries listed below

• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆356Updated last month
• magic-research / PLLaVA
  Official repository for the paper PLLaVA
  ☆630Updated 5 months ago
• AILab-CVC / SEED-X
  Multimodal Models in Real World
  ☆427Updated 2 months ago
• IVGSZ / Flash-VStream
  This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"
  ☆148Updated 3 weeks ago
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆272Updated 9 months ago
• apple / ml-slowfast-llava
  SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models
  ☆195Updated 4 months ago
• VectorSpaceLab / Video-XL
  🔥🔥First-ever hour scale video understanding models
  ☆223Updated 3 weeks ago
• NVlabs / LITA
  ☆155Updated 3 months ago
• md-mohaiminul / VideoRecap
  ☆171Updated 6 months ago
• OpenGVLab / VideoChat-Flash
  VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling
  ☆261Updated this week
• Alpha-VLLM / Lumina-mGPT
  Official Implementation of "Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraini…
  ☆534Updated 5 months ago
• Vision-CAIR / MiniGPT4-video
  Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
  ☆581Updated last month
• farewellthree / PPLLaVA
  Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"
  ☆118Updated last month
• lzw-lzw / GroundingGPT
  [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model
  ☆314Updated 2 months ago
• RenShuhuai-Andy / TimeChat
  [CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding
  ☆324Updated last month
• mbzuai-oryx / Video-LLaVA
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
  ☆248Updated last year
• mbzuai-oryx / VideoGPT-plus
  Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
  ☆244Updated 5 months ago
• BradyFU / Video-MME
  ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
  ☆442Updated last month
• bytedance / tarsier
  Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with g…
  ☆185Updated this week
• microsoft / LLM2CLIP
  LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.
  ☆442Updated this week
• luogen1996 / LLaVA-HR
  LLaVA-HR: High-Resolution Large Language-Vision Assistant
  ☆223Updated 5 months ago
• thunlp / LLaVA-UHD
  LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer
  ☆348Updated this week
• YueFan1014 / VideoAgent
  This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)
  ☆161Updated last month
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆106Updated 3 months ago
• boheumd / MA-LMM
  (2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
  ☆267Updated 5 months ago
• AILab-CVC / SEED
  Official implementation of SEED-LLaMA (ICLR 2024).
  ☆596Updated 3 months ago
• erwold / qwen2vl-flux
  ☆396Updated last month
• HyperGAI / HPT
  HPT - Open Multimodal LLMs from HyperGAI
  ☆313Updated 7 months ago
• baaivision / EVE
  [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models
  ☆261Updated 3 months ago