Alternatives and similar repositories for VideoLLaMA2:

Users that are interested in VideoLLaMA2 are comparing it to the libraries listed below

• Vision-CAIR / MiniGPT4-video
  Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
  ☆581Updated last month
• dvlab-research / LLaMA-VID
  LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)
  ☆758Updated 5 months ago
• PKU-YuanGroup / LanguageBind
  【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  ☆771Updated 9 months ago
• magic-research / PLLaVA
  Official repository for the paper PLLaVA
  ☆630Updated 5 months ago
• yunlong10 / Awesome-LLMs-for-Video-Understanding
  🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.
  ☆1,820Updated this week
• LLaVA-VL / LLaVA-NeXT
  ☆3,272Updated 3 months ago
• showlab / Show-o
  Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.
  ☆1,129Updated 3 weeks ago
• RenShuhuai-Andy / TimeChat
  [CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding
  ☆324Updated last month
• rese1f / MovieChat
  [CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
  ☆572Updated this week
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆972Updated last month
• OpenGVLab / InternVideo
  [ECCV2024] Video Foundation Models & Data for Multimodal Understanding
  ☆1,553Updated this week
• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆1,965Updated 2 months ago
• InternLM / InternLM-XComposer
  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
  ☆2,709Updated 3 weeks ago
• BradyFU / Video-MME
  ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
  ☆442Updated last month
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆356Updated last month
• FoundationVision / LlamaGen
  Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation
  ☆1,460Updated 5 months ago
• beichenzbc / Long-CLIP
  [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"
  ☆732Updated 5 months ago
• open-compass / VLMEvalKit
  Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
  ☆1,689Updated this week
• Vision-CAIR / LongVU
  ☆338Updated 2 months ago
• cambrian-mllm / cambrian
  Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
  ☆1,823Updated 2 months ago
• csuhan / OneLLM
  [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language
  ☆613Updated 2 months ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆720Updated 11 months ago
• mbzuai-oryx / Video-ChatGPT
  [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the cap…
  ☆1,269Updated 4 months ago
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆709Updated 3 weeks ago
• OpenGVLab / VisionLLM
  VisionLLM Series
  ☆977Updated 2 weeks ago
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,204Updated 4 months ago
• microsoft / LLM2CLIP
  LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.
  ☆442Updated this week
• GAIR-NLP / anole
  Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation
  ☆708Updated 5 months ago
• OpenMOSS / AnyGPT
  Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"
  ☆818Updated 4 months ago
• PKU-YuanGroup / MoE-LLaVA
  Mixture-of-Experts for Large Vision-Language Models
  ☆2,051Updated last month