Alternatives and similar repositories for CoVLM

Users that are interested in CoVLM are comparing it to the libraries listed below

• eric-ai-lab / MMWorld
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆28Updated this week
• ChenYi99 / EgoPlan
  ☆70Updated 7 months ago
• alanaai / EVUD
  Egocentric Video Understanding Dataset (EVUD)
  ☆29Updated last year
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated last year
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆67Updated 10 months ago
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆105Updated last year
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆42Updated last year
• AdaCheng / EgoThink
  [CVPR'24 Highlight] The official code and data for paper "EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Lan…
  ☆60Updated 3 months ago
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆41Updated 3 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆54Updated last year
• stogiannidis / srbench
  Source code for the Paper "Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models"
  ☆12Updated last month
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆33Updated 8 months ago
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆31Updated last year
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆64Updated last month
• si0wang / VisVM
  ☆45Updated 6 months ago
• DCDmllm / MorphTokens
  ☆44Updated last year
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆86Updated last year
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆48Updated 2 weeks ago
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆59Updated 5 months ago
• VincentDENGP / 3D-LR
  Can 3D Vision-Language Models Truly Understand Natural Language?
  ☆21Updated last year
• THUNLP-MT / Scaffold
  Scaffold Prompting to promote LMMs
  ☆43Updated 7 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated 4 months ago
• isekai-portal / Link-Context-Learning
  ☆98Updated last year
• Becomebright / GroundVQA
  Official PyTorch code of GroundVQA (CVPR'24)
  ☆61Updated 10 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• showlab / MovieSeq
  [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆39Updated 4 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆60Updated last year
• SivanDoveh / IPLoc
  Repository for the paper: Teaching VLMs to Localize Specific Objects from In-context Examples
  ☆29Updated 7 months ago
• 2toinf / IVM
  [NeurIPS-2024] The offical Implementation of "Instruction-Guided Visual Masking"
  ☆35Updated 8 months ago