Alternatives and similar repositories for CoVLM

Users that are interested in CoVLM are comparing it to the libraries listed below

• eric-ai-lab / MMWorld
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆29Updated last month
• ChenYi99 / EgoPlan
  ☆71Updated 8 months ago
• alanaai / EVUD
  Egocentric Video Understanding Dataset (EVUD)
  ☆31Updated last year
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆104Updated last year
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated last year
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆57Updated last year
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆52Updated last year
• isekai-portal / Link-Context-Learning
  ☆99Updated last year
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆41Updated 5 months ago
• DCDmllm / MorphTokens
  ☆44Updated last year
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆39Updated last year
• si0wang / ViCrit
  ☆23Updated 2 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆49Updated last month
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆128Updated 2 years ago
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆45Updated last year
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆73Updated 11 months ago
• si0wang / VisVM
  ☆45Updated 8 months ago
• ruili33 / TPO
  ☆35Updated 7 months ago
• CVMI-Lab / clip-beyond-tail
  (NeurIPS 2024) What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights
  ☆27Updated 10 months ago
• AdaCheng / EgoThink
  [CVPR'24 Highlight] The official code and data for paper "EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Lan…
  ☆61Updated 5 months ago
• om-ai-lab / ZoomEye
  [EMNLP-2025] ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration
  ☆51Updated this week
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆87Updated last year
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆27Updated last year
• OpenGVLab / EgoExoLearn
  [CVPR 2024] Data and benchmark code for the EgoExoLearn dataset
  ☆66Updated 11 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆69Updated last year
• TencentARC / FLM
  Accelerating Vision-Language Pretraining with Free Language Modeling (CVPR 2023)
  ☆32Updated 2 years ago
• THUNLP-MT / Scaffold
  Scaffold Prompting to promote LMMs
  ☆43Updated 8 months ago
• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆20Updated 10 months ago
• rxtan2 / Koala-video-llm
  ☆35Updated 11 months ago