Alternatives and similar repositories for CoVLM

Users that are interested in CoVLM are comparing it to the libraries listed below

• eric-ai-lab / MMWorld
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆29Updated 4 months ago
• alanaai / EVUD
  Egocentric Video Understanding Dataset (EVUD)
  ☆32Updated last year
• ChenYi99 / EgoPlan
  [IJCV] EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning
  ☆74Updated 11 months ago
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆103Updated 2 years ago
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated 2 years ago
• si0wang / ViCrit
  ☆24Updated 5 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆54Updated 4 months ago
• AdaCheng / EgoThink
  [CVPR'24 Highlight] The official code and data for paper "EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Lan…
  ☆62Updated 7 months ago
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆44Updated 2 years ago
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• DCDmllm / MorphTokens
  ☆43Updated last year
• Shengcao-Cao / groundLMM
  Emergent Visual Grounding in Large Multimodal Models Without Grounding Supervision
  ☆41Updated last month
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆52Updated 2 years ago
• CVMI-Lab / clip-beyond-tail
  (NeurIPS 2024) What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights
  ☆29Updated last year
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆88Updated last year
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆76Updated last year
• si0wang / VisVM
  ☆46Updated 10 months ago
• stogiannidis / srbench
  Source code for the Paper "Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models"
  ☆16Updated last month
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆133Updated 2 years ago
• OpenGVLab / EgoExoLearn
  [CVPR 2024] Data and benchmark code for the EgoExoLearn dataset
  ☆70Updated 2 months ago
• EvolvingLMMs-Lab / MGPO
  High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning
  ☆51Updated 3 months ago
• shiqichen17 / AdaptVis
  Github repository for "Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas" (ICML 2025)
  ☆53Updated 6 months ago
• xjtupanda / Sparrow
  Repo for paper "T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs"
  ☆48Updated 2 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆50Updated 8 months ago
• mbzuai-oryx / Agent-X
  Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks
  ☆32Updated last week
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆66Updated last year
• THUNLP-MT / Scaffold
  Scaffold Prompting to promote LMMs
  ☆45Updated 11 months ago
• z-x-yang / DoraemonGPT
  Official repository of DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models
  ☆88Updated last year
• xvjiarui / IMProv
  IMProv: Inpainting-based Multimodal Prompting for Computer Vision Tasks
  ☆57Updated last year
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆71Updated last year