Alternatives and similar repositories for CoVLM

Users that are interested in CoVLM are comparing it to the libraries listed below

• eric-ai-lab / MMWorld
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆29Updated 2 months ago
• ChenYi99 / EgoPlan
  ☆72Updated 9 months ago
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated last year
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆104Updated last year
• si0wang / ViCrit
  ☆23Updated 3 months ago
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆40Updated 5 months ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆52Updated last year
• THUNLP-MT / Scaffold
  Scaffold Prompting to promote LMMs
  ☆44Updated 9 months ago
• CVMI-Lab / clip-beyond-tail
  (NeurIPS 2024) What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights
  ☆28Updated 10 months ago
• alanaai / EVUD
  Egocentric Video Understanding Dataset (EVUD)
  ☆31Updated last year
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆32Updated last year
• isekai-portal / Link-Context-Learning
  ☆99Updated last year
• si0wang / VisVM
  ☆45Updated 8 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆73Updated last year
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆46Updated 2 years ago
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆40Updated last year
• EvolvingLMMs-Lab / MGPO
  High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning
  ☆48Updated last month
• ruili33 / TPO
  ☆37Updated last week
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆88Updated last year
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆63Updated last year
• VincentDENGP / 3D-LR
  Can 3D Vision-Language Models Truly Understand Natural Language?
  ☆21Updated last year
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆70Updated last year
• multimodal-reasoning-lab / Bagel-Zebra-CoT
  https://huggingface.co/datasets/multimodal-reasoning-lab/Zebra-CoT
  ☆76Updated last month
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆129Updated 2 years ago
• DCDmllm / MorphTokens
  ☆44Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• mbzuai-oryx / Agent-X
  Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks
  ☆30Updated last month
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆60Updated last year
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆65Updated 3 months ago
• FatemehShiri / Spatial-MM
  ☆12Updated 8 months ago