Alternatives and similar repositories for CoVLM

Users that are interested in CoVLM are comparing it to the libraries listed below

• ChenYi99 / EgoPlan
  ☆69Updated 6 months ago
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated last year
• eric-ai-lab / MMWorld
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆28Updated 8 months ago
• alanaai / EVUD
  Egocentric Video Understanding Dataset (EVUD)
  ☆29Updated 11 months ago
• ruili33 / TPO
  ☆33Updated 4 months ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆38Updated last year
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆31Updated 11 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆52Updated last year
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆34Updated 6 months ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated 2 years ago
• si0wang / VisVM
  ☆43Updated 5 months ago
• Share14 / ShareGemini
  ☆30Updated 10 months ago
• VincentDENGP / 3D-LR
  Can 3D Vision-Language Models Truly Understand Natural Language?
  ☆21Updated last year
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆41Updated 2 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆65Updated 8 months ago
• EmbodiedGPT / EgoCOT_Dataset
  ☆48Updated last year
• HAWLYQ / ET-Cap
  ☆25Updated last year
• lbaermann / qaego4d
  Code and Dataset for the CVPRW Paper "Where did I leave my keys? — Episodic-Memory-Based Question Answering on Egocentric Videos"
  ☆25Updated last year
• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆18Updated 7 months ago
• mshukor / ima-lmms
  [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs
  ☆18Updated 7 months ago
• SivanDoveh / IPLoc
  Repository for the paper: Teaching VLMs to Localize Specific Objects from In-context Examples
  ☆23Updated 6 months ago
• THUNLP-MT / Scaffold
  Scaffold Prompting to promote LMMs
  ☆42Updated 5 months ago
• TencentARC / FLM
  Accelerating Vision-Language Pretraining with Free Language Modeling (CVPR 2023)
  ☆32Updated 2 years ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆60Updated 11 months ago
• zhijie-group / R1-Zero-VSI
  ☆36Updated last month
• Becomebright / GroundVQA
  Official PyTorch code of GroundVQA (CVPR'24)
  ☆61Updated 8 months ago
• stogiannidis / srbench
  ☆11Updated 2 weeks ago
• LaVi-Lab / AIM
  Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"
  ☆28Updated 3 weeks ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated 2 months ago