Alternatives and similar repositories for CoVLM:

Users that are interested in CoVLM are comparing it to the libraries listed below

• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆62Updated 5 months ago
• eric-ai-lab / MMWorld
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆25Updated 5 months ago
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆31Updated 4 months ago
• Share14 / ShareGemini
  ☆27Updated 7 months ago
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated last year
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• HAWLYQ / ET-Cap
  ☆25Updated last year
• ChenYi99 / EgoPlan
  ☆66Updated 2 months ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated last year
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆33Updated last year
• keshik6 / HourVideo
  [NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understanding
  ☆66Updated last month
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆41Updated last month
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆31Updated 8 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated last year
• showlab / MovieSeq
  [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆35Updated last month
• alanaai / EVUD
  Egocentric Video Understanding Dataset (EVUD)
  ☆26Updated 7 months ago
• TencentARC / FLM
  Accelerating Vision-Language Pretraining with Free Language Modeling (CVPR 2023)
  ☆31Updated last year
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆41Updated last year
• yale-nlp / TOMATO
  ☆19Updated 3 months ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆26Updated 8 months ago
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆28Updated 3 months ago
• THUNLP-MT / Scaffold
  Scaffold Prompting to promote LMMs
  ☆38Updated 2 months ago
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆53Updated last month
• vinid / neg_clip
  NegCLIP.
  ☆31Updated 2 years ago
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆34Updated 3 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆39Updated this week
• si0wang / VisVM
  ☆36Updated 2 months ago
• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆24Updated 3 months ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆79Updated 10 months ago