Alternatives and similar repositories for CoVLM:

Users that are interested in CoVLM are comparing it to the libraries listed below

• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆30Updated this week
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆38Updated 10 months ago
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆27Updated 2 months ago
• eric-ai-lab / MMWorld
  Official repo of the paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆23Updated 3 months ago
• Share14 / ShareGemini
  ☆26Updated 5 months ago
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated last year
• keshik6 / HourVideo
  [NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understanding
  ☆56Updated last week
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• yuhui-zh15 / C3
  Official implementation of "Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data" (ICLR 2024)
  ☆27Updated 3 months ago
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆23Updated last year
• ChenYi99 / EgoPlan
  ☆65Updated last month
• zjuchenlong / WSAG
  [EMNLP'22] Weakly-Supervised Temporal Article Grounding
  ☆14Updated last year
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆56Updated 4 months ago
• CVMI-Lab / clip-beyond-tail
  (NeurIPS 2024) What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights
  ☆22Updated 2 months ago
• TencentARC / FLM
  Accelerating Vision-Language Pretraining with Free Language Modeling (CVPR 2023)
  ☆31Updated last year
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated last year
• vinid / neg_clip
  NegCLIP.
  ☆29Updated last year
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆31Updated 7 months ago
• alanaai / EVUD
  Egocentric Video Understanding Dataset (EVUD)
  ☆24Updated 6 months ago
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆26Updated 2 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆56Updated last year
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆26Updated last year
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆84Updated 4 months ago
• DCDmllm / MorphTokens
  ☆44Updated 8 months ago
• si0wang / VisVM
  ☆31Updated 2 weeks ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆24Updated 6 months ago
• showlab / MovieSeq
  [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆32Updated 3 months ago
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆32Updated last month
• yuezih / SMILE
  Learning Descriptive Image Captioning via Semipermeable Maximum Likelihood Estimation (NeurIPS 2023)
  ☆23Updated last year
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated last year