UMass-Foundation-Model / CoVLM

Related projects ⓘ

Alternatives and complementary repositories for CoVLM

• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆27Updated 5 months ago
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆36Updated last year
• ChenYi99 / EgoPlan
  ☆61Updated last month
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆24Updated last month
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆23Updated last year
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆34Updated 8 months ago
• ChocoWu / SeTok
  ☆36Updated last month
• eric-ai-lab / MMWorld
  Official repo of the paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆20Updated 2 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆52Updated 2 months ago
• sIncerass / MVLPT
  code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720
  ☆54Updated 5 months ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆35Updated last year
• RifleZhang / LLaVA-Reasoner-DPO
  ☆30Updated this week
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆28Updated 5 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆56Updated last year
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆34Updated 2 weeks ago
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆73Updated 7 months ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆22Updated 4 months ago
• Share14 / ShareGemini
  ☆21Updated 3 months ago
• showlab / MovieSeq
  [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆29Updated last month
• TencentARC / FLM
  Accelerating Vision-Language Pretraining with Free Language Modeling (CVPR 2023)
  ☆31Updated last year
• 2toinf / IVM
  [NeurIPS-2024] The offical Implementation of "Instruction-Guided Visual Masking"
  ☆29Updated this week
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆26Updated last year
• AdaCheng / EgoThink
  [CVPR'24 Highlight] The official code and data for paper "EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Lan…
  ☆48Updated 2 weeks ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆49Updated 5 months ago
• Becomebright / GroundVQA
  Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.
  ☆51Updated 2 months ago
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆32Updated 5 months ago
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆22Updated last week
• CVMI-Lab / clip-beyond-tail
  (NeurIPS 2024) What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights
  ☆19Updated 3 weeks ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆73Updated 6 months ago