Alternatives and similar repositories for Cola

Users that are interested in Cola are comparing it to the libraries listed below

• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated 2 years ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆96Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• Hritikbansal / videocon
  ☆58Updated last year
• imagegridworth / IG-VLM
  ☆140Updated last year
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated last year
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆41Updated 2 weeks ago
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated 2 years ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆76Updated last year
• DCDmllm / MorphTokens
  ☆43Updated last year
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆76Updated last year
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆153Updated 3 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆72Updated last year
• showlab / cosmo
  ☆73Updated last year
• TencentARC / GRPO-CARE
  ☆80Updated 6 months ago
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆86Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated 2 years ago
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆145Updated last year
• Nicous20 / FunQA
  FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …
  ☆104Updated this week
• foundation-multimodal-models / CAPTURE
  ☆81Updated last year
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated 2 years ago
• YujieLu10 / LLMScore
  LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation
  ☆134Updated 2 years ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆127Updated 8 months ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆59Updated last year
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆48Updated last year
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆57Updated 2 years ago
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆79Updated 7 months ago
• UMass-Embodied-AGI / CoVLM
  [ICLR 2023] CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding
  ☆46Updated 6 months ago