Alternatives and similar repositories for Cola

Users that are interested in Cola are comparing it to the libraries listed below

• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated 2 years ago
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆96Updated last year
• Hritikbansal / videocon
  ☆58Updated last year
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆79Updated last year
• DCDmllm / MorphTokens
  ☆43Updated last year
• UMass-Embodied-AGI / CoVLM
  [ICLR 2023] CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding
  ☆46Updated 8 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆159Updated 4 months ago
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated 2 years ago
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated 2 years ago
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆145Updated last year
• TencentARC / FLM
  Accelerating Vision-Language Pretraining with Free Language Modeling (CVPR 2023)
  ☆32Updated 2 years ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆42Updated last month
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• palchenli / VL-Instruction-Tuning
  ☆92Updated 2 years ago
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆45Updated 2 years ago
• imagegridworth / IG-VLM
  ☆138Updated last year
• Nicous20 / FunQA
  FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …
  ☆104Updated last month
• showlab / cosmo
  ☆73Updated last year
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆86Updated last year
• YujieLu10 / LLMScore
  LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation
  ☆134Updated 2 years ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated 2 years ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆58Updated last year
• umd-huang-lab / perceptionCLIP
  Code for our ICLR 2024 paper "PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts"
  ☆79Updated last year
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆147Updated last year
• UX-Decoder / FIND
  [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"
  ☆129Updated last year
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆57Updated 2 years ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆48Updated last year
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆72Updated last year