Alternatives and similar repositories for cosmo

Users that are interested in cosmo are comparing it to the libraries listed below

• Nicous20 / FunQA
  FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …
  ☆104Updated last month
• rxtan2 / Koala-video-llm
  ☆37Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• DCDmllm / Momentor
  ☆80Updated last year
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆96Updated last year
• Hritikbansal / videocon
  ☆58Updated last year
• imagegridworth / IG-VLM
  ☆138Updated last year
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated 2 years ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆128Updated 10 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated 2 years ago
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆57Updated 2 years ago
• showlab / MovieSeq
  [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆42Updated 11 months ago
• Share14 / ShareGemini
  ☆32Updated last year
• CeeZh / LLoVi
  Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"
  ☆106Updated last year
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆79Updated last year
• haoyu-bu / CAFe
  Code for "CAFe: Unifying Representation and Generation with Contrastive-Autoregressive Finetuning"
  ☆32Updated 10 months ago
• Yui010206 / SeViLA
  [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering
  ☆195Updated 2 years ago
• j-min / HiREST
  Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)
  ☆107Updated last year
• llyx97 / FETV
  [NeurIPS 2023 Datasets and Benchmarks] "FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generation", Yuanxin L…
  ☆57Updated last year
• CSU-JPG / TextAtlas
  A Large-scale Dataset for training and evaluating model's ability on Dense Text Image Generation
  ☆86Updated 4 months ago
• dhg-wei / TOPA
  (NeurIPS 2024 Spotlight) TOPA: Extend Large Language Models for Video Understanding via Text-Only Pre-Alignment
  ☆29Updated last year
• jiyt17 / IDA-VLM
  [ICLR 2025] IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model
  ☆37Updated last year
• klauscc / VindLU
  ☆110Updated 3 years ago
• ninatu / howtocaption
  Official implementation of "HowToCaption: Prompting LLMs to Transform Video Annotations at Scale." ECCV 2024
  ☆58Updated 5 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆76Updated last year
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆137Updated 2 years ago
• CASIA-IVA-Lab / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆54Updated 11 months ago
• yeliudev / R2-Tuning
  🌀 R2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding (ECCV 2024)
  ☆90Updated last year
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆105Updated 2 years ago
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆45Updated 2 years ago