Alternatives and similar repositories for merlin

Users that are interested in merlin are comparing it to the libraries listed below

• imagegridworth / IG-VLM
  ☆136Updated 9 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆118Updated 3 months ago
• hshjerry / VideoEspresso
  [CVPR 2025 Oral] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆93Updated last month
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆67Updated 10 months ago
• DCDmllm / Momentor
  ☆76Updated 7 months ago
• WHB139426 / Grounded-Video-LLM
  Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
  ☆117Updated 3 months ago
• Ziyang412 / VideoTree
  Code for CVPR25 paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"
  ☆124Updated 3 weeks ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆128Updated last year
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆59Updated 5 months ago
• Hon-Wong / Elysium
  [ECCV 2024] Elysium: Exploring Object-level Perception in Videos via MLLM
  ☆77Updated 8 months ago
• RifleZhang / LLaVA-Hound-DPO
  ☆152Updated 8 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆59Updated last year
• farewellthree / BT-Adapter
  [CVPR 2024] Official PyTorch implementation of the paper "One For All: Video Conversation is Feasible Without Video Instruction Tuning"
  ☆34Updated last year
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆144Updated 10 months ago
• CeeZh / LLoVi
  Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"
  ☆97Updated 8 months ago
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• TimeMarker-LLM / TimeMarker
  A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability
  ☆94Updated 7 months ago
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆105Updated last year
• ziplab / LongVLM
  ☆97Updated 11 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated 4 months ago
• longvideobench / LongVideoBench
  [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆102Updated 11 months ago
• Share14 / ShareGemini
  ☆30Updated 11 months ago
• showlab / cosmo
  ☆71Updated last year
• TencentARC / ST-LLM
  [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"
  ☆149Updated 10 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆69Updated 5 months ago
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆86Updated 10 months ago
• Nicous20 / FunQA
  FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …
  ☆102Updated 7 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆171Updated 9 months ago
• KangarooGroup / Kangaroo
  official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input
  ☆67Updated 10 months ago