Alternatives and similar repositories for merlin:

Users that are interested in merlin are comparing it to the libraries listed below

• DCDmllm / Momentor
  ☆69Updated 4 months ago
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• bigai-nlco / VideoLLaMB
  Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
  ☆68Updated last month
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆108Updated last month
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆125Updated last year
• hshjerry / VideoEspresso
  [CVPR'25] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆63Updated last week
• WHB139426 / Grounded-Video-LLM
  Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
  ☆97Updated last week
• egoschema / EgoSchema
  ☆86Updated 3 months ago
• longvideobench / LongVideoBench
  [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆91Updated 8 months ago
• Ziyang412 / VideoTree
  Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"
  ☆102Updated last month
• RifleZhang / LLaVA-Hound-DPO
  ☆143Updated 5 months ago
• imagegridworth / IG-VLM
  ☆132Updated 6 months ago
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆57Updated 2 months ago
• CeeZh / LLoVi
  Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"
  ☆94Updated 5 months ago
• TencentARC / ST-LLM
  [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"
  ☆142Updated 6 months ago
• Hon-Wong / Elysium
  [ECCV 2024] Elysium: Exploring Object-level Perception in Videos via MLLM
  ☆70Updated 5 months ago
• showlab / cosmo
  ☆72Updated 10 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆157Updated 5 months ago
• KangarooGroup / Kangaroo
  official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input
  ☆63Updated 7 months ago
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆137Updated 3 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆86Updated 2 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆46Updated 3 weeks ago
• farewellthree / BT-Adapter
  [CVPR 2024] Official PyTorch implementation of the paper "One For All: Video Conversation is Feasible Without Video Instruction Tuning"
  ☆32Updated last year
• THUDM / LVBench
  LVBench: An Extreme Long Video Understanding Benchmark
  ☆85Updated 7 months ago
• TimeMarker-LLM / TimeMarker
  A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability
  ☆90Updated 4 months ago
• alibaba / conv-llava
  ☆113Updated 8 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆63Updated 6 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆59Updated last year
• Share14 / ShareGemini
  ☆29Updated 8 months ago