Alternatives and similar repositories for merlin:

Users that are interested in merlin are comparing it to the libraries listed below

• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆97Updated 2 months ago
• DCDmllm / Momentor
  ☆63Updated 2 months ago
• X2FD / LVIS-INSTRUCT4V
  ☆132Updated last year
• WHB139426 / Grounded-Video-LLM
  Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
  ☆75Updated last month
• imagegridworth / IG-VLM
  ☆130Updated 4 months ago
• Ziyang412 / VideoTree
  Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"
  ☆92Updated 5 months ago
• showlab / cosmo
  ☆72Updated 8 months ago
• hshjerry / VideoEspresso
  VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆46Updated 2 weeks ago
• Hon-Wong / Elysium
  [ECCV 2024] Elysium: Exploring Object-level Perception in Videos via MLLM
  ☆66Updated 3 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆57Updated 4 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆124Updated last year
• farewellthree / BT-Adapter
  [CVPR 2024] Official PyTorch implementation of the paper "One For All: Video Conversation is Feasible Without Video Instruction Tuning"
  ☆29Updated 11 months ago
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆130Updated last month
• RifleZhang / LLaVA-Hound-DPO
  ☆136Updated 2 months ago
• KangarooGroup / Kangaroo
  official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input
  ☆62Updated 5 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆154Updated 3 months ago
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆50Updated last week
• TencentARC / ST-LLM
  [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"
  ☆137Updated 4 months ago
• longvideobench / LongVideoBench
  [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆84Updated 6 months ago
• bigai-nlco / VideoLLaMB
  Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
  ☆61Updated 4 months ago
• keshik6 / HourVideo
  [NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understanding
  ☆62Updated 3 weeks ago
• wxh1996 / VideoAgent
  ☆66Updated last month
• alibaba / conv-llava
  ☆109Updated 6 months ago
• egoschema / EgoSchema
  ☆84Updated last month
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆82Updated 4 months ago
• TimeMarker-LLM / TimeMarker
  A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability
  ☆78Updated 2 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆33Updated 3 months ago
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆84Updated 4 months ago
• Yxxxb / VoCo-LLaMA
  VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆91Updated 6 months ago
• OpenGVLab / LCL
  Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆68Updated 7 months ago