Alternatives and similar repositories for vlm-rlaif

Users that are interested in vlm-rlaif are comparing it to the libraries listed below

• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆32Updated 2 months ago
• mshukor / ima-lmms
  [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs
  ☆18Updated 8 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆78Updated 5 months ago
• si0wang / VisVM
  ☆44Updated 5 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆117Updated 2 months ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆94Updated 11 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated last year
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated 3 months ago
• hmxiong / StreamChat
  Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025
  ☆55Updated 3 months ago
• longvideobench / LongVideoBench
  [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆97Updated 10 months ago
• alanaai / EVUD
  Egocentric Video Understanding Dataset (EVUD)
  ☆29Updated 11 months ago
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆34Updated 7 months ago
• hshjerry / VideoEspresso
  [CVPR 2025 Oral] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆87Updated 2 weeks ago
• imagegridworth / IG-VLM
  ☆135Updated 8 months ago
• RifleZhang / LLaVA-Hound-DPO
  ☆149Updated 7 months ago
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆59Updated 5 months ago
• appletea233 / Temporal-R1
  Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
  ☆40Updated 2 weeks ago
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression
  ☆60Updated 4 months ago
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• ncTimTang / AKS
  [CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding
  ☆73Updated 2 months ago
• yale-nlp / TOMATO
  ☆26Updated 7 months ago
• takomc / amp
  【NeurIPS 2024】The official code of paper "Automated Multi-level Preference for MLLMs"
  ☆19Updated 8 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆111Updated 2 weeks ago
• WHB139426 / Grounded-Video-LLM
  Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
  ☆116Updated 3 months ago
• TencentARC / SEED-Bench-R1
  ☆84Updated 2 months ago
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆58Updated 5 months ago
• yaolinli / TimeChat-Online
  TimeChat-online: 80% Visual Tokens are Naturally Redundant in Streaming Videos
  ☆50Updated this week
• LaVi-Lab / AIM
  Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"
  ☆29Updated last month
• NUS-TRAIL / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆67Updated 2 weeks ago
• Visual-AI / PruneVid
  The official repository for ACL2025 paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".
  ☆46Updated last month