Alternatives and similar repositories for WorldSense

Users that are interested in WorldSense are comparing it to the libraries listed below

• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆26Updated 6 months ago
• Hon-Wong / ByteVideoLLM
  This is the official repo for ByteVideoLLM/Dynamic-VLM
  ☆20Updated 6 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆46Updated 5 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆65Updated 9 months ago
• BriansIDP / video-SALMONN-o1
  ☆32Updated 3 weeks ago
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆58Updated 5 months ago
• xuyang-liu16 / VidCom2
  🚀 Video Compression Commander: Plug-and-Play Inference Acceleration for Video Large Language Models
  ☆23Updated 2 weeks ago
• path2generalist / General-Level
  On Path to Multimodal Generalist: General-Level and General-Bench
  ☆14Updated last month
• RifleZhang / LLaVA-Reasoner-DPO
  ☆80Updated 5 months ago
• EvolvingLMMs-Lab / VideoMMMU
  ☆49Updated 2 months ago
• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆18Updated 8 months ago
• om-ai-lab / ZoomEye
  ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration
  ☆37Updated 5 months ago
• yaolinli / DeCo
  ☆37Updated 11 months ago
• JoeLeelyf / OVO-Bench
  [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?
  ☆65Updated 2 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆117Updated 2 months ago
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆61Updated 2 weeks ago
• SCZwangxiao / video-ReTaKe
  Official implementation of paper ReTaKe: Reducing Temporal and Knowledge Redundancy for Long Video Understanding
  ☆34Updated 3 months ago
• ncTimTang / AKS
  [CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding
  ☆73Updated 2 months ago
• TencentARC / TokLIP
  TokLIP: Marry Visual Tokens to CLIP for Multimodal Comprehension and Generation
  ☆85Updated 3 weeks ago
• Share14 / ShareGemini
  ☆30Updated 10 months ago
• MME-Benchmarks / MME-Unify
  MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models
  ☆40Updated 2 months ago
• JiuTian-VL / MoME
  [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models
  ☆66Updated last month
• xjtupanda / Sparrow
  Repo for paper "T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs"
  ☆49Updated 3 months ago
• DogNeverSleep / MME-VideoOCR
  ☆28Updated 3 weeks ago
• yaolinli / TimeChat-Online
  TimeChat-online: 80% Visual Tokens are Naturally Redundant in Streaming Videos
  ☆51Updated last week
• lzw-lzw / UnifiedMLLM
  UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
  ☆22Updated 10 months ago
• Becomebright / ReKV
  Official PyTorch Code of ReKV (ICLR'25)
  ☆28Updated 3 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated 3 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆60Updated last year
• AlenjandroWang / ASVR
  Autoregressive Semantic Visual Reconstruction Helps VLMs Understand Better
  ☆29Updated last week