williamium3000 / awesome-mllm-grounding
Awesome paper for multi-modal llm with grounding ability
☆17Updated 7 months ago
Alternatives and similar repositories for awesome-mllm-grounding:
Users that are interested in awesome-mllm-grounding are comparing it to the libraries listed below
- Official repository of DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models☆83Updated 6 months ago
- ☆69Updated 3 months ago
- [ECCV 2024] ControlCap: Controllable Region-level Captioning☆73Updated 5 months ago
- [CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding☆39Updated last week
- [ICLR 2025] Reconstructive Visual Instruction Tuning☆73Updated 3 weeks ago
- 👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)☆57Updated 2 months ago
- FreeVA: Offline MLLM as Training-Free Video Assistant☆57Updated 9 months ago
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆153Updated 2 months ago
- R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimization☆63Updated this week
- Official PyTorch code of GroundVQA (CVPR'24)☆56Updated 6 months ago
- TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models☆29Updated 4 months ago
- [CVPR'25] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection☆63Updated last month
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆46Updated 2 weeks ago
- Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models☆37Updated last year
- ☆29Updated 7 months ago
- Egocentric Video Understanding Dataset (EVUD)☆27Updated 8 months ago
- [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning☆68Updated last month
- (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction☆81Updated 3 weeks ago
- Can 3D Vision-Language Models Truly Understand Natural Language?☆21Updated last year
- ☆53Updated this week
- ☆37Updated 2 months ago
- ☆24Updated 3 months ago
- The official implementation of RAR☆82Updated last year
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆63Updated 6 months ago
- [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?☆38Updated this week
- 💡 VideoMind: A Chain-of-LoRA Agent for Long Video Reasoning☆25Updated this week
- R1-like Video-LLM for Temporal Grounding☆55Updated last week
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆49Updated 8 months ago
- Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision☆36Updated this week
- [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences☆36Updated 2 weeks ago