OpenDFM / MULTI-Benchmark
MULTI-Benchmark: Multimodal Understanding Leaderboard with Text and Images
☆27Updated this week
Related projects ⓘ
Alternatives and complementary repositories for MULTI-Benchmark
- ICLR2023 statistics☆60Updated last year
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆38Updated 4 months ago
- [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model☆25Updated last week
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆55Updated last month
- ☆45Updated last year
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆38Updated 7 months ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆33Updated last year
- code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"☆47Updated 2 months ago
- Official code for ICLR 2024 paper Do Generated Data Always Help Contrastive Learning?☆28Updated 7 months ago
- The official code of the paper "PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction".☆44Updated 3 weeks ago
- Official repository of MMDU dataset☆75Updated last month
- [NeurIPS 2024] Efficient Multi-modal Models via Stage-wise Visual Context Compression☆39Updated 3 months ago
- Official implement of MIA-DPO☆40Updated 2 weeks ago
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆22Updated 4 months ago
- ☆27Updated 9 months ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆32Updated 5 months ago
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆26Updated 4 months ago
- 🔥 Aurora Series: A more efficient multimodal large language model series for video.☆47Updated this week
- LMM which strictly superset LLM embedded☆30Updated 2 weeks ago
- [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.☆66Updated 3 months ago
- Mixture of Attention Heads☆39Updated 2 years ago
- DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆58Updated 3 weeks ago
- Code for paper "Patch-Level Training for Large Language Models"☆71Updated this week
- Code for https://arxiv.org/abs/2401.17139 (NeurIPS 2024)☆25Updated this week
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆30Updated last month
- GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes fr…☆69Updated last week
- MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria☆55Updated last month
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆59Updated 5 months ago