[SCIS] MULTI-Benchmark: Multimodal Understanding Leaderboard with Text and Images
☆48Sep 5, 2026Updated last month
Alternatives and similar repositories for MULTI-Benchmark
Users that are interested in MULTI-Benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [EMNLP 2022] The baseline code for META-GUI dataset☆16Jul 9, 2024Updated 2 years ago
- Chinese Vision-Language Understanding Evaluation☆23Dec 26, 2024Updated last year
- ☆12Aug 17, 2025Updated last year
- Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"☆312May 22, 2025Updated last year
- [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"☆15Jun 21, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Public code repo for EMNLP 2024 Findings paper "MACAROON: Training Vision-Language Models To Be Your Engaged Partners"☆14Sep 28, 2024Updated 2 years ago
- ☆27Aug 1, 2024Updated 2 years ago
- [IEEE TPAMI 2026🔥] Learning Disentangled Representations for Generalized Multi-view Clustering☆17Aug 12, 2026Updated 2 months ago
- [NeurIPS 2025] The official implementation of paper "Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarking"☆26Oct 6, 2026Updated 3 weeks ago
- Solving Token Gradient Conflict in Mixture-of-Experts for Large Vision-Language Model☆13Feb 11, 2025Updated last year
- ☆19Dec 6, 2023Updated 2 years ago
- [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…☆49Aug 21, 2024Updated 2 years ago
- ☆14Sep 6, 2024Updated 2 years ago
- The official repository for CVPR'26 Paper "APPO: Attention-guided Perception Policy Optimization for Video Reasoning"☆16Mar 19, 2026Updated 7 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Touchstone: Evaluating Vision-Language Models by Language Models☆84Jan 18, 2024Updated 2 years ago
- Official implementation of "MoDoMoDo: Multi-Domain Data Mixtures for Multimodal LLM Reinforcement Learning"☆11Aug 23, 2025Updated last year
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆43Dec 16, 2025Updated 10 months ago
- ☆11Jan 8, 2025Updated last year
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆62Dec 10, 2024Updated last year
- [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning☆95Jan 7, 2025Updated last year
- Official repository for the ACL 2025 Findings paper "Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning …☆15May 12, 2026Updated 5 months ago
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆51Jul 12, 2026Updated 3 months ago
- [COLING 2025] Piecing It All Together: Verifying Multi-Hop Multimodal Claims.☆11Mar 5, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official implementation of TDC.☆15Jul 22, 2025Updated last year
- LMM for VQA, tcsvt version☆10Jul 19, 2024Updated 2 years ago
- ☆79Sep 15, 2026Updated last month
- [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want☆98Dec 1, 2025Updated 10 months ago
- [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision☆72Jul 10, 2024Updated 2 years ago
- [CVPR2026] VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twice☆90Feb 27, 2026Updated 8 months ago
- Yet another python JIT.☆20Mar 22, 2023Updated 3 years ago
- [COLM'25] Official implementation of the Law of Vision Representation in MLLMs☆180Oct 6, 2025Updated last year
- Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models☆45Jun 14, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆37Sep 16, 2024Updated 2 years ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆110May 27, 2025Updated last year
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆129Nov 25, 2024Updated last year
- ☆16Jul 23, 2024Updated 2 years ago
- [ICLR 2023] CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding☆45Jun 9, 2025Updated last year
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- Repo for paper "T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs"☆48Sep 3, 2025Updated last year