This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR 2025]
☆79Jul 1, 2025Updated 8 months ago
Alternatives and similar repositories for MEGA-Bench
Users that are interested in MEGA-Bench are comparing it to the libraries listed below
Sorting:
- ☆26Jul 22, 2025Updated 7 months ago
- A one-stop library to standardize the inference and evaluation of all the conditional video generation models.☆51Feb 13, 2025Updated last year
- A multimodal model bridging vision and genomics for biodiversity monitoring at scale.☆16Sep 18, 2025Updated 5 months ago
- [ICCV 2023] Official implementation of the paper "PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objects"☆83Feb 16, 2025Updated last year
- [NeurIPS 2024] The official implementation of "Image Copy Detection for Diffusion Models"☆18Oct 1, 2024Updated last year
- ☆25Mar 15, 2022Updated 3 years ago
- ☆48Sep 5, 2024Updated last year
- ☆22Jan 18, 2024Updated 2 years ago
- [IJCV 2024]☆21Nov 11, 2024Updated last year
- [ICCV 2025] NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenes☆89Oct 26, 2025Updated 4 months ago
- MINSU3D: MinkowskiEngine-powered Scene Understanding in 3D☆42Jun 24, 2024Updated last year
- A Survey on Benchmarks of Multimodal Large Language Models☆150Jul 1, 2025Updated 8 months ago
- ☆11Jan 3, 2024Updated 2 years ago
- Official code for the paper: "Perception and Semantic Aware Regularization for Sequential Confidence Calibration （CVPR2023）"☆10May 15, 2024Updated last year
- ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆152Oct 21, 2025Updated 4 months ago
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…☆28Jul 9, 2025Updated 7 months ago
- The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning" [NeurIPS25]☆182Jun 5, 2025Updated 8 months ago
- Official implementation of Our NeurIPS 2024 Paper "Boundary Matters: A Bi-Level Active Finetuning Method"☆14Feb 11, 2025Updated last year
- Know2BIO: A Comprehensive Dual-View Benchmark for Evolving Biomedical Knowledge Graphs☆14Feb 10, 2026Updated 2 weeks ago
- Generative Reranker PyTerrier☆18Dec 1, 2025Updated 2 months ago
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated last year
- ☆13Apr 23, 2025Updated 10 months ago
- MetricEval: A framework that conceptualizes and operationalizes four main components of metric evaluation, in terms of reliability and va…☆12Nov 6, 2023Updated 2 years ago
- [CVPR 2024] Official Implementation of the paper "CAGE: Controllable Articulation GEneration"☆82Feb 26, 2025Updated last year
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆159Dec 6, 2024Updated last year
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆221Nov 27, 2025Updated 3 months ago
- ☆13Jul 14, 2024Updated last year
- Pixel-Level Reasoning Model trained with RL [NeuIPS25]☆278Nov 6, 2025Updated 3 months ago
- [ICCV 2023] Multi3DRefer: Grounding Text Description to Multiple 3D Objects☆94Oct 18, 2025Updated 4 months ago
- Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO☆54Sep 3, 2020Updated 5 years ago
- Landing page + leaderboard for SWE-Bench benchmark☆11Updated this week
- ☆14Nov 19, 2024Updated last year
- ☆19Sep 16, 2025Updated 5 months ago
- A one-stop library to standardize the inference and evaluation of all the conditional image generation models. [ICLR 2024]☆178Dec 2, 2025Updated 2 months ago
- (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.☆360Jan 14, 2025Updated last year
- [ECCV 2022, Oral] OPD: Single-view 3D Openable Part Detection☆34May 18, 2023Updated 2 years ago
- [ICLR 2025] Duoduo CLIP: Efficient 3D Understanding with Multi-View Images☆76May 29, 2025Updated 9 months ago
- [Preprint 2022] “Can We Solve 3D Vision Tasks Starting from A 2D Vision Transformer?” by Yi Wang, Zhiwen Fan, Tianlong Chen, Hehe Fan, Zh…☆63Jan 18, 2023Updated 3 years ago
- [ICCV 2025] The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration R…☆111Jul 9, 2025Updated 7 months ago