This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR 2025]
☆83Jul 1, 2025Updated last year
Alternatives and similar repositories for MEGA-Bench
Users that are interested in MEGA-Bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A one-stop library to standardize the inference and evaluation of all the conditional video generation models.☆50Feb 13, 2025Updated last year
- [ICCV2025] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding☆61Apr 4, 2026Updated 6 months ago
- ☆17Oct 21, 2024Updated 2 years ago
- The official github repo for MixEval-X, the first any-to-any, real-world benchmark.☆17Feb 15, 2025Updated last year
- ☆49Sep 5, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- RIBOSPAN: A Long-Context RNA Foundation Model for Versatile RNA Modeling☆20Sep 1, 2026Updated last month
- [ICML'26] Toward Human-like Audio-Visual Intelligence of Omni-MLLMs☆18Oct 4, 2026Updated 3 weeks ago
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…☆29Jul 9, 2025Updated last year
- Official repository of MMDU dataset☆111Sep 29, 2024Updated 2 years ago
- ☆15Sep 12, 2025Updated last year
- ☆24Aug 10, 2022Updated 4 years ago
- Supplementary Material for Non-binary Deep Transfer Learning for Image Classification☆18Jul 22, 2021Updated 5 years ago
- This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for E…☆600Jul 28, 2026Updated 3 months ago
- A Survey on Benchmarks of Multimodal Large Language Models☆161Jul 13, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ABC: Achieving Better Control of Multimodal Embeddings using VLMs [TMLR2025]☆20Aug 21, 2025Updated last year
- Official code for the paper: "Perception and Semantic Aware Regularization for Sequential Confidence Calibration （CVPR2023）"☆10May 15, 2024Updated 2 years ago
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆228Jun 30, 2026Updated 4 months ago
- [NeurIPS 2024] The official implementation of "Image Copy Detection for Diffusion Models"☆18Oct 1, 2024Updated 2 years ago
- Landing page + leaderboard for SWE-Bench benchmark☆15Sep 1, 2026Updated last month
- ☆50Jun 7, 2025Updated last year
- This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…☆170Sep 27, 2025Updated last year
- OpenThinkIMG is an end-to-end open-source framework that empowers LVLMs to think with images.☆408Jun 1, 2025Updated last year
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆161Dec 6, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆376Jul 24, 2025Updated last year
- ☆10Dec 1, 2024Updated last year
- The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning" [NeurIPS25]☆192Jun 5, 2025Updated last year
- Data visualization code generation benchmark: Evaluates LLMs' ability to generate visualization code from DataFrame descriptions.☆13Nov 28, 2025Updated 11 months ago
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆233Nov 27, 2025Updated 11 months ago
- The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis" [ACL25]☆100Apr 9, 2025Updated last year
- The official code of "VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code Generation" [EMNLP25]☆19Sep 21, 2025Updated last year
- The first benchmark that asks code agents to build agents.☆24Jun 4, 2026Updated 4 months ago
- [ICCV 2025] The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration R…☆114Jul 9, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆165Oct 21, 2025Updated last year
- [ICML 2026] What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-…☆23May 15, 2026Updated 5 months ago
- A one-stop library to standardize the inference and evaluation of all the conditional image generation models. [ICLR 2024]☆180Dec 2, 2025Updated 10 months ago
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆150Nov 14, 2024Updated last year
- Official repository for "TrustGeoGen: Formal-Verified Data Engine for Trustworthy Multi-modal Geometric Problem Solving"☆23Sep 1, 2025Updated last year
- ☆21Sep 14, 2026Updated last month
- Demo page of TAVGBench: Benchmarking Text to Audible-Video Generation☆16Apr 7, 2025Updated last year