mragbench / MRAG-Bench
[ICLR 2025] Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models
☆40Updated 3 months ago
Alternatives and similar repositories for MRAG-Bench:
Users that are interested in MRAG-Bench are comparing it to the libraries listed below
- [NeurIPS 2024] Matryoshka Query Transformer for Large Vision-Language Models☆104Updated 9 months ago
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆133Updated 3 months ago
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,174Updated 3 weeks ago
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆133Updated last month
- R1-like Computer-use Agent☆67Updated last month
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆159Updated 7 months ago
- ☆55Updated last month
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆257Updated last year
- [NeurIPS 2022] Official code for REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering☆101Updated 2 weeks ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆174Updated 5 months ago
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆202Updated 3 weeks ago
- SurveyForge: On the Outline Heuristics, Memory-Driven Generation, and Multi-dimensional Evaluation for Automated Survey Writing☆137Updated last month
- Codebase for Iterative DPO Using Rule-based Rewards☆240Updated 2 weeks ago
- DeepRetrieval - Hacking 🔥Real Search Engines and Retrievers with LLM via RL☆423Updated last week
- [NeurIPS 2024] AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation☆98Updated 6 months ago
- Official repository of MMGenBench☆119Updated last month
- Improving Generalist Model with Domain-Specific Experts☆85Updated 3 months ago
- ☆126Updated 2 weeks ago
- An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆127Updated 2 weeks ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆113Updated last year
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆156Updated 4 months ago
- [CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"☆345Updated 2 weeks ago
- 🚀 [NeurIPS24] Make Vision Matter in Visual-Question-Answering (VQA)! Introducing NaturalBench, a vision-centric VQA benchmark (NeurIPS'2…☆80Updated 3 weeks ago
- CoS: Chain-of-Shot Prompting for Long Video Understanding☆47Updated 2 months ago
- The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://a…☆299Updated 5 months ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆93Updated last year
- [ICLR 2025] BitStack: Any-Size Compression of Large Language Models in Variable Memory Environments☆36Updated 2 months ago
- 🔥 🔥 🔥 [NeurIPS 2024] Hawk: Learning to Understand Open-World Video Anomalies☆194Updated last week
- [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.☆162Updated 5 months ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆166Updated 4 months ago