MiroEval: A benchmark and evaluation framework for deep research agents — 100 tasks (70 text, 30 multimodal) assessed across synthesis quality, factuality, and research process. 13 systems evaluated.
☆47Jul 6, 2026Updated last month
Alternatives and similar repositories for MiroEval
Users that are interested in MiroEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Source Code for DR3-Eval☆39Aug 12, 2026Updated last week
- Pushing Test-Time Scaling Limits of Deep Search with Asymmetric Verification☆22Oct 8, 2025Updated 10 months ago
- Self-Rewarding Sequential Monte Carlo for Masked Diffusion Language Models☆16Feb 17, 2026Updated 6 months ago
- MiroRL is an MCP-first reinforcement learning framework for deep research agent.☆248Aug 27, 2025Updated 11 months ago
- DeepResearchEval: An Automated Framework for Deep Research Task Construction and Agentic Evaluation.☆142Feb 10, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- MiroTrain is an efficient and algorithm-first framework research agent.☆142Aug 27, 2025Updated 11 months ago
- This repository contains the code and data for the paper "Chaining the Evidence: Robust Reinforcement Learning for Deep Search Agents wit…☆73Apr 8, 2026Updated 4 months ago
- Evaluation harness for Apodex-1.0 on public deep-research benchmarks.☆387Jun 8, 2026Updated 2 months ago
- WideSearch: Benchmarking Agentic Broad Info-Seeking☆151Oct 9, 2025Updated 10 months ago
- Fathom-DeepResearch: Unlocking Long Horizon Information Retrieval And Synthesis For SLMs☆63Oct 7, 2025Updated 10 months ago
- Make reasoning models scalable☆51Jun 2, 2026Updated 2 months ago
- DeepResearch Bench II (DRB2) is the follow-up to DeepResearch Bench, with a stronger focus on measuring the gap between deep research sys…☆83Aug 14, 2026Updated last week
- "DeepResearch-Eval: An End-to-End Evaluation Framework for DeepResearch Systems"☆50Oct 16, 2025Updated 10 months ago
- The official repo of "WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents"☆121Sep 29, 2025Updated 10 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Easy-to-Hard Learning for Information Extraction (ACL 2023 Findings)☆14Jul 11, 2023Updated 3 years ago
- ☆15Jul 2, 2026Updated last month
- [🏆ECCV'26] Official Repo for SlowBA: An efficiency backdoor attack towards VLM-based GUI agents☆18Jul 1, 2026Updated last month
- Official repo for ”Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thought“☆26Mar 29, 2026Updated 4 months ago
- Agent-Omit: Training Efficient LLM Agents for Adaptive Thought and Observation Omission via Reinforcement Learning☆33May 11, 2026Updated 3 months ago
- [ACL 2026 Main] Official repository for paper: OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agents☆48Apr 7, 2026Updated 4 months ago
- ☆25Dec 18, 2025Updated 8 months ago
- Kimi K2 Thinking Agentic Search Unofficial Implementation☆15Nov 9, 2025Updated 9 months ago
- COMPASS: A Framework for Evaluating Organization-Specific Policy Alignment in LLMs☆18Apr 7, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆18Apr 9, 2026Updated 4 months ago
- UQ: Assessing Language Models on Unsolved Questions☆30Aug 26, 2025Updated 11 months ago
- LLM Safeguarding with Internal Representations☆20Apr 27, 2026Updated 3 months ago
- Code for "Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous…☆47May 18, 2026Updated 3 months ago
- ☆10May 20, 2019Updated 7 years ago
- ☆58Apr 16, 2026Updated 4 months ago
- [AAAI 2026] This is the official implementation of the paper "ExtendAttack: Attacking Servers of LRMs via Extending Reasoning".☆26Mar 18, 2026Updated 5 months ago
- MiroMind-M1 is a fully open-source series of reasoning language models built on Qwen-2.5, focused on advancing mathematical reasoning.☆285Aug 12, 2025Updated last year
- [COLM 2026] Official implementation for "MonitorBench: A Comprehensive Benchmark for Chain-of-Thought Monitorability in Large Language Mo…☆20Apr 23, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆80Feb 6, 2026Updated 6 months ago
- Deep Data Research. Seek More, See Beyond.☆16Feb 6, 2026Updated 6 months ago
- you.com's framework for evaluating deep research systems.☆77May 15, 2025Updated last year
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆18Mar 15, 2024Updated 2 years ago
- [EMNLP '25] Source code for paper "ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance"☆40Aug 13, 2025Updated last year
- ☆16Jun 19, 2026Updated 2 months ago
- ☆14May 9, 2024Updated 2 years ago