A comprehensive medical AI evaluation framework based on GAPS methodology. Features automated assessment pipeline, thoracic surgery dataset (92 cases), multi-model support, parallel processing, and clinical scoring. Supports OpenAI-compatible APIs including GPT, Claude, Gemini, Qwen with detailed analytics and visualization.
☆46Nov 3, 2025Updated last year
Alternatives and similar repositories for MedicalAiBenchEval
Users that are interested in MedicalAiBenchEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [EMNLP 2025] A real-world clinical benchmark for medical LLMs with physician validation — 2,996 questions from EHRs☆31Oct 20, 2026Updated 2 weeks ago
- MedResearcher-R1 is a deep research agent for medical scenarios, built on a knowledge-informed trajectory synthesis framework.☆525Sep 1, 2025Updated last year
- [ACM MM2026] This is the official implementation of MedCCO☆17Jul 12, 2026Updated 3 months ago
- This is the repo of the medical dialogue dataset 'imcs21' in CBLUE@Tianchi☆116Dec 27, 2022Updated 3 years ago
- ☆14Apr 21, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆222Jun 22, 2026Updated 4 months ago
- UCAgents: Unidirectional Convergence for Visual Evidence Anchored Multi-Agent Medical Decision-Making☆14Dec 15, 2025Updated 10 months ago
- An updated version of eICU Benchmark with an updated problem definition on LoS and Decompensation tasks☆14Aug 12, 2021Updated 5 years ago
- [ICML 2025] MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding☆185Sep 7, 2026Updated last month
- [Nature Communications] The official code for "Quantifying the Reasoning Abilities of LLMs on Real-world Clinical Cases".☆74Nov 7, 2025Updated 11 months ago
- [GRAIL @ MICCAI 2023] Prior-RadGraphFormer: A Prior-Knowledge-Enhanced Transformer for Generating Radiology Graphs from X-Rays☆15Jul 30, 2026Updated 3 months ago
- Beyond the Model: Scaling Medical Capability with a Large Verifier System☆216Sep 3, 2025Updated last year
- An agentic RL framework to enhance retreival-augmented reasoning in Diagnostic Policy☆106Feb 27, 2026Updated 8 months ago
- ☆19Jul 21, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- HuatuoGPT-3: RL-Only Domain Adaptation from Base Models via Off-Policy Seeding☆29Sep 24, 2026Updated last month
- [NeurIPS 2026] MedMemoryBench: Benchmarking Agent Memory in Personalized Healthcare.☆85Oct 8, 2026Updated 3 weeks ago
- ☆23Jun 4, 2026Updated 5 months ago
- ☆22Oct 26, 2026Updated last week
- ☆82Jul 31, 2026Updated 3 months ago
- ☆11May 22, 2024Updated 2 years ago
- EHRXQA: A Multi-Modal Question Answering Dataset for Electronic Health Records with Chest X-ray Images (NeurIPS 2023 D&B)☆104Feb 6, 2026Updated 8 months ago
- ☆39Oct 16, 2026Updated 2 weeks ago
- This project contains simple methods to measure sample relatedness and identify potential swaps and contamination☆10Jan 8, 2016Updated 10 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- KDD 2024 | FlexCare: Leveraging Cross-Task Synergy for Flexible Multimodal Healthcare Prediction☆19Sep 4, 2024Updated 2 years ago
- A virtual clinical environment for self‑evolving LLM diagnostic agents.☆115Feb 12, 2026Updated 8 months ago
- Official Implementation of "A General Model for Retinal Segmentation and Quantification"☆20Mar 9, 2026Updated 7 months ago
- The Official Repo for Paper: Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning☆26Apr 7, 2026Updated 6 months ago
- Build a knowledge graph from UMLS Knowledge Sources (2022) with load, visualize and query with Neo4j and Scispacy☆27Sep 7, 2022Updated 4 years ago
- [NeurIPS 2025] This is the official repository for "RAD: Towards Trustworthy Retrieval-Augmented Multi-modal Clinical Diagnosis"☆27Nov 21, 2025Updated 11 months ago
- ☆19Nov 3, 2025Updated last year
- [ICLR'25] Reasoning-Enhanced Healthcare Predictions with Knowledge Graph Community Retrieval☆66Apr 14, 2025Updated last year
- Our public repo ranked 1st 🏆🏆 at MMSports2023 challenge on segmentation task☆16Oct 31, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆33Oct 16, 2026Updated 2 weeks ago
- Haplotype-based somatic genome simulator☆10Apr 20, 2026Updated 6 months ago
- The official codes for "Can Modern LLMs Act as Agent Cores in Radiology Environments?"☆33Aug 28, 2026Updated 2 months ago
- This repository is for our survey paper: "A Comprehensive Survey on Multimodal RAG: All Combinations of Modalities as Input and Output"☆54Nov 21, 2025Updated 11 months ago
- ☆33May 15, 2026Updated 5 months ago
- ☆34Nov 27, 2025Updated 11 months ago
- The official implementation of the paper: [ProCNS: Progressive Prototype Calibration and Noise Suppression for Weakly-Supervised Medical …☆17Oct 26, 2026Updated last week