DATEXIS / AMEGA-benchmarkLinks
AMEGA-LLM: Autonomous Medical Evaluation for Guideline Adherence of Large Language Models
☆24Updated this week
Alternatives and similar repositories for AMEGA-benchmark
Users that are interested in AMEGA-benchmark are comparing it to the libraries listed below
Sorting:
- Repo for the pape Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questions☆48Updated 6 months ago
- [NeurIPS 2024 Datasets and Benchmark Track Oral] MedCalc-Bench: Evaluating Large Language Models for Medical Calculations☆79Updated last month
- Official implementation for NeurIPS'24 paper: MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Making☆227Updated last year
- [ICML 2025] MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding☆140Updated 6 months ago
- MedAgentsBench: Benchmarking Thinking Models and Agent Frameworks for Complex Medical Reasoning☆71Updated 3 months ago
- For Med-Gemini, we relabeled the MedQA benchmark; this repo includes the annotations and analysis code.☆66Updated last year
- [NeurIPS 2022] Code for "Retrieve, Reason, and Refine: Generating Accurate and Faithful Discharge/Patient Instructions"☆35Updated last year
- The official codes for "Can Modern LLMs Act as Agent Cores in Radiology Environments?"☆28Updated 11 months ago
- A new collection of medical VQA dataset based on MIMIC-CXR. Part of the work 'EHRXQA: A Multi-Modal Question Answering Dataset for Electr…☆94Updated last year
- MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs☆250Updated 7 months ago
- INSPECT dataset/benchmark paper, accepted by NeurIPS 2023☆42Updated 7 months ago
- [npj digital medicine] The official codes for "Towards Evaluating and Building Versatile Large Language Models for Medicine"☆75Updated 8 months ago
- ☆28Updated 2 years ago
- [Nature Communications] The official codes for "Towards Building Multilingual Language Model for Medicine"☆273Updated 8 months ago
- Agent benchmark for medical diagnosis☆268Updated last year
- Code repository for the framework to engage in clinical decision making task using the MIMIC-CDM dataset.☆48Updated 11 months ago
- Expert-level AI radiology report evaluator☆35Updated 9 months ago
- MedAlign is a clinician-generated dataset for instruction following with electronic medical records.☆97Updated 8 months ago
- [Nature Communications] The official code for "Quantifying the Reasoning Abilities of LLMs on Real-world Clinical Cases".☆55Updated 2 months ago
- A novel medical large language model family with 13/70B parameters, which have SOTA performances on various medical tasks☆166Updated last year
- ☆130Updated last year
- Code and data for MedQA☆346Updated 3 years ago
- A Python tool to evaluate the performance of VLM on the medical domain.☆83Updated 5 months ago
- A survey on data-centric foundation models in healthcare.☆76Updated 11 months ago
- Curated papers on Large Language Models in Healthcare and Medical domain☆382Updated 7 months ago
- MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents☆201Updated last month
- Clinical text summarization by adapting large language models☆155Updated last year
- A Paper collection for LLM based Patient Simulators☆85Updated last week
- REMed: Retrieval-Enhanced Medical prediction model☆23Updated last year
- A benchmark for few-shot evaluation of foundation models for electronic health records (EHRs)☆209Updated 7 months ago