DATEXIS / AMEGA-benchmarkLinks
AMEGA-LLM: Autonomous Medical Evaluation for Guideline Adherence of Large Language Models
☆24Updated 2 weeks ago
Alternatives and similar repositories for AMEGA-benchmark
Users that are interested in AMEGA-benchmark are comparing it to the libraries listed below
Sorting:
- Repo for the pape Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questions☆48Updated 6 months ago
- Official implementation for NeurIPS'24 paper: MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Making☆233Updated last year
- MedAgentsBench: Benchmarking Thinking Models and Agent Frameworks for Complex Medical Reasoning☆73Updated 4 months ago
- [NeurIPS 2024 Datasets and Benchmark Track Oral] MedCalc-Bench: Evaluating Large Language Models for Medical Calculations☆79Updated last month
- For Med-Gemini, we relabeled the MedQA benchmark; this repo includes the annotations and analysis code.☆66Updated last year
- [NeurIPS 2022] Code for "Retrieve, Reason, and Refine: Generating Accurate and Faithful Discharge/Patient Instructions"☆35Updated last year
- Agent benchmark for medical diagnosis☆277Updated last year
- [ICML 2025] MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding☆142Updated 6 months ago
- A new collection of medical VQA dataset based on MIMIC-CXR. Part of the work 'EHRXQA: A Multi-Modal Question Answering Dataset for Electr…☆95Updated this week
- Code repository for the framework to engage in clinical decision making task using the MIMIC-CDM dataset.☆49Updated last year
- A novel medical large language model family with 13/70B parameters, which have SOTA performances on various medical tasks☆167Updated last year
- [npj digital medicine] The official codes for "Towards Evaluating and Building Versatile Large Language Models for Medicine"☆75Updated 9 months ago
- MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents☆223Updated 2 months ago
- A Paper collection for LLM based Patient Simulators☆91Updated last month
- The official codes for "Can Modern LLMs Act as Agent Cores in Radiology Environments?"☆28Updated last year
- REMed: Retrieval-Enhanced Medical prediction model☆23Updated last year
- INSPECT dataset/benchmark paper, accepted by NeurIPS 2023☆43Updated 8 months ago
- EHRXQA: A Multi-Modal Question Answering Dataset for Electronic Health Records with Chest X-ray Images (NeurIPS 2023 D&B)☆91Updated this week
- Expert-level AI radiology report evaluator☆36Updated 10 months ago
- Clinically Adapted Model Enhanced from LLaMA☆89Updated 2 years ago
- [Nature Communications] The official codes for "Towards Building Multilingual Language Model for Medicine"☆274Updated 9 months ago
- A metric suite leveraging the logical inference capabilities of LLMs, for radiology report generation both with and without grounding☆92Updated 3 weeks ago
- Code repository to create the MIMIC-CDM Dataset.☆43Updated last year
- A Python tool to evaluate the performance of VLM on the medical domain.☆83Updated 6 months ago
- ☆25Updated this week
- PMC-VQA is a large-scale medical visual question-answering dataset, which contains 227k VQA pairs of 149k images that cover various modal…☆225Updated last year
- MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs☆256Updated 7 months ago
- Codes and Pre-trained models for RAMM: Retrieval-augmented Biomedical Visual Question Answering with Multi-modal Pre-training [ACM MM 202…☆29Updated 2 years ago
- MedAlign is a clinician-generated dataset for instruction following with electronic medical records.☆97Updated 8 months ago
- Code and data for MedQA☆353Updated 3 years ago