Alternatives and similar repositories for MedAgentBench

Users that are interested in MedAgentBench are comparing it to the libraries listed below

• som-shahlab / medalign
  MedAlign is a clinician-generated dataset for instruction following with electronic medical records.
  ☆94Updated last month
• wshi83 / EhrAgent
  [EMNLP'24] EHRAgent: Code Empowers Large Language Models for Complex Tabular Reasoning on Electronic Health Records
  ☆100Updated 6 months ago
• UCSC-VLAA / MedReason
  MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs
  ☆184Updated last week
• mitmedialab / medical_hallucination
  Medical Hallucination in Foundation Models and Their Impact on Healthcare (2025)
  ☆61Updated 3 months ago
• KaiHe-better / LLM-for-Healthcare
  ☆124Updated last year
• Google-Health / med-gemini-medqa-relabelling
  For Med-Gemini, we relabeled the MedQA benchmark; this repo includes the annotations and analysis code.
  ☆49Updated last year
• zzachw / llemr
  NeurIPS'24 DB (Spotlight) | Instruction Tuning Large Language Models to Understand Electronic Health Records
  ☆36Updated 6 months ago
• SamuelSchmidgall / AgentClinic
  Agent benchmark for medical diagnosis
  ☆206Updated 5 months ago
• openlifescience-ai / Open-Medical-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for Medical LLMs (and beyond)
  ☆121Updated 9 months ago
• abachaa / MEDEC
  ☆37Updated 3 weeks ago
• BIDS-Xu-Lab / Me-LLaMA
  A novel medical large language model family with 13/70B parameters, which have SOTA performances on various medical tasks
  ☆153Updated 5 months ago
• StanfordMIMI / clin-summ
  Clinical text summarization by adapting large language models
  ☆143Updated 10 months ago
• som-shahlab / ehrshot-benchmark
  A benchmark for few-shot evaluation of foundation models for electronic health records (EHRs)
  ☆176Updated 2 weeks ago
• ncbi / MedCPT
  Code for MedCPT, a model for zero-shot biomedical information retrieval.
  ☆185Updated last year
• eth-medical-ai-lab / MIRIAD
  MIRIAD is a million scale Medical Instruction and RetrIeval Datatset
  ☆78Updated last week
• nyuolab / NYUTron
  public code repository for paper "Health system scale language models are general purpose clinical prediction engines"
  ☆113Updated last year
• m42-health / med42
  ☆55Updated last year
• UCSC-VLAA / o1_medical
  ☆48Updated 4 months ago
• Andy-jqa / biomedical-qa-datasets
  Biomedical Question Answering Datasets.
  ☆112Updated last month
• abhinand5 / MedEmbed
  MedEmbed is a collection of embedding models fine-tuned specifically for medical and clinical data.
  ☆64Updated 8 months ago
• gersteinlab / medagents-benchmark
  MedAgentsBench: Benchmarking Thinking Models and Agent Frameworks for Complex Medical Reasoning
  ☆45Updated this week
• som-shahlab / femr
  FEMR (Framework for Electronic Medical Records) provides tooling for large-scale, self-supervised learning using electronic health record…
  ☆144Updated this week
• mila-iqia / ddxplus
  ☆85Updated 2 years ago
• Medical-Event-Data-Standard / meds
  Schema definitions and Python types for Medical Event Data Standard, a standard for medical event data such as EHR and claims data
  ☆62Updated last month
• hiesingerlab / almanac-retrieval
  Almanac: Retrieval-Augmented Language Models for Clinical Medicine
  ☆33Updated last year
• kaneplusplus / icd-10-cm-embedding
  LLM Embeddings for ICD 10 Data
  ☆51Updated 6 months ago
• microsoft / chexprompt
  Expert-level AI radiology report evaluator
  ☆32Updated 2 months ago
• som-shahlab / hf_ehr
  Training HuggingFace models on EHR data
  ☆26Updated 3 weeks ago
• AIM-Harvard / SDoH
  Large Language Models to Identify Social Determinants of Health in Electronic Health Records | Paper: https://www.nature.com/articles/s41…
  ☆45Updated last year
• HanjieChen / ChallengeClinicalQA
  Repo for the pape Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questions
  ☆38Updated 10 months ago