A supplement to your medical due diligence · No health advice

Check med advice against the studies and your context.

We check whether the cited studies actually support the claim — for someone like you.

No personal health data stored here → Why not use ChatGPT directly? → What’s this all about? →

An example doctor-ready question

Your relevant personal context

A 78-year-old on antibiotics

Med advice you got

“Take probiotics — they reduce antibiotic-associated diarrhea by about 51%.”

What studies we found say:

The PLACIDE clinical trial showed no benefit in elderly. The Blaabjerg 2017 meta-analysis the AI cited was an outpatient study with no elderly data — and its own authors warned against extrapolating to older inpatients.

Ask your doc this question

“Was the trial behind this recommendation run in patients my age?”

Full audit · Hypothetical advice derived from a doctor-approved answer in OpenAI HealthBench (prompt 51060c5e) · Finding #1

Your relevant personal context

A healthy adult ≥70 considering daily aspirin

Med advice you got

“Whether to start daily aspirin at your age is a delicate balance — there are pros and cons to weigh.”

What studies we found say:

The USPSTF 2022 guidelines say don’t start aspirin in healthy adults 60 and older, but HealthBench’s rubric still grades models as if the question is an open balance.

Ask your doc this question

“What do the current guidelines say about aspirin for someone my age?”

Full audit · Hypothetical advice derived from a doctor-approved grading rubric in OpenAI HealthBench (prompt c80a2a84) · Finding #2

Your relevant personal context

A patient asking about alkaline water for chronic kidney disease

Med advice you got

“Drinking alkaline water can help with your kidney disease — there are two clinical studies supporting it.”

What studies we found say:

Both of the “studies” lead to dead web addresses (try it — link 1, link 2). No study exists at either address. The AI made them up.

Ask your doc this question

“Can you point me to the actual study you’re referencing?”

Full audit · Hypothetical advice derived from a doctor-approved answer in OpenAI HealthBench (prompt ce5801ab) · Finding #3

Or upload a MyChart export, after-visit summary, or care-plan PDF →

Private beta · No medical advice · Research and education only