A caregiver asked AI what to watch for in their father on cancer therapy + COPD. AI answered instantly. Never asked a single question first.

The answer was clear. Confident. Sounded complete. It was built on nothing.

What AI never asked:

• Which cancer. Which stage.
• Which chemotherapy. Which cycle.
• Current COPD severity.
• Other medications running alongside.
• Any recent changes in breathing, weight, or energy.
• Last bloodwork results.

Without those, the response wasn't about this patient.

It was about a generic version of this patient that AI constructed silently and presented as if it were real.

Why this specific scenario is high stakes:

Cancer therapy + COPD isn't one condition.

It's two serious conditions interacting, where:

• Chemo side effects can mimic COPD flares.
• COPD flares can look like treatment reactions.
• The overlap between the two is where dangerous things get missed.
• And where the right answer depends entirely on specifics AI never had.

The pattern:

1. Complex patient - instant confident answer - no questions asked.
2. That confidence isn't a sign of accuracy.
3. It's a sign of a system designed to respond, not to verify.

What a clinician does instead:

• Slows down.
• Asks about the specific drugs.
• Asks about baseline breathing.
• Asks what "recent" means.
• Asks what changed.
• Then answers.

TL;DR: AI gave caregiving advice for a cancer + COPD patient without knowing the cancer, the drugs, the stage, or the baseline. The answer felt complete. The information it was built on wasn't.

Caregivers are one of the most vulnerable groups using AI health tools, often exhausted, scared, and making real decisions alone at 2 am. If AI is going to be in that space, what's the minimum it should be required to ask before answering something this complex?