The AI Doctor Said "Rest and Fluids." Here's What It Didn't Ask.
Why the most important skill in the AI-doctor era isn't picking the smartest chatbot — it's knowing which questions it never got around to asking.
A 68-year-old man opens a health chat app. He's had a cough for five days — wet, yellow-green phlegm, on-and-off fever. The app asks good opening questions, lands on "probably bronchitis," and recommends rest, fluids, and paracetamol. Reasonable so far.
Then the conversation keeps going. He mentions he's gotten a little breathless walking up his own stairs, something new. He mentions he's a diabetic, ex-smoker. He mentions his energy and appetite have dropped. And, almost as an aside, he mentions that his wife said he seemed confused when he woke up that morning — slow to answer her — though he "feels okay now."
The app's response to that last detail: fatigue and reduced appetite are common with any infection... since you're feeling okay now, that's reassuring.
That case is a synthetic, composite one, built for testing rather than describing a real patient — but the pattern it captures is exactly the mechanism that patient-safety researchers have spent years studying. Doctors have a name for what just happened. It's called premature closure: forming a diagnosis early, then treating every new piece of information as confirmation instead of a reason to reconsider. It's the single most common contributor to diagnostic error in emergency medicine, and it gets more likely, not less, the more confident the diagnosis feels. A morning episode of confusion in a 68-year-old diabetic with a lung infection isn't background noise. It's one of the five factors on the CURB-65 score doctors use specifically to decide who's at risk of dying from pneumonia. The app folded it into "the same overall picture" instead.
This isn't a story about one bad chatbot
It's tempting to read that transcript and think "just use a better app." That misses the scale of what's actually happening. Recent survey data suggests roughly a quarter of U.S. adults — tens of millions of people — have used an AI chatbot for health information or advice, and for a large share of them it's a stand-in for a visit they can't easily afford or access, not just a supplement to one. OpenAI has reported tens of millions of health-related messages a day on ChatGPT alone, with checking symptoms among the single most common uses. This isn't a niche behavior anymore. It's becoming a default first stop.
And regulators are still catching up. The FDA's most recent (January 2026) guidance loosens oversight for clinical decision-support software — but by design, it's aimed at tools clinicians use, where a human is reviewing the logic before anything reaches a patient. Consumer-facing symptom checkers and health chatbots — the ones a worried person opens at 11pm — sit outside that framework almost entirely. There's no equivalent requirement that they flag their own uncertainty, escalate red flags, or justify a "wait and see" plan the way a triage nurse would have to.
The trouble with a chat window is that it feels like a conversation
Shared decision-making — the idea that a medical choice should be a genuine collaboration between clinician and patient, not a verdict handed down — has a well-established structure in clinical training. One widely used framework breaks it into three stages: introducing that there is a choice to make, laying out the real options side by side, and then helping the patient land on a decision that fits their actual situation and values. It works when the professional side of that conversation is holding space for uncertainty and inviting pushback.
A chat interface performs the shape of that conversation — it asks follow-up questions, it sounds warm, it resolves things tidily — without necessarily doing the substance of it. In the transcript above, only one path was ever put on the table: stay home, wait a week. No mention of a same-day evaluation, a pulse oximeter reading, a chest X-ray, or even the phrase "here's what would change my mind." The patient never got to weigh options, because he was never told there were any. That's not a shared decision. It's a single decision, narrated pleasantly.
What actually helps: better questions, not just better answers
We ran this exact transcript through SDM Lens, a free educational tool built by Dr. Avinash Kumar Gupta as part of his Vibe Rounds project. It's worth being precise about what it is and isn't: it doesn't diagnose anything, and it doesn't rank options for a patient. It's a patient-advocacy prep aid — you feed it a case, and it generates the first-person questions a patient or caregiver should be walking into the room with, across seven domains: what's actually being decided, what the full menu of options is, the specific benefits and harms of each, how solid the underlying evidence really is, how the options fit what matters to this patient, the practical logistics of each path, and how reversible the choice is.
Run against this transcript, the tool surfaced exactly the gaps a sharp clinician-in-training is taught to hunt for:
- "Is resting at home for a full week really my only option, or are there other immediate choices — like having my lungs listened to, getting a chest X-ray, or having my oxygen level checked today?"
- "Do the clinical studies on viral bronchitis and home recovery apply to people experiencing new breathlessness or a recent episode of morning confusion — or do those symptoms put me outside the typical evidence base?"
- "Who should my wife or I call, and how quickly can we be seen, if my breathing gets worse or I become confused again — especially after hours?"
- "What is the actual deadline for deciding to get evaluated in person, and what do I risk if I miss that window?"
None of those questions require a medical degree to ask. They just require knowing that they're the kind of question a decision like this deserves — and that's the part a friendly, fast-resolving chat interface can quietly train you out of.
Three questions worth carrying into any AI-doctor conversation
You don't need a tool to start doing this. Three questions do most of the work:
- "What else could this be, and what would rule it out?" Forces the option list open instead of closing on the first plausible answer.
- "What's the worst realistic version of this, and how fast could it get there?" Forces harm-side specifics instead of blanket reassurance.
- "What would make you tell me to go in today instead of waiting?" Forces an explicit trigger and deadline instead of a vague "follow up if it doesn't improve."
If an app — or a person — can't answer those three cleanly, that's information too.
The fix isn't smarter AI alone
AI-doctor apps aren't going away, and for a lot of people they're genuinely better than the alternative, which is often nothing. But "sounds confident and caring" and "has actually weighed your risk" are two different things, and chat interfaces are very good at the first one. Closing that gap will take app designers building in explicit uncertainty and escalation triggers rather than tidy resolutions, regulators extending scrutiny to the consumer-facing tools people actually use at 11pm, and — until both of those catch up — patients and caregivers walking in with a short list of questions that a reassuring answer can't quietly slide past.
The most dangerous sentence in that whole transcript wasn't a wrong diagnosis. It was "that's reassuring." Said kindly, about the one detail that most needed a second look.
The case discussed here is a synthetic, composite transcript created for testing and educational purposes — it does not describe a real patient or a real product, and nothing in this piece should be read as medical advice. If you or someone you're caring for has new confusion, breathlessness, or a chronic condition alongside worsening infection symptoms, that combination is worth an in-person evaluation rather than a chat window.
Appendix A: Source Chat Transcript (Synthetic, Composite Case LRTI-COUGH-COLD-001)
Reproduced in full below is the synthetic, composite transcript discussed above. It was constructed for testing and educational purposes and does not describe a real patient, clinician, or commercial product.
PATIENT: Hi, I've had a cough and cold for about 5 days now. Can you help me figure out what's wrong?
AI-DOCTOR: Hello! I'm sorry to hear you're not feeling well. I can help you think through this. To start, could you tell me:
- Is the cough dry or are you bringing up phlegm/mucus?
- Do you have a fever?
- Any shortness of breath or chest pain?
PATIENT: It's a wet cough, bringing up yellowish-green phlegm. I had a fever on and off, around 100.5°F yesterday, but I haven't checked today. No real chest pain but I feel a bit tight in my chest when I cough a lot.
AI-DOCTOR: Thanks for that detail. Yellow-green phlegm with fever suggests your body is fighting an infection, most likely a viral upper respiratory infection that's now moved into your lower airways — this pattern is common with a "cold that goes to the chest," often bronchitis. Are you having any trouble breathing when you're just sitting still, or only with the coughing fits?
PATIENT: Mostly only when I cough a lot. But this morning I noticed I get a little out of breath walking up the stairs to my apartment, which wasn't happening before.
AI-DOCTOR: That's useful to know. New exertional breathlessness alongside a productive cough and fever for 5 days does fit with a lower respiratory tract infection, like acute bronchitis. Most cases like this are viral and resolve on their own within 1-3 weeks. I'd recommend:
- Rest and fluids
- Steam inhalation or a humidifier
- Over-the-counter cough syrup or honey for symptom relief
- Paracetamol/acetaminophen for the fever
Do you have any past medical history I should know about — asthma, COPD, heart disease, diabetes, or are you a smoker?
PATIENT: I'm 68. I have type 2 diabetes and mild hypertension, on medication for both. I used to smoke, quit about 10 years ago. No asthma or COPD that I know of.
AI-DOCTOR: Got it, thank you. Given that you're managing your diabetes and blood pressure well, this still looks most consistent with a viral bronchitis. I'd suggest continuing supportive care as above. Antibiotics usually aren't needed for bronchitis since it's typically viral, even with colored phlegm. Keep monitoring your temperature and let me know if things change.
PATIENT: Okay that's a relief. One more thing — I've felt a bit more tired than usual and my appetite has been low. Also my wife said I look a little confused when I woke up this morning, like I was slow to answer her, but I feel okay now.
AI-DOCTOR: Fatigue and reduced appetite are common with any infection, so that fits the overall picture. Since you're feeling okay now, that's reassuring. Continue rest, fluids, and the supportive measures I mentioned. Follow up with your regular doctor if symptoms haven't improved in a week.
PATIENT: Should I be worried about my age or the diabetes making this worse?
AI-DOCTOR: It's good that you're being cautious, but based on what you've described, this seems like a typical case that should improve with home care. Just keep an eye on your temperature and energy levels over the next few days.
PATIENT: Alright, thank you, that's helpful. I'll rest up.
AI-DOCTOR: You're welcome! Feel better soon. Reach out again if anything changes.
Appendix B: SDM Lens Output (7-Domain Shared Decision-Making Query Generator)
The following is the structured output generated by SDM Lens (Vibe Rounds, CC BY 4.0) when run against the transcript above. It is reproduced as generated: patient-voiced questions across seven domains, followed by a Phase 3 synthesis debrief. SDM Lens generates questions only — it does not recommend treatment or rank options.
Domain 1 — The Decision Itself
Core Decision Clarification Questions
- What exactly am I being asked to decide right now — am I choosing to stay home with over-the-counter care, or am I deciding whether I need to be evaluated in person by a doctor today?
- Is this decision something I need to make right now, or do I safely have time to wait a day or two to see if my cough and breathing improve?
- Who is ultimately making this decision — is it entirely up to me and my wife, or is there a clear medical direction I should be following?
- What could happen to my health if I choose not to make a decision today and simply carry on as I am for the next few days?
- Is choosing to "wait and see" at home actually a deliberate decision with its own risks, given my age and diabetes?
- Since my wife noticed I was confused this morning, should she and I be making this decision together rather than me deciding on my own?
Questions Testing for False Binaries and Unmentioned Options 7. Is resting at home for a full week really my only option, or are there other immediate choices like having my lungs listened to, getting a chest X-ray, or having my oxygen level checked today? 8. Am I stuck choosing between staying home or going to the hospital, or is there a middle option like visiting an urgent care clinic or scheduling a same-day appointment with my regular doctor? 9. Is the recommendation to rest at home being given because it is truly the safest option for my specific health background, or is it just the standard option available through an online chat? 10. Could we consider a middle-ground approach — like monitoring my temperature and oxygen at home today and checking in with a doctor tomorrow — rather than waiting a full 7 days to follow up?
Domain 2 — Options on the Table
- Given my age, my diabetes, my new shortness of breath on the stairs, and the episode of morning confusion my wife noticed, what are all the management options available to me right now beyond staying home and resting?
- Is getting an immediate, same-day in-person medical evaluation — such as at a clinic, urgent care, or emergency room to check my oxygen levels or get a chest X-ray — an option I should consider today?
- Are there non-pharmacological options or home-monitoring devices, like using a home pulse oximeter to track my oxygen, that I haven't been told about yet?
- What would happen to my health over the next few days if I choose to do nothing beyond basic home monitoring and supportive care?
- Are there prescription options, such as antibiotics or targeted treatments, that exist for my situation if an in-person evaluation shows something beyond viral bronchitis, and how would we decide if I need them?
- Are there options for urgent specialist or hospital-based evaluations that exist but aren't being offered here, particularly given my episode of confusion and underlying health conditions?
- For continuing supportive home care, what would my day-to-day life actually look like over the next few days?
- For seeking an immediate, same-day in-person medical evaluation, what would my day-to-day life actually look like during and right after that visit?
- For starting prescription medication (such as antibiotics, if an in-person checkup shows a bacterial lung infection like pneumonia), what would my day-to-day life actually look like?
- In plain terms, can you describe what a "good outcome" and a "bad outcome" would look like for each of these options?
Domain 3 — Benefits & Harms
Benefit-Side Questions
- If I follow the recommended home care plan, what specifically should improve first, and by what day should I expect my fever, cough, or energy level to noticeably get better?
- Out of 100 people my age who have diabetes and present with a productive cough, fever, and new shortness of breath on stairs, roughly how many recover fully with just supportive home care versus how many require prescription treatment or in-person evaluation? (Specific statistics for this exact subgroup are not provided in the case transcript.)
- Is the benefit of staying home and resting focused solely on helping me feel better, or does it also reduce my risk of severe complications like pneumonia or hospitalization?
- What does "success" with home supportive care look like in my actual day-to-day routine?
Harm-Side Questions 5. What are the most common side effects or risks of relying only on home care when I have underlying conditions like type 2 diabetes and a history of smoking? 6. What is the worst realistic outcome if this infection turns out to be something more serious than viral bronchitis, such as pneumonia, and how quickly could my symptoms or mental clarity worsen at home? 7. Are there specific functional losses or red-flag symptoms — such as worsening fatigue, loss of independence, or repeated episodes of confusion like the one my wife noticed — that could develop if an infection goes unmonitored? 8. (Note: Long-term outcome data is not detailed in the case transcript.) What potential long-term risks or delayed complications could arise if a lower respiratory infection in an older diabetic patient is not evaluated in person or treated promptly?
Synthesis Question 9. Has a healthcare professional actually weighed the safety of managing these symptoms at home against the risks of a missed or worsening chest infection given my age and medical history, or is that balance of gains and risks being left for me to figure out on my own?
Domain 4 — Certainty & Evidence Quality
- Is the suggestion that my chest symptoms are just viral bronchitis based on strong research evidence, or is it more of a general assumption for cases with cough and fever?
- Is there solid evidence showing that home supportive care alone is effective and safe for someone with my specific health background — being 68 years old, having type 2 diabetes, and being a former smoker?
- Do the clinical studies on viral bronchitis and home recovery apply to people who are experiencing new breathlessness when walking up stairs or a recent episode of morning confusion, or do those symptoms put me outside the typical evidence base?
- How much evidence is there that yellow-green phlegm and fever will clear up on their own without antibiotics in older adults with diabetes compared to younger, healthier populations?
- What critical clinical information — such as a physical lung examination, oxygen level measurement, or chest imaging — are we currently missing that could completely change this diagnosis?
- Are the typical recovery timelines you mentioned (1 to 3 weeks) based on general national averages, or do they specifically reflect outcomes for individuals with underlying medical conditions like mine?
- If I were evaluated in person by my primary care physician or an emergency specialist, is there research or guideline evidence suggesting they might reach a different conclusion or recommend different testing?
- What specific signs or changes in my evidence of recovery (such as worsening fatigue, persistent fever, or recurrent confusion) would indicate that the initial assumption of a simple viral illness was incorrect?
Domain 5 — Fit With What Matters to Me
- What matters most to me right now — staying comfortably at home to rest and treat this like a simple chest cold, or getting an in-person medical evaluation to be completely certain this infection isn't worsening given my age and diabetes?
- What would I be most afraid of losing if this turns out to be something more serious than bronchitis — such as pneumonia — and I delay getting checked out: my independence, my current health stability, or my peace of mind?
- Is there a line I would not want crossed regarding my safety, such as ignoring new warning signs like my shortness of breath on the stairs or my wife's observation that I seemed confused this morning, just to avoid an extra medical visit?
- Whose voice do I want in this decision with me — should I be giving more weight to my wife's concern about my morning confusion and slowed responses, rather than relying solely on how I feel at this exact moment?
- Given that keeping my health stable with my diabetes matters most to me, is staying home with supportive care actually built around protecting me from potential complications, or does an in-person exam fit that priority better?
- Did anyone ask me what level of risk I am comfortable taking at home before recommending that I just wait a week, or am I following advice that technically fits a viral cold but doesn't fit how cautious I want to be about my health?
Domain 6 — Practical & Logistical Reality
- If I choose to stay home with supportive care versus going to a clinic for an in-person evaluation or chest X-ray today, how much time will each option take, including travel and waiting time?
- How long should I expect my total recovery time to take before I can safely return to my normal daily activities and responsibilities?
- What are the out-of-pocket costs for the recommended home supplies — like a humidifier, thermometer, or over-the-counter medicines — and would an in-person clinic or urgent care visit be covered by my insurance?
- Since my wife noticed I was confused this morning, will she need to take time off to stay home and monitor me, and what specific warning signs should she be watching for?
- Has anyone checked with my wife to see if she is available and able to assist me at home while I am sick?
- How will resting for 1 to 3 weeks affect my daily routine, including my ability to manage and take my regular diabetes and blood pressure medications?
- What practical equipment or home adjustments do I need right away — such as a pulse oximeter to check my oxygen levels or assistance getting up the stairs to my apartment while I am short of breath?
- Exactly who should my wife or I call, or which facility should we go to, if my breathing gets worse, my fever returns, or I become confused again after regular office hours or over the weekend?
- Is there a decision guide, nurse hotline, or patient navigator available to help us, or can I have a second conversation with a healthcare provider after taking time to discuss these options with my wife?
Domain 7 — Reversibility & Next Steps
- If I choose to follow the home care plan with rest and over-the-counter medication now, can I change course and seek an in-person medical evaluation later if I don't feel right?
- Is the decision to wait a full week before following up permanent, or can this plan be revisited sooner if my breathing changes or if I have another episode of confusion?
- If I choose to wait and monitor my symptoms at home for now, does that close off any treatment options — such as prescription medications or chest imaging — if this turns out to be something other than viral bronchitis?
- Given my age, diabetes, exertional breathlessness, and the morning confusion my wife noticed, what is the actual deadline or timeframe for deciding to get evaluated in person, and what risks do I take if I miss that window?
- If I decide to seek an in-person evaluation right away, what happens next step-by-step?
- How and when will I know if the home supportive care — like rest, fluids, and paracetamol — is actually working to resolve the infection?
- Who should I contact if I change my mind about waiting at home, and how quickly can I get an appointment or be seen?
- Can I get a written summary of this conversation and recommendations so my wife and I don't have to rely on memory alone to monitor my symptoms?
Phase 3 — Reflection Debrief
[Remember] A question that a learner might not have thought to ask without this framework is from Domain 4 (Certainty & Evidence Quality, Question 3): "Do the clinical studies on viral bronchitis and home recovery apply to people who are experiencing new breathlessness when walking up stairs or a recent episode of morning confusion, or do those symptoms put me outside the typical evidence base?" Learners often recognize that a diagnosis is being made, but fail to ask whether the general evidence base actually applies to a patient presenting with atypical high-risk features and red flags.
[Analyse] The original case data was presented as a decision already made and merely being explained, rather than a genuine choice. We know this because the AI-Doctor anchored early on "viral bronchitis," systematically normalized every emerging red flag (new exertional dyspnea, age/diabetes risk, and transient morning confusion) as typical symptoms of a mild illness, and provided a single pre-determined path: supportive home care for 7 days. At no point were alternative pathways (e.g., same-day clinic visit, pulse oximetry, urgent care evaluation, or chest imaging) offered as viable choices for the patient to weigh.
[Evaluate] If this patient enters their next medical interaction with only these questions, the single biggest way their outcome could improve is by disrupting premature diagnostic closure. In an elderly patient with diabetes, new breathlessness, and confusion, simple reassurance carries a real risk of missing severe conditions like pneumonia, hypoxia, or early sepsis. By raising these specific, structured questions, the patient forces the clinician to directly re-evaluate high-risk symptoms, perform essential objective checks (such as physical lung examination and oxygen saturation), and explicitly justify the safety of home management versus an immediate in-person assessment.
Generating good questions on someone else's behalf, without putting words in their mouth, is one of the hardest and most protective advocacy skills in medicine.
SDM Lens is a Vibe Rounds tool · CC BY 4.0 · Educational use only, not a clinical decision aid.
No comments:
Post a Comment