{"id":28311,"date":"2026-05-05T17:52:12","date_gmt":"2026-05-05T17:52:12","guid":{"rendered":"https:\/\/www.europesays.com\/ai\/28311\/"},"modified":"2026-05-05T17:52:12","modified_gmt":"2026-05-05T17:52:12","slug":"should-you-ask-chatgpt-for-medical-advice-harvard-gazette","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ai\/28311\/","title":{"rendered":"Should you ask ChatGPT for medical advice?\u2014 Harvard Gazette"},"content":{"rendered":"<p>Physicians noticed something unusual in the late 2000s: Patients were coming to appointments armed with sometimes-dubious medical information they had gleaned online from \u201cDr. Google,\u201d according to Adam Rodman, an internist and AI researcher.<\/p>\n<p>Today, about <a href=\"https:\/\/www.kff.org\/public-opinion\/kff-tracking-poll-on-health-information-and-trust-use-of-ai-for-health-information-and-advice\/#:~:text=Findings-,Key%20Takeaways,mental%20health%20information%20or%20advice.\" rel=\"nofollow noopener\" target=\"_blank\">68 percent of adults<\/a> have turned to a search engine for medical advice in the past. But Dr. Google has a competitor. About <a href=\"https:\/\/www.kff.org\/public-opinion\/kff-tracking-poll-on-health-information-and-trust-use-of-ai-for-health-information-and-advice\/#:~:text=Findings-,Key%20Takeaways,mental%20health%20information%20or%20advice.\" rel=\"nofollow noopener\" target=\"_blank\">32 percent of adults<\/a>, approximately half of those who sought advice online, turned to AI chatbots for help.\u00a0<\/p>\n<p>Rodman thinks such resources, used appropriately, are an overall net good. In <a href=\"https:\/\/www.nytimes.com\/2026\/02\/17\/opinion\/doctors-patients-ai.html\" rel=\"nofollow noopener\" target=\"_blank\">op-eds<\/a> and <a href=\"https:\/\/www.youtube.com\/watch?v=NDMwP4fo5aw\" rel=\"nofollow noopener\" target=\"_blank\">online courses<\/a>, <a href=\"https:\/\/connects.catalyst.harvard.edu\/Profiles\/display\/Person\/159591\" rel=\"nofollow noopener\" target=\"_blank\">Rodman<\/a>, a Harvard Medical School assistant professor of medicine at Beth Israel Deaconess Medical Center, has shared advice for how to best employ Dr. Chat.\u00a0<\/p>\n<p>In this interview, edited for length and clarity, Rodman offers a stoplight system to figure out when it\u2019s safe to ask a chatbot, and when you should really just ask your doctor.<\/p>\n<p>How were doctors thinking about online medical information before the age of AI?\u00a0<\/p>\n<p>The early literature refers to this as the internet-informed patient. In the early 2000s, doctors noticed people would come into their appointments with articles they found online, but it was still only among really tech-savvy people. It certainly wasn\u2019t a normal interaction.\u00a0<\/p>\n<p>Then in the late 2000s, search engines started to take advantage of neural network technology, and they were able to serve up more relevant health information. They figure out what you\u2019re going to want to read next, and they give it to you.<\/p>\n<p>That\u2019s when we first got the phrase \u201cDr. Google,\u201d often used as a pejorative, from doctors who saw patients coming in with a level of confidence that may or may not have been earned.<\/p>\n<p>Of course, there are patients who know a lot about their health and are very well informed, but we also saw a lot of patients misinformed.\u00a0<\/p>\n<p>That\u2019s where we get this concept of cyberchondria. It\u2019s related to hypochondria: this idea that search engines can drive people to more and more extreme places until you go from googling your headache to reading about glioblastoma multiforme \u2014 and <a href=\"https:\/\/dl.acm.org\/doi\/abs\/10.1145\/1629096.1629101\" rel=\"nofollow noopener\" target=\"_blank\">research has shown<\/a> that it\u2019s a real phenomenon.\u00a0<\/p>\n<p>\u201cBoth Google and AI companies are now very aware that people are using their tools for health information and are trying to build in safety mechanisms.\u201d<\/p>\n<p>We all have understandable and reasonable anxieties about our health. Seeking out information is something fundamental about humanity.<\/p>\n<p>The problem is when that starts to interact with these recommendation algorithms that are optimized for engagement, and for showing you what you want to see even if it\u2019s incorrect.\u00a0<\/p>\n<p>Now let\u2019s bring AI into the mix. Is it any different to ask a chatbot about symptoms versus googling them?\u00a0<\/p>\n<p>It\u2019s nuanced. In one sense, LLMs do exactly what Google does: They serve you up the things you unconsciously want to hear, even if those things make you anxious.\u00a0<\/p>\n<p>On the other hand, unlike with a Google search, some people feel they have a relationship with an LLM. LLMs speak with extreme authority and confidence no matter what they say. It\u2019s under-explored the extent to which that could make cyberchondria worse.\u00a0<\/p>\n<p>Both Google and AI companies are now very aware that people are using their tools for health information and are trying to build in safety mechanisms. The bots will tell you to go to the emergency room or call your doctor, those sorts of things.<\/p>\n<p>But at least theoretically, language models are much, much better than Google, especially the more modern reasoning models, when it comes to identifying medical conditions.<\/p>\n<p>What do you mean by \u201ctheoretically\u201d?<\/p>\n<p>There was a very good <a href=\"https:\/\/www.nature.com\/articles\/s41591-025-04074-y\" rel=\"nofollow noopener\" target=\"_blank\">paper<\/a> earlier this year from a researcher named Andrew Bean that tested several LLMs and found they performed very well at identifying medical conditions alone, but did much worse in conversation with real people.<\/p>\n<p>What that shows is that user interaction matters a lot. The way people interact with the model, the clarity of their questions, matters. Those psychological phenomena we talked about are present in ways that are really hard to mitigate.\u00a0<\/p>\n<p>What kinds of health questions are safe to ask an LLM, and what kinds aren\u2019t?\u00a0<\/p>\n<p>I would divide it into a stoplight system. Red: never safe. Yellow: sometimes safe. Green: almost always safe.\u00a0<\/p>\n<p>In the green light are general questions about health, where the quality of the information is not particularly context-dependent.<\/p>\n<p>For example, \u201cI have diabetes and my doctor has told me I need to eat a diabetic diet. Here are some things I like to eat. Can you help me build a diabetic meal plan?\u201d Or \u201cI\u2019m trying to start a new exercise program, can you help?\u201d Or \u201cMy doctor just prescribed me amlodipine. What are some common side effects?\u201d\u00a0<\/p>\n<p>In the yellow light are questions where you want to involve a doctor in the loop. For example, prepping for your visits, understanding a visit after it happens, or understanding a test result that doesn\u2019t entirely make sense to you.<\/p>\n<p>Let\u2019s say you just left your doctor\u2019s visit and you\u2019re a little bit confused about what\u2019s going on. Log in to your patient portal, copy that note, take out your identifying information, plug it into an LLM, and then have a discussion.<\/p>\n<p>With these kinds of questions, you really need to make sure you\u2019re putting in enough health context to help LLM give you a good response. So you need to have some understanding of prompt engineering to get information that\u2019s helpful for you.<\/p>\n<p>In the red light \u2014 and I should stress that this might change in the future as technology develops \u2014 are things like asking an LLM how to manage a condition, if your doctor is prescribing the right medication, or why you were prescribed drug X over drug Y. These are highly contextual questions that the models aren\u2019t trained for.\u00a0<\/p>\n<p>In short, the best way people can use it right now is not as a replacement for medical advice but as a way to help prepare or increase your understanding before or after visits.\u00a0<\/p>\n<p>Are there privacy concerns when it comes to sharing health information with AI?\u00a0<\/p>\n<p>It\u2019s not inherently riskier to share data with an AI firm than with a search engine. That said, the major companies \u2014 OpenAI, Anthropic, Microsoft \u2014 are now developing health functions specifically so that people can put in their medical information directly, and that\u2019s quite new.<\/p>\n<p>Additionally, studies have shown people do share more information with an LLM than they would with a search engine. So from a technology perspective, it\u2019s no different, but in practice it is a much bigger security concern.\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"Physicians noticed something unusual in the late 2000s: Patients were coming to appointments armed with sometimes-dubious medical information&hellip;\n","protected":false},"author":2,"featured_media":28312,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[1691,580,6381,1668,157,2391,52],"class_list":{"0":"post-28311","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-openai","8":"tag-a-i","9":"tag-chatgpt","10":"tag-computers","11":"tag-health-care","12":"tag-openai","13":"tag-qa","14":"tag-research"},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/28311","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=28311"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/28311\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/28312"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=28311"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=28311"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=28311"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}