Over the past year, many individuals like Abi have begun relying on AI chatbots such as ChatGPT for help with their health issues.  Expert Guide: Should You Trust AI Chatbot Health Advice? The reason is simple: it has become difficult for people to see doctors, while artificial intelligence (AI) is available around the clock and can respond to questions immediately. Even wEven with AI technology passing certain medical tests, this raises the question of whether we can truly trust AI for health advice.

Why are people using AI as a source of health information?

AI chatbots provide a more personal and less threatening experience to people with health anxiety than searching for information through traditional methods. Abi, who lives in Manchester, described her experience with using AI as “solving a problem together,” as if she were having a conversation with a doctor. Expert Guide: Should You Trust AI Chatbot Health Advice?

In contrast to regular search engines, which usually emphasize the worst-case scenarios for health conditions, AI tools provide customized solutions for the specific symptom(s) they present. For example, when Abi suspected a urinary tract infection, ChatGPT suggested she visit a pharmacist, which led her to receive the correct antibiotics and saved time and worry.

For many users of AI, it provides quick access to reassurance, help with requests, and recommendations that offer direction without putting additional strain on the established health care system. Expert Guide: Should You Trust AI Chatbot Health Advice?

Expert Guide: Should You Trust AI Chatbot Health Advice

While AI has its advantages, it’s not an infallible resource; sometimes it misguides its users. When user Abi’s back was injured while hiking, the chatbot told her to head straight to the emergency room, as there was a good chance she may have sustained a serious internal injury.

After waiting hours in the ER, she learned that she had actually not sustained any serious, internal injury. Although the chatbots suggested a more cautious approach, the experience highlighted a clear issue: AI can sometimes offer highly confident insights that prove wrong.

What Do Experts Think?

Health professionals are becoming increasingly concerned that too many people are relying on AI for help with medical questions, as Chris Whitty expressed concern that we are at a particularly challenging moment in the life of AI; many are using types of AI that aren’t yet 100% reliable, and giving you confident but inaccurate information.

The University of Oxford found in a study that when chatbots were given a full medical history, they were correct 95% of the time. However, when real users generated text with chatbots during a conversation, it was correct only 35% of the time.

The drop in the accuracy level of conversational chatbots is due in large part because communicating symptoms is somewhat subjective, and different people have different amounts of symptoms (or mis-defined symptoms) to share; therefore, until all of the accounts are considered by a medical professional, the accounts cannot move to a median. Expert Guide: Should You Trust AI Chatbot Health Advice?

Expert Guide: Should You Trust AI Chatbot Health Advice.

Misinterpretation Risk

Users of AI chatbots seeking medical advice based on their symptoms may receive conflicting or inaccurate advice due to the nature of the information they enter into the system. For example, an AI chatbot was able to generate an incorrect recommendation (rest) for a patient who possesses neurological signs in their presenting symptoms (subarachnoid hemorrhage), even though they would require immediate medical attention.

This serves as an example of how seemingly minor variations in phrasing can lead to very different results, often with serious consequences. Expert Guide: Should You Trust AI Chatbot Health Advice?

Concern Regarding Misinformation

AI chatbots have been shown to disseminate inordinate amounts of misleading and/or false medical information. A study conducted by the Lundquist Institute for Biomedical Innovation found that of the 213 responses generated by various popular AI chatbots across domains, such as cancer therapies and nutrition, 119 (56%) were identified as problematic. Some chatbots suggested that naturopathic therapies may be effective cancer treatments, despite lacking scientific support.

Additionally, AI systems are designed to use an authoritative delivery style; therefore, users may not question or verify the information they receive, even if it appears incorrect.

Expert Guide: Should You Trust AI Chatbot Health Advice.

The Differences Between AI and Traditional Search

An important distinction between searching for medical information on an established, trusted medical website and searching directly with an AI chatbot is that AI provides answers in an informal, conversational manner, which may create an element of trust that is not accurate, according to Dr. Margaret McCartney. Expert Guide: Should You Trust AI Chatbot Health Advice?

Unlike manually searching for information, in that process, you are able to evaluate sources of information, determine if they are credible, and get several different perspectives on a subject; from an AI chatbot, you feel that your answer is definitive (final), thus making it more difficult for you to question the validity of that answer.
So, Should You Use AI Chatbots to Access Health Information?

The answer is to use AI chatbots as a tool to enhance your ability to gather information about your health; however, you should not entirely rely on AI for obtaining health-related information. Expert Guide: Should You Trust AI Chatbot Health Advice?

Chatbots provide a good source of information for the following purposes:

  • General health information
  • Understanding symptoms of an ailment
  • Deciding whether to seek medical attention

However, if you are seeking medical assistance for a serious issue or are unsure about your condition, it is critical that you consult a qualified healthcare professional. Many reputable companies that develop and sell AI chatbots advise users that this technology is not intended to replace healthcare professionals. Expert Guide: Should You Trust AI Chatbot Health Advice?

Conclusion

AI is changing the way we access information, including healthcare guidance. AI-based tools like ChatGPT offer users convenience and support; however, they are not always reliable or secure. As Abi stated, “Take everything you read in AI with a grain of salt.” Expert Guide: Should You Trust AI Chatbot Health Advice?
It can be dangerous to rely solely on technology for health information; you should always verify the information obtained through this medium before using it. Expert Guide: Should You Trust AI Chatbot Health Advice?