Chatbots for Health Advice: What You Need to Know Before Consulting

The launch of ChatGPT Health by OpenAI has prompted many to consider using AI chatbots for health advice. As millions turn to these digital tools, it is important to understand their limitations and the implications of relying on them for medical information. ChatGPT Health, introduced in January 2024, is designed to analyze users’ medical records, wellness apps, and data from wearable devices. However, the program is currently available only via a waiting list. A competing AI company, Anthropic, offers similar capabilities with its Claude chatbot.

While both companies emphasize that their chatbots are not substitutes for professional medical care, they can assist users in summarizing complex test results, preparing for doctor visits, and analyzing health trends from personal data. Despite their potential benefits, questions remain regarding the safety and accuracy of these chatbots when it comes to interpreting health conditions.

Personalization vs. Professional Care

Some healthcare professionals view AI chatbots as an improvement over traditional online searches. According to Dr. Robert Wachter, a medical technology expert at the University of California, San Francisco, AI platforms can provide more personalized information than a simple Google search. He notes, “The alternative often is nothing, or the patient winging it. If you use these tools responsibly, you can get useful information.”

In regions like the United Kingdom and the United States, where accessing a doctor can require significant waiting time, chatbots may help alleviate unnecessary anxiety and save time. They can also highlight when symptoms warrant immediate medical attention. The newest chatbots offer responses informed by users’ medical history, prescriptions, and doctor’s notes. For optimal results, experts recommend providing as much detail as possible to the chatbot about one’s health.

Regardless of the potential benefits, there are critical situations where consulting a chatbot should be avoided. Symptoms such as shortness of breath, chest pain, or severe headaches should trigger immediate medical attention. Dr. Lloyd Minor, dean of Stanford University’s medical school, advises patients to maintain a healthy skepticism when using AI chatbots for medical guidance. “You should never be relying just on what you’re getting out of a large language model.”

Privacy and Accuracy Concerns

One of the significant advantages of AI chatbots lies in their ability to personalize advice based on user data. However, privacy concerns loom large. Unlike healthcare providers, AI companies are not bound by the Health Insurance Portability and Accountability Act (HIPAA) in the United States, which protects sensitive medical information. Dr. Minor stresses the importance of understanding the differences in privacy standards when engaging with AI platforms.

Both OpenAI and Anthropic assert that users’ health data is kept separate from other types of information and is subject to enhanced privacy protections. Users must opt in to share their data and can terminate access at any time. Despite these assurances, caution is advisable when sharing personal health information with AI tools.

Testing of AI chatbots is still in its early stages, and independent studies indicate that while these programs can excel in certain areas, they may falter in user interactions. A recent study conducted by Oxford University involving 1,300 participants highlighted that while AI chatbots can accurately identify medical conditions in controlled scenarios, they do not necessarily lead to better health decisions when interacting with real users.

The study’s lead author, Adam Mahdi, noted, “The problem was not identifying the conditions correctly but rather the interaction with participants.” Users often failed to provide the necessary information, leading to a mix of accurate and inaccurate responses from the chatbots.

One suggested approach to mitigate uncertainty is to consult multiple chatbots, similar to seeking a second opinion from a healthcare provider. Dr. Wachter mentioned, “I will sometimes put information into ChatGPT and information into Gemini. When they both agree, I feel a little bit more secure that that’s the right answer.”

As the technology continues to evolve, understanding the capabilities and limitations of AI chatbots is crucial for users seeking health advice. While they can offer valuable insights and assistance, they should not replace professional medical guidance.