By Allergen Bureau
-

ChatGPT falls short in educating parents about food allergen management

Many parents of food allergic children struggle with concerns regarding safety and turn to the internet for information about various allergy management strategies. A recent study assessed the accuracy of ChatGPT as a self-guided educational resource for parents of children undergoing Oral Immunotherapy (OIT) for food allergies.

ChatGPT, part of the latest generation of AI technology, has gained widespread recognition for its ability to conduct human-like conversations and address a wide range of topics. Although not specifically designed for health care, ChatGPT’s potential to respond to consumer health questions is being widely explored.

Previous research has examined ChatGPT’s responses to patients’ health care questions in comparison to responses from verified physicians on an online social media forum. Results indicated that nearly 80 per cent of healthcare providers evaluating the answers preferred the AI responses, citing their quality and empathy.

In the latest study, 16 OIT experts rated each ChatGPT response to 14 questions, categorised as basic, advanced, or medical. ChatGPT responses were complex, requiring high level reading ability. Understandability was scored between 73-84 per cent across the 14 questions.

The study concluded that while ChatGPT provides comprehensive and intelligible answers, there are notable limitations in readability and complexity that need addressing to enhance its effectiveness as a food allergy educational tool for the public.

Reference: Rafeh, et al. Can ChatGPT provide parent education for Oral Immunotherapy (OIT)?

Annals of Allergy, Asthma & Immunology. 2025, DOI: 10.1016/j.anai.2025.04.011